2024-09-12T21:59:35.326 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T21:59:35.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T21:59:35.465 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7902919' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8861 sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOI8C/uRa3GIGuTsgrSBJ4Xl+Y+3cqBHPLOcOEHtcu470zoiKNZ2A2y8ZMvUEoj+TMihHnCc3KvpcBVI7gTKDT8= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOvv7OGgKDSl5fED1gCBOpGZNG2O7T14lvMGbvJ98YueXT55/MRJaqU7gEA4BgnBsXrJwKah5StG45TqoI7r1k= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTriyqD+q3kt4Ipx70QbmDLOSLFj/k3BAoKLsRorJzUwM/fxKhfN3KBM7cDk7zoEU2w7j5itVIJuiL20zWPc30= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNelOMKzff3xB+VAlk9Wh493qUVkkVP1X5ppv3jx5A6R51Ffcdb7nSGRkd6OYqB+sEN6aOwcBzArntoDSvaTiM= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_21:32:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T21:59:35.465 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa; will attempt to use it 2024-09-12T21:59:35.466 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa/tasks 2024-09-12T21:59:35.466 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T21:59:35.467 INFO:teuthology.task.internal:Checking packages... 2024-09-12T21:59:35.489 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '086c737fa75c22d521a3932c59b31c5e1d1c9ef4' 2024-09-12T21:59:35.489 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T21:59:35.489 INFO:teuthology.packaging:ref: None 2024-09-12T21:59:35.489 INFO:teuthology.packaging:tag: None 2024-09-12T21:59:35.490 INFO:teuthology.packaging:branch: squid 2024-09-12T21:59:35.490 INFO:teuthology.packaging:sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T21:59:35.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T21:59:35.728 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-12T21:59:35.730 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T21:59:35.737 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T21:59:35.737 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T21:59:35.775 INFO:teuthology.task.internal:Saving configuration 2024-09-12T21:59:35.789 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T21:59:35.809 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T21:59:35.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:54:25.895446', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOI8C/uRa3GIGuTsgrSBJ4Xl+Y+3cqBHPLOcOEHtcu470zoiKNZ2A2y8ZMvUEoj+TMihHnCc3KvpcBVI7gTKDT8='} 2024-09-12T21:59:35.857 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:54:25.897463', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOvv7OGgKDSl5fED1gCBOpGZNG2O7T14lvMGbvJ98YueXT55/MRJaqU7gEA4BgnBsXrJwKah5StG45TqoI7r1k='} 2024-09-12T21:59:35.880 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:54:25.896463', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTriyqD+q3kt4Ipx70QbmDLOSLFj/k3BAoKLsRorJzUwM/fxKhfN3KBM7cDk7zoEU2w7j5itVIJuiL20zWPc30='} 2024-09-12T21:59:35.902 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 21:54:25.894201', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNelOMKzff3xB+VAlk9Wh493qUVkkVP1X5ppv3jx5A6R51Ffcdb7nSGRkd6OYqB+sEN6aOwcBzArntoDSvaTiM='} 2024-09-12T21:59:35.903 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T21:59:35.909 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T21:59:35.909 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['osd.0'] 2024-09-12T21:59:35.909 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['osd.1'] 2024-09-12T21:59:35.910 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['osd.2'] 2024-09-12T21:59:35.910 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T21:59:36.046 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a12d47ac0>, signals=[15]) 2024-09-12T21:59:36.046 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T21:59:36.053 INFO:teuthology.task.internal:Opening connections... 2024-09-12T21:59:36.053 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T21:59:36.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:59:36.134 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T21:59:36.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:59:36.210 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T21:59:36.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:59:36.285 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T21:59:36.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T21:59:36.362 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T21:59:36.370 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-12T21:59:36.390 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-12T21:59:36.390 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-09-12T21:59:36.448 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:59:36.449 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:59:36.449 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:59:36.449 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:59:36.449 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:59:36.449 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:59:36.449 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-12T21:59:36.473 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-09-12T21:59:36.491 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-09-12T21:59:36.492 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:59:36.549 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:59:36.550 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:59:36.550 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:59:36.550 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:59:36.550 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-09-12T21:59:36.573 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-12T21:59:36.591 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-12T21:59:36.592 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-12T21:59:36.650 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-12T21:59:36.650 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-12T21:59:36.650 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-12T21:59:36.650 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:59:36.651 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:59:36.652 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-12T21:59:36.673 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-09-12T21:59:36.691 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-09-12T21:59:36.691 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-09-12T21:59:36.749 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-09-12T21:59:36.749 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-09-12T21:59:36.749 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-09-12T21:59:36.749 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T21:59:36.750 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T21:59:36.751 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T21:59:36.751 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-09-12T21:59:36.773 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T21:59:36.783 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T21:59:36.816 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T21:59:36.816 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:59:36.819 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:59:36.822 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:59:36.825 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-09-12T21:59:36.842 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T21:59:36.849 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T21:59:36.849 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:59:36.877 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:59:36.879 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:59:36.882 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-09-12T21:59:36.987 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T21:59:37.092 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T21:59:37.107 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T21:59:37.107 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T21:59:37.107 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:59:37.108 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:59:37.108 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:59:37.109 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T21:59:37.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:59:37.126 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-12T21:59:37.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:59:37.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:59:37.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T21:59:37.128 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-12T21:59:37.129 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T21:59:37.129 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-12T21:59:37.183 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:59:37.183 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-12T21:59:37.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-12T21:59:37.188 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:59:37.189 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-503.el9.x86_64 2024-09-12T21:59:37.189 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-09-12T21:59:37.190 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:59:37.191 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-503.el9.x86_64 2024-09-12T21:59:37.191 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-503.el9.x86_64 2024-09-12T21:59:37.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-09-12T21:59:37.191 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-503.el9.x86_64 2024-09-12T21:59:37.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-09-12T21:59:40.633 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-12T21:59:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-12T21:59:41.765 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-12T21:59:42.930 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-12T21:59:42.974 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-09-12T21:59:45.107 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-12T21:59:47.041 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 20 MB 00:02 2024-09-12T21:59:48.197 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-12T21:59:49.392 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-12T21:59:49.931 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T21:59:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-12T21:59:50.718 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T21:59:51.450 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T21:59:52.224 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-12T21:59:52.901 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-12T21:59:52.979 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T21:59:53.629 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-12T21:59:55.851 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-12T21:59:56.149 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-12T21:59:57.326 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-12T21:59:58.114 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T21:59:58.114 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T21:59:58.211 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-12T21:59:58.218 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-12T21:59:58.219 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-09-12T21:59:58.220 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T21:59:58.220 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 79 M 2024-09-12T21:59:58.220 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 126 M 2024-09-12T21:59:58.220 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-12T21:59:58.505 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T21:59:58.533 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 79 kB/s | 23 kB 00:00 2024-09-12T21:59:58.635 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T21:59:59.102 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T21:59:59.592 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-12T22:00:00.367 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-12T22:00:00.630 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:00:00.630 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:00:00.728 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-12T22:00:00.737 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-12T22:00:00.738 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:00:00.739 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-12T22:00:00.739 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-12T22:00:00.739 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-12T22:00:00.851 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 13 MB/s | 35 MB 00:02 2024-09-12T22:00:00.851 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:00:00.851 INFO:teuthology.orchestra.run.smithi164.stdout:Total 30 MB/s | 79 MB 00:02 2024-09-12T22:00:01.078 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 269 kB/s | 23 kB 00:00 2024-09-12T22:00:01.133 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:00:01.133 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:00:01.218 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-12T22:00:01.224 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T22:00:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-12T22:00:01.224 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T22:00:01.224 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-12T22:00:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:00:01.224 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-12T22:00:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:00:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:00:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:00:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:00:01.225 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-12T22:00:01.225 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T22:00:01.225 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-09-12T22:00:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:00:01.226 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 79 M 2024-09-12T22:00:01.226 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 126 M 2024-09-12T22:00:01.226 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-12T22:00:01.386 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 200 kB/s | 23 kB 00:00 2024-09-12T22:00:01.445 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-12T22:00:01.534 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-12T22:00:01.845 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-12T22:00:01.894 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-12T22:00:01.894 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-12T22:00:02.137 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-12T22:00:02.245 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-12T22:00:02.245 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:00:02.245 INFO:teuthology.orchestra.run.smithi148.stdout:Total 52 MB/s | 79 MB 00:01 2024-09-12T22:00:02.745 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-12T22:00:02.841 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-12T22:00:02.841 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-12T22:00:02.928 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-12T22:00:03.045 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-12T22:00:03.046 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:00:03.046 INFO:teuthology.orchestra.run.smithi107.stdout:Total 43 MB/s | 79 MB 00:01 2024-09-12T22:00:03.296 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-12T22:00:03.297 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-12T22:00:03.728 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-12T22:00:04.080 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-12T22:00:04.080 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-12T22:00:04.240 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-12T22:00:04.240 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-12T22:00:05.039 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-12T22:00:05.040 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-12T22:00:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-12T22:00:05.469 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 1.2 kB/s | 1.7 kB 00:01 2024-09-12T22:00:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:00:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:06.706 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-12T22:00:07.412 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:00:07.495 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-12T22:00:07.534 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:00:07.535 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:00:07.624 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T22:00:07.637 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T22:00:07.638 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-09-12T22:00:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T22:00:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T22:00:07.638 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:00:07.638 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T22:00:07.639 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:00:07.639 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:00:07.639 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:00:07.639 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:00:07.639 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T22:00:07.639 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T22:00:07.639 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-09-12T22:00:07.640 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:00:07.640 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 79 M 2024-09-12T22:00:07.640 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 126 M 2024-09-12T22:00:07.640 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T22:00:07.979 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 355 kB/s | 23 kB 00:00 2024-09-12T22:00:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:00:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:08.848 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:08.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:11.180 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:11.963 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-12T22:00:13.791 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:13.837 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:15.278 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:15.388 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:15.519 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.8 MB/s | 29 MB 00:07 2024-09-12T22:00:16.017 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:16.055 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:17.230 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 35 MB 00:09 2024-09-12T22:00:17.266 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:00:17.266 INFO:teuthology.orchestra.run.smithi019.stdout:Total 8.2 MB/s | 79 MB 00:09 2024-09-12T22:00:17.943 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T22:00:18.324 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T22:00:18.324 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T22:00:18.698 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:19.349 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T22:00:19.349 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T22:00:20.207 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:20.897 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:21.997 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T22:00:22.667 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:00:22.747 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:25.551 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:25.810 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:30.931 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:30.968 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:36.112 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:57.248 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:57.295 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:57.627 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:57.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:00:57.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:57.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:58.449 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:58.449 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:00:58.449 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-12T22:00:58.449 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:00:58.449 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:00:58.449 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:00:58.449 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:00:58.450 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:00:58.450 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-12T22:00:58.811 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:00:58.897 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:00:58.898 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:00:58.898 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:00:58.898 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:00:58.898 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:00:58.898 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T22:00:58.898 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:00:58.898 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:00:58.956 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:00:58.957 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:00:58.957 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-09-12T22:00:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 82.el9 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8274670 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-09-12T22:00:58.994 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:00:58.995 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:00:58.996 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:00:58.996 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:00:58.997 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:00:59.000 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:59.352 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:59.352 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:00:59.352 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:59.353 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:59.493 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:00:59.494 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:00:59.494 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:00:59.494 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:00:59.620 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:01:00.192 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-12T22:01:00.358 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:01:00.358 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:01:00.358 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-12T22:01:00.358 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.359 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.359 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.359 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.359 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:01:00.359 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-12T22:01:00.543 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:01:00.623 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.623 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.624 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.624 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:01:00.624 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:01:00.624 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T22:01:00.624 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:01:00.624 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:01:00.683 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.683 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-12T22:01:00.724 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:01:00.725 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-12T22:01:00.725 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-12T22:01:00.726 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-12T22:01:00.726 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-12T22:01:00.726 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-12T22:01:00.726 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:01:00.726 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-12T22:01:00.726 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-12T22:01:00.726 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-12T22:01:00.727 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:01:00.727 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:01:00.727 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:01:00.727 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:01:00.727 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-12T22:01:00.728 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-12T22:01:00.728 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:01:00.728 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-12T22:01:00.728 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-12T22:01:00.728 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:01:00.728 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:01:00.729 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:01:00.729 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:01:00.729 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-12T22:01:00.729 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:01:00.729 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:01:00.730 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:01:00.730 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:01:00.814 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.814 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.814 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.814 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:01:00.814 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:01:00.815 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T22:01:00.815 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:01:00.815 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:01:00.873 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:00.874 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.874 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-09-12T22:01:00.905 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-09-12T22:01:00.906 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-09-12T22:01:00.906 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-09-12T22:01:00.906 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 82.el9 2024-09-12T22:01:00.906 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-09-12T22:01:00.906 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:01:00.906 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-09-12T22:01:00.906 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8274670 2024-09-12T22:01:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-09-12T22:01:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:01:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:01:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:01:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:01:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-09-12T22:01:00.908 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-09-12T22:01:00.908 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:01:00.908 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-09-12T22:01:00.908 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-09-12T22:01:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:01:00.908 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:01:00.909 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:01:00.909 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:01:00.909 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-09-12T22:01:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:01:00.909 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:01:00.910 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:01:00.911 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:01:00.911 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:01:00.938 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:01:00.973 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-09-12T22:01:00.976 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-12T22:01:00.991 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.TGSpHSIRHt 2024-09-12T22:01:00.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TGSpHSIRHt 2024-09-12T22:01:01.059 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.TGSpHSIRHt 2024-09-12T22:01:01.202 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.TGSpHSIRHt is 6KB 2024-09-12T22:01:01.223 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.TGSpHSIRHt 2024-09-12T22:01:01.241 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:01:01.302 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:01:01.302 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:01:01.302 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:01:01.302 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:01:01.303 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:01:01.427 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-12T22:01:01.454 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-09-12T22:01:01.597 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-09-12T22:01:02.838 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:01:02.870 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-12T22:01:02.873 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-12T22:01:02.889 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.Qcly76aRdm 2024-09-12T22:01:02.890 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Qcly76aRdm 2024-09-12T22:01:02.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.Qcly76aRdm 2024-09-12T22:01:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:01:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-09-12T22:01:03.035 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-12T22:01:03.051 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.E7gLpb0yGH 2024-09-12T22:01:03.051 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.E7gLpb0yGH 2024-09-12T22:01:03.091 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.Qcly76aRdm is 6KB 2024-09-12T22:01:03.120 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.E7gLpb0yGH 2024-09-12T22:01:03.141 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.Qcly76aRdm 2024-09-12T22:01:03.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:01:03.223 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:01:03.224 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:01:03.224 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:01:03.224 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:01:03.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:01:03.268 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.E7gLpb0yGH is 6KB 2024-09-12T22:01:03.317 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.E7gLpb0yGH 2024-09-12T22:01:03.333 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:01:03.374 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-12T22:01:03.395 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:01:03.396 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:01:03.396 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:01:03.396 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:01:03.397 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:01:03.545 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-09-12T22:01:15.162 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:01:15.204 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:01:15.542 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:01:15.542 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:01:15.542 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:01:15.542 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:01:16.326 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:01:16.326 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:01:16.326 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T22:01:16.327 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:16.327 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:01:16.327 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:01:16.327 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:01:16.327 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:01:16.327 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T22:01:16.700 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:01:16.792 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:16.793 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:01:16.793 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:01:16.793 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:01:16.793 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:01:16.793 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T22:01:16.793 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:01:16.793 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:01:16.852 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:01:16.852 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:01:16.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 82.el9 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-09-12T22:01:16.888 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8274670 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-09-12T22:01:16.889 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-09-12T22:01:16.890 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:01:16.890 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:01:16.890 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:01:16.890 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:01:16.890 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-09-12T22:01:16.890 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:01:16.890 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:01:16.891 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:01:16.891 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:01:16.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:01:17.601 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-12T22:01:18.874 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:01:18.906 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-12T22:01:18.908 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:01:18.922 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.162LqO1n8P 2024-09-12T22:01:18.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.162LqO1n8P 2024-09-12T22:01:18.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.162LqO1n8P 2024-09-12T22:01:19.127 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.162LqO1n8P is 6KB 2024-09-12T22:01:19.176 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.162LqO1n8P 2024-09-12T22:01:19.190 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:01:19.252 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:01:19.253 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:01:19.253 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:01:19.253 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:01:19.254 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:01:19.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-12T22:01:31.469 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T22:01:31.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:01:31.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:33.380 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T22:01:33.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:01:33.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:33.548 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T22:01:33.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T22:01:33.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:49.421 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T22:01:49.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:01:49.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:01:51.933 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-12T22:01:51.933 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-12T22:02:00.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:02:00.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:02:00.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T22:02:00.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:02:03.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-12T22:02:03.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-12T22:02:06.013 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-12T22:02:15.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:02:15.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:02:15.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:02:15.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:02:16.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T22:02:16.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:02:34.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-12T22:02:49.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T22:02:49.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:02:49.442 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T22:02:49.878 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-12T22:02:50.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T22:02:50.271 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:02:50.272 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-12T22:02:50.286 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:02:50.286 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:02:50.286 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:02:50.286 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:02:51.288 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T22:02:51.288 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:02:51.366 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-09-12T22:02:51.389 DEBUG:teuthology.parallel:result is None 2024-09-12T22:02:58.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:02:58.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:02:58.854 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T22:02:59.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:02:59.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:02:59.259 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T22:02:59.274 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:02:59.274 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:02:59.274 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:02:59.274 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:03:00.275 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T22:03:00.275 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:03:00.352 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-09-12T22:03:00.373 DEBUG:teuthology.parallel:result is None 2024-09-12T22:03:15.024 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T22:03:16.002 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T22:03:27.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:03:27.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:03:27.538 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-12T22:03:27.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:03:27.921 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:03:27.921 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-12T22:03:27.937 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:03:27.938 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:03:27.938 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:03:27.938 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:03:28.939 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T22:03:28.939 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:03:29.304 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-09-12T22:03:29.326 DEBUG:teuthology.parallel:result is None 2024-09-12T22:03:31.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:03:31.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:03:31.321 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-12T22:03:31.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:03:31.686 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:03:31.686 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-12T22:03:31.702 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:03:31.702 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:03:31.702 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:03:31.702 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:03:32.703 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T22:03:32.703 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:03:33.055 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-09-12T22:03:33.075 DEBUG:teuthology.parallel:result is None 2024-09-12T22:03:33.076 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T22:03:33.088 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T22:03:33.088 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:03:33.091 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:03:33.094 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:03:33.097 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:03:33.115 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T22:03:33.129 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T22:03:33.162 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T22:03:33.162 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:03:33.165 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:03:33.168 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:03:33.170 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:03:33.199 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T22:03:33.205 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T22:03:33.205 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:03:33.228 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:03:33.237 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:03:33.239 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:03:33.258 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.270 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.271 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.271 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.279 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.282 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.283 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.291 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:03:33.293 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T22:03:33.300 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T22:03:33.300 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:03:33.316 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:03:33.319 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:03:33.328 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:03:33.357 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T22:03:33.367 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T22:03:33.367 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:03:33.386 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:03:33.388 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:03:33.395 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:03:33.416 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:33.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:33.542 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:33.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:33.673 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:03:33.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:03:33.743 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:33.786 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:33.847 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:33.888 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:33.931 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:03:33.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:03:33.997 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:34.037 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:34.106 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:34.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:34.193 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:03:34.193 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:03:34.261 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:34.304 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:03:34.366 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:34.405 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:03:34.455 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:03:34.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:03:34.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-12T22:03:34.527 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-09-12T22:03:34.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-12T22:03:34.533 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-09-12T22:03:34.576 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:03:34.579 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:03:34.580 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:03:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:03:35.039 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T22:03:35.047 INFO:teuthology.task.internal:Starting timer... 2024-09-12T22:03:35.047 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T22:03:35.083 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T22:03:35.115 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T22:03:35.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-09-12T22:03:35.189 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-09-12T22:03:35.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-09-12T22:03:35.268 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-09-12T22:03:35.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-12T22:03:35.330 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-12T22:03:35.332 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-09-12T22:03:35.392 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-09-12T22:03:35.394 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T22:03:35.394 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-09-12T22:03:35.415 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-09-12T22:03:35.415 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-09-12T22:03:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-09-12T22:03:35.444 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-12T22:03:35.471 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-12T22:03:35.472 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-09-12T22:03:35.491 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-09-12T22:03:35.492 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-09-12T22:03:35.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:03:35.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:03:35.522 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:03:35.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:03:35.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:03:35.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:03:35.581 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:03:35.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:03:35.611 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T22:03:35.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:03:35.648 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:03:35.681 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:03:35.718 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:03:35.749 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T22:03:35.759 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T22:03:35.762 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T22:03:35.926 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T22:03:35.937 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T22:03:35.938 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi107.front.sepia.ceph.com,smithi148.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T22:07:24.485 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-09-12T22:07:24.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:07:24.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:07:24.566 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T22:07:24.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:07:24.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T22:07:24.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:07:24.726 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-12T22:07:24.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T22:07:24.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:07:24.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:07:24.876 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-12T22:07:24.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:07:24.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:07:24.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:07:25.034 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-12T22:07:25.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:07:25.113 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T22:07:25.126 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T22:07:25.127 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:07:25.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:07:25.130 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:07:25.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:07:25.133 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:07:25.133 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:07:25.135 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:07:25.135 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:07:25.160 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:07:25.164 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:07:25.164 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:07:25.175 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:07:25.179 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:07:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:07:25.183 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:07:25.198 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:07:25.200 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-09-12T22:07:25.205 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-12T22:07:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-09-12T22:07:25.211 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-09-12T22:07:25.216 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-12T22:07:25.221 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-09-12T22:07:25.222 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-09-12T22:07:25.225 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:07:25.231 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:07:25.233 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-09-12T22:07:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:07:25.239 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:07:25.245 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:07:25.248 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:07:25.252 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:07:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:07:25.297 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:07:25.300 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:07:25.300 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-12T22:07:25.300 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.300 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.301 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.301 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.303 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:07:25.308 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:07:25.308 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-12T22:07:25.308 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.308 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.308 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.308 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:07:25.319 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:07:25.319 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-12T22:07:25.319 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.320 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.320 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.320 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.320 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:07:25.324 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:07:25.324 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T22:07:25.324 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.324 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.324 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.324 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:07:25.324 INFO:teuthology.run_tasks:Running task install... 2024-09-12T22:07:25.332 DEBUG:teuthology.task.install:project ceph 2024-09-12T22:07:25.332 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}} 2024-09-12T22:07:25.332 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'} 2024-09-12T22:07:25.332 INFO:teuthology.task.install:Using flavor: default 2024-09-12T22:07:25.339 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T22:07:25.339 INFO:teuthology.task.install:extra packages: [] 2024-09-12T22:07:25.339 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:07:25.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:07:25.342 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:07:25.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:07:25.344 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:07:25.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:07:25.345 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:07:25.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:07:25.491 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:07:25.492 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:07:25.495 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:07:25.495 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:07:25.511 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:07:25.511 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:07:25.524 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:07:25.524 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:07:25.604 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:07:25.604 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:07:25.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:07:25.612 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:07:25.612 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:07:25.612 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:07:25.631 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:07:25.631 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:07:25.634 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:07:25.634 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:07:25.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:07:25.638 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:07:25.638 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:07:25.661 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:07:25.662 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:07:25.664 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:07:25.664 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:07:25.664 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:07:25.690 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:07:25.690 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:07:25.698 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:07:25.704 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:07:25.727 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:07:25.755 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:07:25.774 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:07:25.779 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:07:25.802 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:07:25.830 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:07:25.840 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-09-12T22:07:25.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-09-12T22:07:25.843 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-09-12T22:07:25.845 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-09-12T22:07:25.866 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-12T22:07:25.868 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-12T22:07:25.893 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-09-12T22:07:25.896 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-09-12T22:07:26.069 INFO:teuthology.orchestra.run.smithi164.stdout:45 files removed 2024-09-12T22:07:26.086 INFO:teuthology.orchestra.run.smithi019.stdout:45 files removed 2024-09-12T22:07:26.093 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-12T22:07:26.097 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:07:26.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:07:26.120 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:07:26.121 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-09-12T22:07:26.147 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:07:26.651 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 311 kB/s | 83 kB 00:00 2024-09-12T22:07:26.680 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 303 kB/s | 83 kB 00:00 2024-09-12T22:07:26.691 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 301 kB/s | 83 kB 00:00 2024-09-12T22:07:26.694 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 319 kB/s | 83 kB 00:00 2024-09-12T22:07:26.935 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T22:07:26.964 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T22:07:26.970 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-12T22:07:26.992 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-12T22:07:27.210 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T22:07:27.228 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T22:07:27.248 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-12T22:07:27.268 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T22:07:28.545 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.2 MB 00:01 2024-09-12T22:07:30.139 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-12T22:07:30.202 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-12T22:07:30.401 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-09-12T22:07:36.253 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 20 MB 00:06 2024-09-12T22:07:36.357 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 20 MB 00:05 2024-09-12T22:07:38.260 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 20 MB 00:06 2024-09-12T22:07:38.660 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 20 MB 00:07 2024-09-12T22:07:40.683 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T22:07:41.921 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-12T22:07:42.509 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-12T22:07:42.761 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.5 MB 00:00 2024-09-12T22:07:43.538 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-12T22:07:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-12T22:07:44.002 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-12T22:07:44.350 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T22:07:44.381 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-12T22:07:45.335 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T22:07:45.570 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-12T22:07:46.757 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T22:07:48.977 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T22:07:49.764 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T22:07:50.766 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T22:07:51.305 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:51.306 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:51.376 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-12T22:07:51.400 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:07:51.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:07:51.402 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:07:51.403 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:07:51.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:07:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:07:51.406 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:07:51.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:07:51.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:07:51.409 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:07:51.410 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:07:51.411 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:07:51.412 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-12T22:07:51.413 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-12T22:07:51.413 INFO:teuthology.orchestra.run.smithi148.stdout:Install 135 Packages 2024-09-12T22:07:51.413 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 4 Packages 2024-09-12T22:07:51.413 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:07:51.413 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 213 M 2024-09-12T22:07:51.413 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-12T22:07:52.065 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:52.066 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:52.086 INFO:teuthology.orchestra.run.smithi148.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-12T22:07:52.134 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-12T22:07:52.149 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-12T22:07:52.149 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-12T22:07:52.149 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-12T22:07:52.149 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-12T22:07:52.149 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:07:52.150 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:07:52.150 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:07:52.150 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:07:52.150 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:07:52.150 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:07:52.150 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:07:52.151 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:07:52.151 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:07:52.151 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:07:52.151 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:07:52.151 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:07:52.152 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:07:52.152 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:07:52.152 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:07:52.152 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:07:52.152 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:07:52.152 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:07:52.153 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:07:52.153 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:07:52.153 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:07:52.153 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:07:52.154 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:07:52.154 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:07:52.154 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:07:52.154 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:07:52.155 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:07:52.155 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:07:52.155 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:07:52.155 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:07:52.155 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:07:52.156 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-09-12T22:07:52.156 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:07:52.156 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:07:52.156 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:07:52.156 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:07:52.157 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-12T22:07:52.157 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:07:52.157 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:07:52.157 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:07:52.158 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:07:52.158 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:07:52.158 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:07:52.158 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:07:52.158 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:07:52.158 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:07:52.159 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:07:52.159 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:07:52.159 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:07:52.159 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:07:52.159 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:07:52.160 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:07:52.160 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:07:52.160 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:07:52.160 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:07:52.161 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:07:52.161 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:07:52.161 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:07:52.161 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:07:52.161 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:07:52.162 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:07:52.162 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:07:52.162 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:07:52.162 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:07:52.162 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:07:52.163 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:07:52.163 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:07:52.163 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:07:52.163 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:07:52.164 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:07:52.164 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:07:52.164 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:07:52.164 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:07:52.164 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:07:52.165 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:07:52.165 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:07:52.165 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:07:52.165 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:07:52.165 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:07:52.166 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:07:52.167 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:07:52.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:07:52.169 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:07:52.170 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:07:52.170 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:07:52.170 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:07:52.170 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:07:52.170 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:07:52.170 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:07:52.170 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout:Install 135 Packages 2024-09-12T22:07:52.171 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 4 Packages 2024-09-12T22:07:52.172 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:07:52.172 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 213 M 2024-09-12T22:07:52.172 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-12T22:07:52.253 INFO:teuthology.orchestra.run.smithi148.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 5.3 MB/s | 896 kB 00:00 2024-09-12T22:07:52.320 INFO:teuthology.orchestra.run.smithi148.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 2.1 MB/s | 145 kB 00:00 2024-09-12T22:07:52.355 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T22:07:52.529 INFO:teuthology.orchestra.run.smithi148.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 9.5 MB/s | 5.4 MB 00:00 2024-09-12T22:07:52.579 INFO:teuthology.orchestra.run.smithi148.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 9.2 MB/s | 2.4 MB 00:00 2024-09-12T22:07:52.646 INFO:teuthology.orchestra.run.smithi148.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-12T22:07:52.673 INFO:teuthology.orchestra.run.smithi107.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2024-09-12T22:07:52.938 INFO:teuthology.orchestra.run.smithi148.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-12T22:07:53.094 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:53.095 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:53.165 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-12T22:07:53.187 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:07:53.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:07:53.189 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:07:53.190 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:07:53.191 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:07:53.192 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:07:53.193 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:07:53.194 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:07:53.195 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:07:53.196 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:07:53.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:07:53.198 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout:Install 135 Packages 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 4 Packages 2024-09-12T22:07:53.199 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:07:53.200 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 213 M 2024-09-12T22:07:53.200 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-12T22:07:53.249 INFO:teuthology.orchestra.run.smithi148.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 16 MB/s | 21 MB 00:01 2024-09-12T22:07:53.257 INFO:teuthology.orchestra.run.smithi107.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.5 MB/s | 896 kB 00:00 2024-09-12T22:07:53.291 INFO:teuthology.orchestra.run.smithi148.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 606 kB/s | 25 kB 00:00 2024-09-12T22:07:53.399 INFO:teuthology.orchestra.run.smithi107.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.0 MB/s | 145 kB 00:00 2024-09-12T22:07:53.634 INFO:teuthology.orchestra.run.smithi164.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2024-09-12T22:07:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:(10/139): ceph-radosgw-19.1.1-314.g086c737f.el9 15 MB/s | 11 MB 00:00 2024-09-12T22:07:53.833 INFO:teuthology.orchestra.run.smithi148.stdout:(11/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 14 MB/s | 17 MB 00:01 2024-09-12T22:07:53.858 INFO:teuthology.orchestra.run.smithi148.stdout:(12/139): libcephfs-devel-19.1.1-314.g086c737f. 165 kB/s | 32 kB 00:00 2024-09-12T22:07:53.867 INFO:teuthology.orchestra.run.smithi164.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-12T22:07:53.925 INFO:teuthology.orchestra.run.smithi148.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.4 MB/s | 164 kB 00:00 2024-09-12T22:07:53.968 INFO:teuthology.orchestra.run.smithi164.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.4 MB/s | 145 kB 00:00 2024-09-12T22:07:53.984 INFO:teuthology.orchestra.run.smithi148.stdout:(14/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.9 MB/s | 753 kB 00:00 2024-09-12T22:07:54.026 INFO:teuthology.orchestra.run.smithi148.stdout:(15/139): librados-devel-19.1.1-314.g086c737f.e 1.2 MB/s | 127 kB 00:00 2024-09-12T22:07:54.032 INFO:teuthology.orchestra.run.smithi107.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 3.5 MB/s | 5.4 MB 00:01 2024-09-12T22:07:54.084 INFO:teuthology.orchestra.run.smithi148.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 4.9 MB/s | 506 kB 00:00 2024-09-12T22:07:54.159 INFO:teuthology.orchestra.run.smithi164.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 7.3 MB/s | 5.4 MB 00:00 2024-09-12T22:07:54.184 INFO:teuthology.orchestra.run.smithi148.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 452 kB/s | 45 kB 00:00 2024-09-12T22:07:54.285 INFO:teuthology.orchestra.run.smithi148.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.3 MB/s | 136 kB 00:00 2024-09-12T22:07:54.385 INFO:teuthology.orchestra.run.smithi164.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 5.7 MB/s | 2.4 MB 00:00 2024-09-12T22:07:54.385 INFO:teuthology.orchestra.run.smithi148.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.6 MB/s | 162 kB 00:00 2024-09-12T22:07:54.427 INFO:teuthology.orchestra.run.smithi164.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 5.7 MB/s | 1.5 MB 00:00 2024-09-12T22:07:54.457 INFO:teuthology.orchestra.run.smithi107.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 3.6 MB/s | 1.5 MB 00:00 2024-09-12T22:07:54.477 INFO:teuthology.orchestra.run.smithi148.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 3.4 MB/s | 320 kB 00:00 2024-09-12T22:07:54.585 INFO:teuthology.orchestra.run.smithi148.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 2.7 MB/s | 301 kB 00:00 2024-09-12T22:07:54.686 INFO:teuthology.orchestra.run.smithi148.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 995 kB/s | 99 kB 00:00 2024-09-12T22:07:54.707 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:54.708 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:07:54.715 INFO:teuthology.orchestra.run.smithi107.stdout:(6/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 1.8 MB/s | 2.4 MB 00:01 2024-09-12T22:07:54.780 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T22:07:54.786 INFO:teuthology.orchestra.run.smithi148.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 855 kB/s | 85 kB 00:00 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:07:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:07:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:07:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:07:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:07:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:07:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:07:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:07:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:07:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:07:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:07:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:07:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout:Install 135 Packages 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 4 Packages 2024-09-12T22:07:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:07:54.808 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 213 M 2024-09-12T22:07:54.808 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T22:07:54.903 INFO:teuthology.orchestra.run.smithi148.stdout:(24/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 6.1 MB/s | 5.3 MB 00:00 2024-09-12T22:07:55.003 INFO:teuthology.orchestra.run.smithi148.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-12T22:07:55.018 INFO:teuthology.orchestra.run.smithi164.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 7.4 MB/s | 4.7 MB 00:00 2024-09-12T22:07:55.070 INFO:teuthology.orchestra.run.smithi148.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 477 kB/s | 32 kB 00:00 2024-09-12T22:07:55.271 INFO:teuthology.orchestra.run.smithi148.stdout:(27/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 6.4 MB/s | 3.1 MB 00:00 2024-09-12T22:07:55.436 INFO:teuthology.orchestra.run.smithi164.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 11 MB/s | 21 MB 00:02 2024-09-12T22:07:55.511 INFO:teuthology.orchestra.run.smithi164.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 336 kB/s | 25 kB 00:00 2024-09-12T22:07:55.523 INFO:teuthology.orchestra.run.smithi019.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2024-09-12T22:07:55.579 INFO:teuthology.orchestra.run.smithi148.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 288 kB/s | 146 kB 00:00 2024-09-12T22:07:55.849 INFO:teuthology.orchestra.run.smithi107.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 3.4 MB/s | 4.7 MB 00:01 2024-09-12T22:07:55.963 INFO:teuthology.orchestra.run.smithi148.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 5.1 MB/s | 3.6 MB 00:00 2024-09-12T22:07:56.055 INFO:teuthology.orchestra.run.smithi148.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 2.7 MB/s | 249 kB 00:00 2024-09-12T22:07:56.121 INFO:teuthology.orchestra.run.smithi148.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 740 kB/s | 49 kB 00:00 2024-09-12T22:07:56.136 INFO:teuthology.orchestra.run.smithi164.stdout:(10/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 9.9 MB/s | 17 MB 00:01 2024-09-12T22:07:56.197 INFO:teuthology.orchestra.run.smithi148.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 219 kB/s | 16 kB 00:00 2024-09-12T22:07:56.211 INFO:teuthology.orchestra.run.smithi164.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 424 kB/s | 32 kB 00:00 2024-09-12T22:07:56.264 INFO:teuthology.orchestra.run.smithi148.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T22:07:56.320 INFO:teuthology.orchestra.run.smithi164.stdout:(12/139): ceph-radosgw-19.1.1-314.g086c737f.el9 8.1 MB/s | 11 MB 00:01 2024-09-12T22:07:56.353 INFO:teuthology.orchestra.run.smithi164.stdout:(13/139): libcephfs2-19.1.1-314.g086c737f.el9.x 5.2 MB/s | 753 kB 00:00 2024-09-12T22:07:56.404 INFO:teuthology.orchestra.run.smithi164.stdout:(14/139): libcephsqlite-19.1.1-314.g086c737f.el 1.9 MB/s | 164 kB 00:00 2024-09-12T22:07:56.425 INFO:teuthology.orchestra.run.smithi148.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 4.7 MB/s | 765 kB 00:00 2024-09-12T22:07:56.438 INFO:teuthology.orchestra.run.smithi164.stdout:(15/139): librados-devel-19.1.1-314.g086c737f.e 1.5 MB/s | 127 kB 00:00 2024-09-12T22:07:56.480 INFO:teuthology.orchestra.run.smithi164.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 6.6 MB/s | 506 kB 00:00 2024-09-12T22:07:56.563 INFO:teuthology.orchestra.run.smithi164.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 541 kB/s | 45 kB 00:00 2024-09-12T22:07:56.598 INFO:teuthology.orchestra.run.smithi148.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 462 kB/s | 80 kB 00:00 2024-09-12T22:07:56.655 INFO:teuthology.orchestra.run.smithi164.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.5 MB/s | 136 kB 00:00 2024-09-12T22:07:56.747 INFO:teuthology.orchestra.run.smithi164.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.7 MB/s | 162 kB 00:00 2024-09-12T22:07:56.773 INFO:teuthology.orchestra.run.smithi148.stdout:(36/139): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-12T22:07:56.798 INFO:teuthology.orchestra.run.smithi019.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 703 kB/s | 896 kB 00:01 2024-09-12T22:07:56.839 INFO:teuthology.orchestra.run.smithi164.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 3.4 MB/s | 320 kB 00:00 2024-09-12T22:07:56.840 INFO:teuthology.orchestra.run.smithi148.stdout:(37/139): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T22:07:56.899 INFO:teuthology.orchestra.run.smithi148.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-09-12T22:07:56.956 INFO:teuthology.orchestra.run.smithi164.stdout:(21/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-12T22:07:56.973 INFO:teuthology.orchestra.run.smithi019.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 832 kB/s | 145 kB 00:00 2024-09-12T22:07:56.981 INFO:teuthology.orchestra.run.smithi164.stdout:(22/139): python3-rbd-19.1.1-314.g086c737f.el9. 2.1 MB/s | 301 kB 00:00 2024-09-12T22:07:57.023 INFO:teuthology.orchestra.run.smithi164.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T22:07:57.024 INFO:teuthology.orchestra.run.smithi107.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 4.7 MB/s | 21 MB 00:04 2024-09-12T22:07:57.048 INFO:teuthology.orchestra.run.smithi164.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-12T22:07:57.049 INFO:teuthology.orchestra.run.smithi148.stdout:(39/139): ceph-mgr-diskprediction-local-19.1.1- 5.0 MB/s | 7.4 MB 00:01 2024-09-12T22:07:57.083 INFO:teuthology.orchestra.run.smithi107.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 433 kB/s | 25 kB 00:00 2024-09-12T22:07:57.132 INFO:teuthology.orchestra.run.smithi164.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T22:07:57.216 INFO:teuthology.orchestra.run.smithi164.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 382 kB/s | 32 kB 00:00 2024-09-12T22:07:57.223 INFO:teuthology.orchestra.run.smithi019.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 2.8 MB/s | 5.4 MB 00:01 2024-09-12T22:07:57.224 INFO:teuthology.orchestra.run.smithi148.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 609 kB/s | 106 kB 00:00 2024-09-12T22:07:57.258 INFO:teuthology.orchestra.run.smithi148.stdout:(41/139): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-09-12T22:07:57.299 INFO:teuthology.orchestra.run.smithi164.stdout:(27/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-12T22:07:57.317 INFO:teuthology.orchestra.run.smithi148.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-12T22:07:57.325 INFO:teuthology.orchestra.run.smithi164.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.3 MB/s | 146 kB 00:00 2024-09-12T22:07:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-12T22:07:57.401 INFO:teuthology.orchestra.run.smithi148.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T22:07:57.474 INFO:teuthology.orchestra.run.smithi019.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-12T22:07:57.650 INFO:teuthology.orchestra.run.smithi164.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 10 MB/s | 3.6 MB 00:00 2024-09-12T22:07:57.734 INFO:teuthology.orchestra.run.smithi164.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 2.9 MB/s | 249 kB 00:00 2024-09-12T22:07:57.817 INFO:teuthology.orchestra.run.smithi164.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 592 kB/s | 49 kB 00:00 2024-09-12T22:07:57.901 INFO:teuthology.orchestra.run.smithi164.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 197 kB/s | 16 kB 00:00 2024-09-12T22:07:57.993 INFO:teuthology.orchestra.run.smithi164.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 3.0 MB/s | 285 kB 00:00 2024-09-12T22:07:58.034 INFO:teuthology.orchestra.run.smithi148.stdout:(45/139): ceph-test-19.1.1-314.g086c737f.el9.x8 10 MB/s | 49 MB 00:04 2024-09-12T22:07:58.091 INFO:teuthology.orchestra.run.smithi019.stdout:(6/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 7.6 MB/s | 4.7 MB 00:00 2024-09-12T22:07:58.101 INFO:teuthology.orchestra.run.smithi164.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-12T22:07:58.210 INFO:teuthology.orchestra.run.smithi164.stdout:(35/139): ceph-mgr-diskprediction-local-19.1.1- 8.4 MB/s | 7.4 MB 00:00 2024-09-12T22:07:58.344 INFO:teuthology.orchestra.run.smithi164.stdout:(36/139): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-12T22:07:58.436 INFO:teuthology.orchestra.run.smithi164.stdout:(37/139): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-12T22:07:58.461 INFO:teuthology.orchestra.run.smithi164.stdout:(38/139): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-12T22:07:58.501 INFO:teuthology.orchestra.run.smithi148.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 595 kB/s | 689 kB 00:01 2024-09-12T22:07:58.503 INFO:teuthology.orchestra.run.smithi164.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T22:07:58.526 INFO:teuthology.orchestra.run.smithi148.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 217 kB/s | 107 kB 00:00 2024-09-12T22:07:58.553 INFO:teuthology.orchestra.run.smithi164.stdout:(40/139): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-12T22:07:58.579 INFO:teuthology.orchestra.run.smithi164.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T22:07:58.604 INFO:teuthology.orchestra.run.smithi164.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T22:07:58.610 INFO:teuthology.orchestra.run.smithi148.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-12T22:07:58.629 INFO:teuthology.orchestra.run.smithi164.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T22:07:58.655 INFO:teuthology.orchestra.run.smithi164.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T22:07:58.677 INFO:teuthology.orchestra.run.smithi148.stdout:(49/139): bison-3.7.4-5.el9.x86_64.rpm 739 kB/s | 943 kB 00:01 2024-09-12T22:07:58.719 INFO:teuthology.orchestra.run.smithi148.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-12T22:07:58.799 INFO:teuthology.orchestra.run.smithi019.stdout:(7/139): ceph-common-19.1.1-314.g086c737f.el9.x 6.0 MB/s | 21 MB 00:03 2024-09-12T22:07:58.813 INFO:teuthology.orchestra.run.smithi164.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-12T22:07:58.827 INFO:teuthology.orchestra.run.smithi148.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-12T22:07:58.853 INFO:teuthology.orchestra.run.smithi148.stdout:(52/139): flex-2.6.4-9.el9.x86_64.rpm 961 kB/s | 313 kB 00:00 2024-09-12T22:07:58.855 INFO:teuthology.orchestra.run.smithi164.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-12T22:07:58.906 INFO:teuthology.orchestra.run.smithi164.stdout:(47/139): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-12T22:07:58.931 INFO:teuthology.orchestra.run.smithi164.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-12T22:07:58.936 INFO:teuthology.orchestra.run.smithi148.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-12T22:07:58.961 INFO:teuthology.orchestra.run.smithi148.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-12T22:07:59.000 INFO:teuthology.orchestra.run.smithi164.stdout:(49/139): flexiblas-3.0.4-8.el9.x86_64.rpm 472 kB/s | 33 kB 00:00 2024-09-12T22:07:59.032 INFO:teuthology.orchestra.run.smithi164.stdout:(50/139): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-12T22:07:59.045 INFO:teuthology.orchestra.run.smithi148.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-12T22:07:59.073 INFO:teuthology.orchestra.run.smithi164.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-12T22:07:59.104 INFO:teuthology.orchestra.run.smithi148.stdout:(56/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.0 MB/s | 3.0 MB 00:00 2024-09-12T22:07:59.115 INFO:teuthology.orchestra.run.smithi164.stdout:(52/139): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-12T22:07:59.132 INFO:teuthology.orchestra.run.smithi019.stdout:(8/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 1.1 MB/s | 2.4 MB 00:02 2024-09-12T22:07:59.157 INFO:teuthology.orchestra.run.smithi164.stdout:(53/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-12T22:07:59.200 INFO:teuthology.orchestra.run.smithi164.stdout:(54/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T22:07:59.212 INFO:teuthology.orchestra.run.smithi148.stdout:(57/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-12T22:07:59.254 INFO:teuthology.orchestra.run.smithi148.stdout:(58/139): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-12T22:07:59.299 INFO:teuthology.orchestra.run.smithi019.stdout:(9/139): ceph-osd-19.1.1-314.g086c737f.el9.x86_ 14 MB/s | 17 MB 00:01 2024-09-12T22:07:59.307 INFO:teuthology.orchestra.run.smithi107.stdout:(10/139): ceph-radosgw-19.1.1-314.g086c737f.el9 3.1 MB/s | 11 MB 00:03 2024-09-12T22:07:59.316 INFO:teuthology.orchestra.run.smithi019.stdout:(10/139): ceph-selinux-19.1.1-314.g086c737f.el9 137 kB/s | 25 kB 00:00 2024-09-12T22:07:59.321 INFO:teuthology.orchestra.run.smithi148.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T22:07:59.350 INFO:teuthology.orchestra.run.smithi164.stdout:(55/139): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-12T22:07:59.355 INFO:teuthology.orchestra.run.smithi148.stdout:(60/139): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2024-09-12T22:07:59.374 INFO:teuthology.orchestra.run.smithi107.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 477 kB/s | 32 kB 00:00 2024-09-12T22:07:59.375 INFO:teuthology.orchestra.run.smithi019.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 544 kB/s | 32 kB 00:00 2024-09-12T22:07:59.380 INFO:teuthology.orchestra.run.smithi148.stdout:(61/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-12T22:07:59.439 INFO:teuthology.orchestra.run.smithi148.stdout:(62/139): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T22:07:59.464 INFO:teuthology.orchestra.run.smithi148.stdout:(63/139): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-12T22:07:59.508 INFO:teuthology.orchestra.run.smithi019.stdout:(12/139): ceph-radosgw-19.1.1-314.g086c737f.el9 15 MB/s | 11 MB 00:00 2024-09-12T22:07:59.525 INFO:teuthology.orchestra.run.smithi164.stdout:(56/139): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-12T22:07:59.566 INFO:teuthology.orchestra.run.smithi107.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 3.8 MB/s | 753 kB 00:00 2024-09-12T22:07:59.567 INFO:teuthology.orchestra.run.smithi164.stdout:(57/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 587 kB/s | 24 kB 00:00 2024-09-12T22:07:59.567 INFO:teuthology.orchestra.run.smithi019.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.8 MB/s | 164 kB 00:00 2024-09-12T22:07:59.609 INFO:teuthology.orchestra.run.smithi164.stdout:(58/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T22:07:59.625 INFO:teuthology.orchestra.run.smithi107.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.7 MB/s | 164 kB 00:00 2024-09-12T22:07:59.661 INFO:teuthology.orchestra.run.smithi019.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.4 MB/s | 127 kB 00:00 2024-09-12T22:07:59.689 INFO:teuthology.orchestra.run.smithi148.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-12T22:07:59.693 INFO:teuthology.orchestra.run.smithi164.stdout:(59/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-12T22:07:59.708 INFO:teuthology.orchestra.run.smithi107.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.5 MB/s | 127 kB 00:00 2024-09-12T22:07:59.735 INFO:teuthology.orchestra.run.smithi164.stdout:(60/139): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-12T22:07:59.751 INFO:teuthology.orchestra.run.smithi019.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 5.4 MB/s | 506 kB 00:00 2024-09-12T22:07:59.776 INFO:teuthology.orchestra.run.smithi164.stdout:(61/139): openblas-0.3.26-2.el9.x86_64.rpm 923 kB/s | 38 kB 00:00 2024-09-12T22:07:59.852 INFO:teuthology.orchestra.run.smithi164.stdout:(62/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-09-12T22:07:59.889 INFO:teuthology.orchestra.run.smithi148.stdout:(65/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-09-12T22:07:59.976 INFO:teuthology.orchestra.run.smithi019.stdout:(16/139): libcephfs2-19.1.1-314.g086c737f.el9.x 1.2 MB/s | 753 kB 00:00 2024-09-12T22:08:00.015 INFO:teuthology.orchestra.run.smithi148.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-12T22:08:00.017 INFO:teuthology.orchestra.run.smithi107.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 1.6 MB/s | 506 kB 00:00 2024-09-12T22:08:00.043 INFO:teuthology.orchestra.run.smithi019.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 677 kB/s | 45 kB 00:00 2024-09-12T22:08:00.118 INFO:teuthology.orchestra.run.smithi019.stdout:(18/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-12T22:08:00.132 INFO:teuthology.orchestra.run.smithi148.stdout:(67/139): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-12T22:08:00.144 INFO:teuthology.orchestra.run.smithi019.stdout:(19/139): python3-ceph-common-19.1.1-314.g086c7 1.3 MB/s | 136 kB 00:00 2024-09-12T22:08:00.161 INFO:teuthology.orchestra.run.smithi019.stdout:(20/139): python3-cephfs-19.1.1-314.g086c737f.e 3.8 MB/s | 162 kB 00:00 2024-09-12T22:08:00.211 INFO:teuthology.orchestra.run.smithi019.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T22:08:00.240 INFO:teuthology.orchestra.run.smithi148.stdout:(68/139): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-12T22:08:00.278 INFO:teuthology.orchestra.run.smithi019.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T22:08:00.303 INFO:teuthology.orchestra.run.smithi019.stdout:(23/139): python3-rados-19.1.1-314.g086c737f.el 2.0 MB/s | 320 kB 00:00 2024-09-12T22:08:00.345 INFO:teuthology.orchestra.run.smithi019.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-12T22:08:00.349 INFO:teuthology.orchestra.run.smithi148.stdout:(69/139): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-12T22:08:00.421 INFO:teuthology.orchestra.run.smithi019.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T22:08:00.458 INFO:teuthology.orchestra.run.smithi148.stdout:(70/139): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-12T22:08:00.487 INFO:teuthology.orchestra.run.smithi019.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 479 kB/s | 32 kB 00:00 2024-09-12T22:08:00.554 INFO:teuthology.orchestra.run.smithi019.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.1 MB/s | 146 kB 00:00 2024-09-12T22:08:00.566 INFO:teuthology.orchestra.run.smithi148.stdout:(71/139): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-12T22:08:00.894 INFO:teuthology.orchestra.run.smithi164.stdout:(63/139): ceph-test-19.1.1-314.g086c737f.el9.x8 9.0 MB/s | 49 MB 00:05 2024-09-12T22:08:00.913 INFO:teuthology.orchestra.run.smithi019.stdout:(28/139): ceph-mgr-dashboard-19.1.1-314.g086c73 9.9 MB/s | 3.6 MB 00:00 2024-09-12T22:08:00.977 INFO:teuthology.orchestra.run.smithi164.stdout:(64/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-12T22:08:01.075 INFO:teuthology.orchestra.run.smithi107.stdout:(16/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 2.6 MB/s | 17 MB 00:06 2024-09-12T22:08:01.120 INFO:teuthology.orchestra.run.smithi164.stdout:(65/139): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-12T22:08:01.126 INFO:teuthology.orchestra.run.smithi107.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 900 kB/s | 45 kB 00:00 2024-09-12T22:08:01.176 INFO:teuthology.orchestra.run.smithi107.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 2.7 MB/s | 136 kB 00:00 2024-09-12T22:08:01.211 INFO:teuthology.orchestra.run.smithi164.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T22:08:01.226 INFO:teuthology.orchestra.run.smithi107.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 3.2 MB/s | 162 kB 00:00 2024-09-12T22:08:01.287 INFO:teuthology.orchestra.run.smithi164.stdout:(67/139): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-09-12T22:08:01.337 INFO:teuthology.orchestra.run.smithi164.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-12T22:08:01.352 INFO:teuthology.orchestra.run.smithi107.stdout:(20/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 4.0 MB/s | 5.3 MB 00:01 2024-09-12T22:08:01.358 INFO:teuthology.orchestra.run.smithi148.stdout:(72/139): openblas-openmp-0.3.26-2.el9.x86_64.r 2.5 MB/s | 4.9 MB 00:01 2024-09-12T22:08:01.362 INFO:teuthology.orchestra.run.smithi164.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 339 kB/s | 26 kB 00:00 2024-09-12T22:08:01.363 INFO:teuthology.orchestra.run.smithi019.stdout:(29/139): ceph-test-19.1.1-314.g086c737f.el9.x8 24 MB/s | 49 MB 00:02 2024-09-12T22:08:01.377 INFO:teuthology.orchestra.run.smithi107.stdout:(21/139): python3-rados-19.1.1-314.g086c737f.el 2.1 MB/s | 320 kB 00:00 2024-09-12T22:08:01.387 INFO:teuthology.orchestra.run.smithi164.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T22:08:01.414 INFO:teuthology.orchestra.run.smithi019.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 4.9 MB/s | 249 kB 00:00 2024-09-12T22:08:01.421 INFO:teuthology.orchestra.run.smithi164.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T22:08:01.438 INFO:teuthology.orchestra.run.smithi164.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-12T22:08:01.455 INFO:teuthology.orchestra.run.smithi107.stdout:(22/139): python3-rbd-19.1.1-314.g086c737f.el9. 2.9 MB/s | 301 kB 00:00 2024-09-12T22:08:01.464 INFO:teuthology.orchestra.run.smithi019.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 992 kB/s | 49 kB 00:00 2024-09-12T22:08:01.486 INFO:teuthology.orchestra.run.smithi107.stdout:(23/139): python3-rgw-19.1.1-314.g086c737f.el9. 915 kB/s | 99 kB 00:00 2024-09-12T22:08:01.511 INFO:teuthology.orchestra.run.smithi107.stdout:(24/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.5 MB/s | 85 kB 00:00 2024-09-12T22:08:01.530 INFO:teuthology.orchestra.run.smithi164.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-12T22:08:01.556 INFO:teuthology.orchestra.run.smithi019.stdout:(32/139): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-12T22:08:01.573 INFO:teuthology.orchestra.run.smithi019.stdout:(33/139): ceph-prometheus-alerts-19.1.1-314.g08 151 kB/s | 16 kB 00:00 2024-09-12T22:08:01.578 INFO:teuthology.orchestra.run.smithi107.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-12T22:08:01.606 INFO:teuthology.orchestra.run.smithi019.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T22:08:01.614 INFO:teuthology.orchestra.run.smithi164.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-12T22:08:01.628 INFO:teuthology.orchestra.run.smithi107.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 635 kB/s | 32 kB 00:00 2024-09-12T22:08:01.657 INFO:teuthology.orchestra.run.smithi019.stdout:(35/139): cephadm-19.1.1-314.g086c737f.el9.noar 8.9 MB/s | 765 kB 00:00 2024-09-12T22:08:01.670 INFO:teuthology.orchestra.run.smithi107.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 3.5 MB/s | 146 kB 00:00 2024-09-12T22:08:01.722 INFO:teuthology.orchestra.run.smithi164.stdout:(75/139): python3-packaging-20.9-5.el9.noarch.r 712 kB/s | 77 kB 00:00 2024-09-12T22:08:01.742 INFO:teuthology.orchestra.run.smithi148.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 654 kB/s | 250 kB 00:00 2024-09-12T22:08:01.757 INFO:teuthology.orchestra.run.smithi019.stdout:(36/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 2.1 MB/s | 3.1 MB 00:01 2024-09-12T22:08:01.764 INFO:teuthology.orchestra.run.smithi164.stdout:(76/139): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-12T22:08:01.782 INFO:teuthology.orchestra.run.smithi019.stdout:(37/139): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-12T22:08:01.865 INFO:teuthology.orchestra.run.smithi164.stdout:(77/139): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-12T22:08:01.924 INFO:teuthology.orchestra.run.smithi019.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-12T22:08:01.929 INFO:teuthology.orchestra.run.smithi107.stdout:(28/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 7.0 MB/s | 3.1 MB 00:00 2024-09-12T22:08:01.940 INFO:teuthology.orchestra.run.smithi164.stdout:(78/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T22:08:01.949 INFO:teuthology.orchestra.run.smithi019.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 995 kB/s | 191 kB 00:00 2024-09-12T22:08:02.000 INFO:teuthology.orchestra.run.smithi019.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T22:08:02.041 INFO:teuthology.orchestra.run.smithi164.stdout:(79/139): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-12T22:08:02.041 INFO:teuthology.orchestra.run.smithi019.stdout:(41/139): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-12T22:08:02.082 INFO:teuthology.orchestra.run.smithi164.stdout:(80/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-12T22:08:02.092 INFO:teuthology.orchestra.run.smithi019.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-12T22:08:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 592 kB/s | 222 kB 00:00 2024-09-12T22:08:02.124 INFO:teuthology.orchestra.run.smithi164.stdout:(81/139): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-12T22:08:02.142 INFO:teuthology.orchestra.run.smithi019.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-12T22:08:02.193 INFO:teuthology.orchestra.run.smithi019.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-12T22:08:02.196 INFO:teuthology.orchestra.run.smithi107.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 6.8 MB/s | 3.6 MB 00:00 2024-09-12T22:08:02.263 INFO:teuthology.orchestra.run.smithi107.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 3.7 MB/s | 249 kB 00:00 2024-09-12T22:08:02.301 INFO:teuthology.orchestra.run.smithi019.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 689 kB 00:00 2024-09-12T22:08:02.313 INFO:teuthology.orchestra.run.smithi107.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 990 kB/s | 49 kB 00:00 2024-09-12T22:08:02.317 INFO:teuthology.orchestra.run.smithi148.stdout:(75/139): python3-packaging-20.9-5.el9.noarch.r 386 kB/s | 77 kB 00:00 2024-09-12T22:08:02.335 INFO:teuthology.orchestra.run.smithi019.stdout:(46/139): python3-cryptography-36.0.1-4.el9.x86 3.0 MB/s | 1.2 MB 00:00 2024-09-12T22:08:02.363 INFO:teuthology.orchestra.run.smithi107.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 331 kB/s | 16 kB 00:00 2024-09-12T22:08:02.368 INFO:teuthology.orchestra.run.smithi019.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-12T22:08:02.434 INFO:teuthology.orchestra.run.smithi148.stdout:(76/139): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-12T22:08:02.443 INFO:teuthology.orchestra.run.smithi019.stdout:(48/139): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-12T22:08:02.469 INFO:teuthology.orchestra.run.smithi019.stdout:(49/139): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-09-12T22:08:02.511 INFO:teuthology.orchestra.run.smithi019.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-12T22:08:02.544 INFO:teuthology.orchestra.run.smithi019.stdout:(51/139): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-12T22:08:02.578 INFO:teuthology.orchestra.run.smithi019.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-12T22:08:02.611 INFO:teuthology.orchestra.run.smithi019.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-12T22:08:02.651 INFO:teuthology.orchestra.run.smithi148.stdout:(77/139): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:02 2024-09-12T22:08:02.653 INFO:teuthology.orchestra.run.smithi019.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T22:08:02.687 INFO:teuthology.orchestra.run.smithi019.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-12T22:08:02.691 INFO:teuthology.orchestra.run.smithi164.stdout:(82/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-09-12T22:08:02.738 INFO:teuthology.orchestra.run.smithi019.stdout:(56/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-12T22:08:02.758 INFO:teuthology.orchestra.run.smithi164.stdout:(83/139): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-09-12T22:08:02.771 INFO:teuthology.orchestra.run.smithi019.stdout:(57/139): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-12T22:08:02.783 INFO:teuthology.orchestra.run.smithi164.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-09-12T22:08:02.797 INFO:teuthology.orchestra.run.smithi107.stdout:(33/139): ceph-test-19.1.1-314.g086c737f.el9.x8 8.5 MB/s | 49 MB 00:05 2024-09-12T22:08:02.805 INFO:teuthology.orchestra.run.smithi019.stdout:(58/139): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-12T22:08:02.822 INFO:teuthology.orchestra.run.smithi019.stdout:(59/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-12T22:08:02.822 INFO:teuthology.orchestra.run.smithi107.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 622 kB/s | 285 kB 00:00 2024-09-12T22:08:02.825 INFO:teuthology.orchestra.run.smithi164.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 863 kB/s | 36 kB 00:00 2024-09-12T22:08:02.838 INFO:teuthology.orchestra.run.smithi019.stdout:(60/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 705 kB/s | 47 kB 00:00 2024-09-12T22:08:02.867 INFO:teuthology.orchestra.run.smithi164.stdout:(86/139): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-12T22:08:02.889 INFO:teuthology.orchestra.run.smithi107.stdout:(35/139): cephadm-19.1.1-314.g086c737f.el9.noar 8.2 MB/s | 765 kB 00:00 2024-09-12T22:08:02.893 INFO:teuthology.orchestra.run.smithi164.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-12T22:08:02.905 INFO:teuthology.orchestra.run.smithi019.stdout:(61/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-09-12T22:08:02.922 INFO:teuthology.orchestra.run.smithi019.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-12T22:08:02.928 INFO:teuthology.orchestra.run.smithi148.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 548 kB/s | 269 kB 00:00 2024-09-12T22:08:02.948 INFO:teuthology.orchestra.run.smithi019.stdout:(63/139): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-12T22:08:02.951 INFO:teuthology.orchestra.run.smithi164.stdout:(88/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T22:08:02.952 INFO:teuthology.orchestra.run.smithi148.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 529 kB/s | 159 kB 00:00 2024-09-12T22:08:02.993 INFO:teuthology.orchestra.run.smithi164.stdout:(89/139): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-12T22:08:03.035 INFO:teuthology.orchestra.run.smithi164.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-09-12T22:08:03.056 INFO:teuthology.orchestra.run.smithi019.stdout:(64/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-12T22:08:03.060 INFO:teuthology.orchestra.run.smithi164.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-12T22:08:03.077 INFO:teuthology.orchestra.run.smithi148.stdout:(80/139): python3-pytz-2021.1-5.el9.noarch.rpm 408 kB/s | 51 kB 00:00 2024-09-12T22:08:03.098 INFO:teuthology.orchestra.run.smithi019.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-12T22:08:03.131 INFO:teuthology.orchestra.run.smithi107.stdout:(36/139): ceph-mgr-diskprediction-local-19.1.1- 6.2 MB/s | 7.4 MB 00:01 2024-09-12T22:08:03.156 INFO:teuthology.orchestra.run.smithi107.stdout:(37/139): fuse-2.9.9-16.el9.x86_64.rpm 239 kB/s | 80 kB 00:00 2024-09-12T22:08:03.194 INFO:teuthology.orchestra.run.smithi164.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 141 kB/s | 22 kB 00:00 2024-09-12T22:08:03.207 INFO:teuthology.orchestra.run.smithi019.stdout:(66/139): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-09-12T22:08:03.210 INFO:teuthology.orchestra.run.smithi148.stdout:(81/139): python3-requests-oauthlib-1.3.0-12.el 402 kB/s | 54 kB 00:00 2024-09-12T22:08:03.266 INFO:teuthology.orchestra.run.smithi019.stdout:(67/139): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-12T22:08:03.291 INFO:teuthology.orchestra.run.smithi019.stdout:(68/139): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-12T22:08:03.316 INFO:teuthology.orchestra.run.smithi019.stdout:(69/139): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-12T22:08:03.333 INFO:teuthology.orchestra.run.smithi019.stdout:(70/139): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-12T22:08:03.366 INFO:teuthology.orchestra.run.smithi019.stdout:(71/139): python3-jsonpointer-2.0-4.el9.noarch. 253 kB/s | 19 kB 00:00 2024-09-12T22:08:03.369 INFO:teuthology.orchestra.run.smithi148.stdout:(82/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.8 MB/s | 5.1 MB 00:02 2024-09-12T22:08:03.386 INFO:teuthology.orchestra.run.smithi164.stdout:(93/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-12T22:08:03.392 INFO:teuthology.orchestra.run.smithi019.stdout:(72/139): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-12T22:08:03.408 INFO:teuthology.orchestra.run.smithi019.stdout:(73/139): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-12T22:08:03.428 INFO:teuthology.orchestra.run.smithi164.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 2.3 MB/s | 548 kB 00:00 2024-09-12T22:08:03.431 INFO:teuthology.orchestra.run.smithi107.stdout:(38/139): libquadmath-11.5.0-2.el9.x86_64.rpm 638 kB/s | 191 kB 00:00 2024-09-12T22:08:03.453 INFO:teuthology.orchestra.run.smithi148.stdout:(83/139): python3-pyasn1-modules-0.4.8-6.el9.no 530 kB/s | 279 kB 00:00 2024-09-12T22:08:03.453 INFO:teuthology.orchestra.run.smithi164.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 822 kB/s | 19 kB 00:00 2024-09-12T22:08:03.456 INFO:teuthology.orchestra.run.smithi107.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 843 kB/s | 253 kB 00:00 2024-09-12T22:08:03.459 INFO:teuthology.orchestra.run.smithi019.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-12T22:08:03.470 INFO:teuthology.orchestra.run.smithi148.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T22:08:03.484 INFO:teuthology.orchestra.run.smithi019.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-12T22:08:03.487 INFO:teuthology.orchestra.run.smithi164.stdout:(96/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.0 MB/s | 308 kB 00:00 2024-09-12T22:08:03.512 INFO:teuthology.orchestra.run.smithi164.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T22:08:03.531 INFO:teuthology.orchestra.run.smithi107.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T22:08:03.538 INFO:teuthology.orchestra.run.smithi164.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T22:08:03.563 INFO:teuthology.orchestra.run.smithi164.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T22:08:03.568 INFO:teuthology.orchestra.run.smithi019.stdout:(76/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-09-12T22:08:03.578 INFO:teuthology.orchestra.run.smithi148.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-12T22:08:03.585 INFO:teuthology.orchestra.run.smithi019.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-12T22:08:03.597 INFO:teuthology.orchestra.run.smithi164.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-12T22:08:03.610 INFO:teuthology.orchestra.run.smithi019.stdout:(78/139): python3-packaging-20.9-5.el9.noarch.r 512 kB/s | 77 kB 00:00 2024-09-12T22:08:03.624 INFO:teuthology.orchestra.run.smithi107.stdout:(41/139): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-12T22:08:03.647 INFO:teuthology.orchestra.run.smithi164.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T22:08:03.649 INFO:teuthology.orchestra.run.smithi107.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T22:08:03.660 INFO:teuthology.orchestra.run.smithi019.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-12T22:08:03.662 INFO:teuthology.orchestra.run.smithi148.stdout:(86/139): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-09-12T22:08:03.681 INFO:teuthology.orchestra.run.smithi164.stdout:(102/139): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-09-12T22:08:03.687 INFO:teuthology.orchestra.run.smithi148.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T22:08:03.694 INFO:teuthology.orchestra.run.smithi019.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-12T22:08:03.699 INFO:teuthology.orchestra.run.smithi107.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T22:08:03.719 INFO:teuthology.orchestra.run.smithi019.stdout:(81/139): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-12T22:08:03.744 INFO:teuthology.orchestra.run.smithi019.stdout:(82/139): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-12T22:08:03.756 INFO:teuthology.orchestra.run.smithi164.stdout:(103/139): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-12T22:08:03.770 INFO:teuthology.orchestra.run.smithi019.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 709 kB/s | 54 kB 00:00 2024-09-12T22:08:03.787 INFO:teuthology.orchestra.run.smithi148.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-12T22:08:03.789 INFO:teuthology.orchestra.run.smithi164.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2024-09-12T22:08:03.803 INFO:teuthology.orchestra.run.smithi019.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-12T22:08:03.808 INFO:teuthology.orchestra.run.smithi107.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-12T22:08:03.813 INFO:teuthology.orchestra.run.smithi148.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 763 kB/s | 96 kB 00:00 2024-09-12T22:08:03.815 INFO:teuthology.orchestra.run.smithi164.stdout:(105/139): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-12T22:08:03.837 INFO:teuthology.orchestra.run.smithi019.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-12T22:08:03.840 INFO:teuthology.orchestra.run.smithi164.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 290 kB/s | 14 kB 00:00 2024-09-12T22:08:03.865 INFO:teuthology.orchestra.run.smithi164.stdout:(107/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 236 kB/s | 43 kB 00:00 2024-09-12T22:08:03.866 INFO:teuthology.orchestra.run.smithi107.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-12T22:08:03.870 INFO:teuthology.orchestra.run.smithi019.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 534 kB/s | 36 kB 00:00 2024-09-12T22:08:03.890 INFO:teuthology.orchestra.run.smithi164.stdout:(108/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-12T22:08:03.904 INFO:teuthology.orchestra.run.smithi019.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-12T22:08:03.908 INFO:teuthology.orchestra.run.smithi107.stdout:(46/139): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-12T22:08:03.913 INFO:teuthology.orchestra.run.smithi148.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 509 kB/s | 64 kB 00:00 2024-09-12T22:08:03.916 INFO:teuthology.orchestra.run.smithi164.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-12T22:08:03.938 INFO:teuthology.orchestra.run.smithi148.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 358 kB/s | 45 kB 00:00 2024-09-12T22:08:03.950 INFO:teuthology.orchestra.run.smithi164.stdout:(110/139): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-12T22:08:03.950 INFO:teuthology.orchestra.run.smithi107.stdout:(47/139): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-09-12T22:08:03.963 INFO:teuthology.orchestra.run.smithi019.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-12T22:08:03.975 INFO:teuthology.orchestra.run.smithi164.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-12T22:08:03.988 INFO:teuthology.orchestra.run.smithi019.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-12T22:08:03.992 INFO:teuthology.orchestra.run.smithi164.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-09-12T22:08:03.992 INFO:teuthology.orchestra.run.smithi107.stdout:(48/139): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-12T22:08:04.017 INFO:teuthology.orchestra.run.smithi164.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 421 kB/s | 18 kB 00:00 2024-09-12T22:08:04.017 INFO:teuthology.orchestra.run.smithi107.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-12T22:08:04.042 INFO:teuthology.orchestra.run.smithi164.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T22:08:04.042 INFO:teuthology.orchestra.run.smithi107.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-12T22:08:04.068 INFO:teuthology.orchestra.run.smithi164.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-12T22:08:04.076 INFO:teuthology.orchestra.run.smithi107.stdout:(51/139): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-09-12T22:08:04.093 INFO:teuthology.orchestra.run.smithi164.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-12T22:08:04.101 INFO:teuthology.orchestra.run.smithi107.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-12T22:08:04.118 INFO:teuthology.orchestra.run.smithi164.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:08:04.144 INFO:teuthology.orchestra.run.smithi107.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-12T22:08:04.155 INFO:teuthology.orchestra.run.smithi019.stdout:(90/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-12T22:08:04.160 INFO:teuthology.orchestra.run.smithi164.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-09-12T22:08:04.164 INFO:teuthology.orchestra.run.smithi148.stdout:(92/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-12T22:08:04.169 INFO:teuthology.orchestra.run.smithi107.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-12T22:08:04.180 INFO:teuthology.orchestra.run.smithi019.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-12T22:08:04.185 INFO:teuthology.orchestra.run.smithi164.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T22:08:04.189 INFO:teuthology.orchestra.run.smithi148.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-12T22:08:04.202 INFO:teuthology.orchestra.run.smithi107.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-09-12T22:08:04.205 INFO:teuthology.orchestra.run.smithi019.stdout:(92/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 263 kB/s | 64 kB 00:00 2024-09-12T22:08:04.227 INFO:teuthology.orchestra.run.smithi164.stdout:(120/139): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-12T22:08:04.253 INFO:teuthology.orchestra.run.smithi164.stdout:(121/139): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-12T22:08:04.256 INFO:teuthology.orchestra.run.smithi148.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 4.5 MB/s | 308 kB 00:00 2024-09-12T22:08:04.264 INFO:teuthology.orchestra.run.smithi019.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 9.2 MB/s | 548 kB 00:00 2024-09-12T22:08:04.278 INFO:teuthology.orchestra.run.smithi164.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 325 kB/s | 16 kB 00:00 2024-09-12T22:08:04.281 INFO:teuthology.orchestra.run.smithi148.stdout:(95/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 5.8 MB/s | 548 kB 00:00 2024-09-12T22:08:04.294 INFO:teuthology.orchestra.run.smithi107.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-12T22:08:04.297 INFO:teuthology.orchestra.run.smithi019.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 9.0 MB/s | 308 kB 00:00 2024-09-12T22:08:04.303 INFO:teuthology.orchestra.run.smithi164.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T22:08:04.306 INFO:teuthology.orchestra.run.smithi148.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 386 kB/s | 19 kB 00:00 2024-09-12T22:08:04.323 INFO:teuthology.orchestra.run.smithi019.stdout:(95/139): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-09-12T22:08:04.328 INFO:teuthology.orchestra.run.smithi107.stdout:(57/139): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-12T22:08:04.331 INFO:teuthology.orchestra.run.smithi148.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T22:08:04.337 INFO:teuthology.orchestra.run.smithi164.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-09-12T22:08:04.348 INFO:teuthology.orchestra.run.smithi019.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 386 kB/s | 19 kB 00:00 2024-09-12T22:08:04.353 INFO:teuthology.orchestra.run.smithi107.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-12T22:08:04.357 INFO:teuthology.orchestra.run.smithi148.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T22:08:04.362 INFO:teuthology.orchestra.run.smithi164.stdout:(125/139): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-12T22:08:04.378 INFO:teuthology.orchestra.run.smithi107.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-12T22:08:04.382 INFO:teuthology.orchestra.run.smithi148.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T22:08:04.382 INFO:teuthology.orchestra.run.smithi019.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-12T22:08:04.387 INFO:teuthology.orchestra.run.smithi164.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T22:08:04.404 INFO:teuthology.orchestra.run.smithi107.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T22:08:04.407 INFO:teuthology.orchestra.run.smithi019.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-12T22:08:04.407 INFO:teuthology.orchestra.run.smithi148.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T22:08:04.413 INFO:teuthology.orchestra.run.smithi164.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-12T22:08:04.424 INFO:teuthology.orchestra.run.smithi019.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-12T22:08:04.438 INFO:teuthology.orchestra.run.smithi164.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T22:08:04.457 INFO:teuthology.orchestra.run.smithi019.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-12T22:08:04.466 INFO:teuthology.orchestra.run.smithi148.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T22:08:04.471 INFO:teuthology.orchestra.run.smithi107.stdout:(61/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.6 MB/s | 3.0 MB 00:00 2024-09-12T22:08:04.488 INFO:teuthology.orchestra.run.smithi164.stdout:(129/139): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-12T22:08:04.496 INFO:teuthology.orchestra.run.smithi107.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 420 kB/s | 38 kB 00:00 2024-09-12T22:08:04.508 INFO:teuthology.orchestra.run.smithi148.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T22:08:04.508 INFO:teuthology.orchestra.run.smithi019.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T22:08:04.514 INFO:teuthology.orchestra.run.smithi164.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-12T22:08:04.521 INFO:teuthology.orchestra.run.smithi107.stdout:(63/139): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-12T22:08:04.539 INFO:teuthology.orchestra.run.smithi164.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T22:08:04.541 INFO:teuthology.orchestra.run.smithi148.stdout:(103/139): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-09-12T22:08:04.550 INFO:teuthology.orchestra.run.smithi019.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T22:08:04.564 INFO:teuthology.orchestra.run.smithi164.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T22:08:04.567 INFO:teuthology.orchestra.run.smithi148.stdout:(104/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-12T22:08:04.575 INFO:teuthology.orchestra.run.smithi019.stdout:(103/139): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-12T22:08:04.590 INFO:teuthology.orchestra.run.smithi164.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:08:04.592 INFO:teuthology.orchestra.run.smithi019.stdout:(104/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-12T22:08:04.600 INFO:teuthology.orchestra.run.smithi148.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 538 kB/s | 14 kB 00:00 2024-09-12T22:08:04.615 INFO:teuthology.orchestra.run.smithi164.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T22:08:04.625 INFO:teuthology.orchestra.run.smithi019.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-12T22:08:04.634 INFO:teuthology.orchestra.run.smithi148.stdout:(106/139): python3-cachetools-4.2.4-1.el9.noarc 349 kB/s | 32 kB 00:00 2024-09-12T22:08:04.638 INFO:teuthology.orchestra.run.smithi107.stdout:(64/139): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-12T22:08:04.651 INFO:teuthology.orchestra.run.smithi019.stdout:(106/139): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2024-09-12T22:08:04.659 INFO:teuthology.orchestra.run.smithi148.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T22:08:04.671 INFO:teuthology.orchestra.run.smithi107.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-12T22:08:04.674 INFO:teuthology.orchestra.run.smithi164.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T22:08:04.676 INFO:teuthology.orchestra.run.smithi019.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 3.5 MB/s | 172 kB 00:00 2024-09-12T22:08:04.710 INFO:teuthology.orchestra.run.smithi019.stdout:(108/139): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-12T22:08:04.726 INFO:teuthology.orchestra.run.smithi148.stdout:(108/139): libarrow-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2024-09-12T22:08:04.738 INFO:teuthology.orchestra.run.smithi107.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T22:08:04.752 INFO:teuthology.orchestra.run.smithi019.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-12T22:08:04.760 INFO:teuthology.orchestra.run.smithi148.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-12T22:08:04.764 INFO:teuthology.orchestra.run.smithi107.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T22:08:04.785 INFO:teuthology.orchestra.run.smithi148.stdout:(110/139): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-12T22:08:04.789 INFO:teuthology.orchestra.run.smithi107.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-12T22:08:04.810 INFO:teuthology.orchestra.run.smithi148.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T22:08:04.814 INFO:teuthology.orchestra.run.smithi107.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T22:08:04.827 INFO:teuthology.orchestra.run.smithi019.stdout:(110/139): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-12T22:08:04.835 INFO:teuthology.orchestra.run.smithi148.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-12T22:08:04.839 INFO:teuthology.orchestra.run.smithi107.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T22:08:04.852 INFO:teuthology.orchestra.run.smithi019.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-09-12T22:08:04.857 INFO:teuthology.orchestra.run.smithi164.stdout:(136/139): librados2-19.1.1-314.g086c737f.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-12T22:08:04.861 INFO:teuthology.orchestra.run.smithi148.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T22:08:04.865 INFO:teuthology.orchestra.run.smithi107.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T22:08:04.869 INFO:teuthology.orchestra.run.smithi019.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-09-12T22:08:04.886 INFO:teuthology.orchestra.run.smithi019.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 528 kB/s | 18 kB 00:00 2024-09-12T22:08:04.886 INFO:teuthology.orchestra.run.smithi148.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T22:08:04.890 INFO:teuthology.orchestra.run.smithi107.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-12T22:08:04.903 INFO:teuthology.orchestra.run.smithi019.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2024-09-12T22:08:04.913 INFO:teuthology.orchestra.run.smithi148.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-12T22:08:04.920 INFO:teuthology.orchestra.run.smithi019.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-09-12T22:08:04.937 INFO:teuthology.orchestra.run.smithi148.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T22:08:04.937 INFO:teuthology.orchestra.run.smithi019.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-09-12T22:08:04.954 INFO:teuthology.orchestra.run.smithi019.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-12T22:08:04.966 INFO:teuthology.orchestra.run.smithi164.stdout:(137/139): openssl-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 1.4 MB 00:00 2024-09-12T22:08:04.973 INFO:teuthology.orchestra.run.smithi148.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T22:08:04.979 INFO:teuthology.orchestra.run.smithi019.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T22:08:04.982 INFO:teuthology.orchestra.run.smithi107.stdout:(73/139): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-12T22:08:04.996 INFO:teuthology.orchestra.run.smithi019.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T22:08:05.007 INFO:teuthology.orchestra.run.smithi107.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T22:08:05.012 INFO:teuthology.orchestra.run.smithi148.stdout:(118/139): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-09-12T22:08:05.030 INFO:teuthology.orchestra.run.smithi019.stdout:(120/139): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T22:08:05.032 INFO:teuthology.orchestra.run.smithi107.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T22:08:05.038 INFO:teuthology.orchestra.run.smithi148.stdout:(119/139): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-12T22:08:05.057 INFO:teuthology.orchestra.run.smithi107.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T22:08:05.063 INFO:teuthology.orchestra.run.smithi148.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T22:08:05.080 INFO:teuthology.orchestra.run.smithi019.stdout:(121/139): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-12T22:08:05.083 INFO:teuthology.orchestra.run.smithi107.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-12T22:08:05.097 INFO:teuthology.orchestra.run.smithi019.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-09-12T22:08:05.105 INFO:teuthology.orchestra.run.smithi148.stdout:(121/139): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-12T22:08:05.108 INFO:teuthology.orchestra.run.smithi107.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T22:08:05.122 INFO:teuthology.orchestra.run.smithi019.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-12T22:08:05.125 INFO:teuthology.orchestra.run.smithi107.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-12T22:08:05.130 INFO:teuthology.orchestra.run.smithi148.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-09-12T22:08:05.139 INFO:teuthology.orchestra.run.smithi019.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 739 kB/s | 31 kB 00:00 2024-09-12T22:08:05.141 INFO:teuthology.orchestra.run.smithi164.stdout:(138/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.4 MB/s | 2.4 MB 00:00 2024-09-12T22:08:05.150 INFO:teuthology.orchestra.run.smithi107.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 6.5 MB/s | 279 kB 00:00 2024-09-12T22:08:05.155 INFO:teuthology.orchestra.run.smithi148.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T22:08:05.172 INFO:teuthology.orchestra.run.smithi148.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-09-12T22:08:05.173 INFO:teuthology.orchestra.run.smithi019.stdout:(125/139): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2024-09-12T22:08:05.177 INFO:teuthology.orchestra.run.smithi107.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T22:08:05.198 INFO:teuthology.orchestra.run.smithi019.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-12T22:08:05.201 INFO:teuthology.orchestra.run.smithi107.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T22:08:05.206 INFO:teuthology.orchestra.run.smithi148.stdout:(125/139): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-12T22:08:05.223 INFO:teuthology.orchestra.run.smithi148.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T22:08:05.223 INFO:teuthology.orchestra.run.smithi019.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T22:08:05.240 INFO:teuthology.orchestra.run.smithi148.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-12T22:08:05.257 INFO:teuthology.orchestra.run.smithi019.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-12T22:08:05.265 INFO:teuthology.orchestra.run.smithi148.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-12T22:08:05.276 INFO:teuthology.orchestra.run.smithi107.stdout:(83/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T22:08:05.282 INFO:teuthology.orchestra.run.smithi019.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 890 kB/s | 74 kB 00:00 2024-09-12T22:08:05.290 INFO:teuthology.orchestra.run.smithi148.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-12T22:08:05.302 INFO:teuthology.orchestra.run.smithi107.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T22:08:05.307 INFO:teuthology.orchestra.run.smithi019.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T22:08:05.316 INFO:teuthology.orchestra.run.smithi148.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T22:08:05.327 INFO:teuthology.orchestra.run.smithi107.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T22:08:05.333 INFO:teuthology.orchestra.run.smithi019.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T22:08:05.349 INFO:teuthology.orchestra.run.smithi148.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T22:08:05.350 INFO:teuthology.orchestra.run.smithi019.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-12T22:08:05.352 INFO:teuthology.orchestra.run.smithi107.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-12T22:08:05.375 INFO:teuthology.orchestra.run.smithi148.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-12T22:08:05.375 INFO:teuthology.orchestra.run.smithi019.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T22:08:05.380 INFO:teuthology.orchestra.run.smithi107.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T22:08:05.400 INFO:teuthology.orchestra.run.smithi148.stdout:(133/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-12T22:08:05.402 INFO:teuthology.orchestra.run.smithi107.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T22:08:05.408 INFO:teuthology.orchestra.run.smithi019.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T22:08:05.428 INFO:teuthology.orchestra.run.smithi107.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T22:08:05.433 INFO:teuthology.orchestra.run.smithi148.stdout:(134/139): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T22:08:05.450 INFO:teuthology.orchestra.run.smithi019.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T22:08:05.473 INFO:teuthology.orchestra.run.smithi107.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 909 kB/s | 64 kB 00:00 2024-09-12T22:08:05.484 INFO:teuthology.orchestra.run.smithi148.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T22:08:05.503 INFO:teuthology.orchestra.run.smithi107.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-12T22:08:05.533 INFO:teuthology.orchestra.run.smithi164.stdout:(139/139): librbd1-19.1.1-314.g086c737f.el9.x86 3.4 MB/s | 3.2 MB 00:00 2024-09-12T22:08:05.539 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:08:05.540 INFO:teuthology.orchestra.run.smithi164.stdout:Total 17 MB/s | 213 MB 00:12 2024-09-12T22:08:05.579 INFO:teuthology.orchestra.run.smithi107.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 211 kB/s | 22 kB 00:00 2024-09-12T22:08:05.637 INFO:teuthology.orchestra.run.smithi107.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 9.2 MB/s | 548 kB 00:00 2024-09-12T22:08:05.670 INFO:teuthology.orchestra.run.smithi107.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 9.1 MB/s | 308 kB 00:00 2024-09-12T22:08:05.759 INFO:teuthology.orchestra.run.smithi019.stdout:(136/139): librbd1-19.1.1-314.g086c737f.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-12T22:08:05.767 INFO:teuthology.orchestra.run.smithi148.stdout:(136/139): librados2-19.1.1-314.g086c737f.el9.x 9.3 MB/s | 3.4 MB 00:00 2024-09-12T22:08:05.829 INFO:teuthology.orchestra.run.smithi107.stdout:(95/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-12T22:08:05.834 INFO:teuthology.orchestra.run.smithi148.stdout:(137/139): librbd1-19.1.1-314.g086c737f.el9.x86 7.9 MB/s | 3.2 MB 00:00 2024-09-12T22:08:05.855 INFO:teuthology.orchestra.run.smithi107.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 106 kB/s | 19 kB 00:00 2024-09-12T22:08:05.867 INFO:teuthology.orchestra.run.smithi019.stdout:(137/139): openssl-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 1.4 MB 00:00 2024-09-12T22:08:05.876 INFO:teuthology.orchestra.run.smithi148.stdout:(138/139): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-12T22:08:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:(97/139): protobuf-compiler-3.14.0-13.el9.x86_6 2.2 MB/s | 863 kB 00:00 2024-09-12T22:08:05.989 INFO:teuthology.orchestra.run.smithi107.stdout:(98/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 206 kB/s | 26 kB 00:00 2024-09-12T22:08:06.030 INFO:teuthology.orchestra.run.smithi107.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T22:08:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-12T22:08:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:(101/139): liboath-2.6.7-2.el9.x86_64.rpm 255 kB/s | 49 kB 00:00 2024-09-12T22:08:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:(102/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T22:08:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T22:08:06.168 INFO:teuthology.orchestra.run.smithi019.stdout:(138/139): librados2-19.1.1-314.g086c737f.el9.x 4.3 MB/s | 3.4 MB 00:00 2024-09-12T22:08:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:(104/139): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-12T22:08:06.198 INFO:teuthology.orchestra.run.smithi107.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-09-12T22:08:06.216 INFO:teuthology.orchestra.run.smithi107.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-12T22:08:06.241 INFO:teuthology.orchestra.run.smithi107.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T22:08:06.274 INFO:teuthology.orchestra.run.smithi107.stdout:(108/139): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-12T22:08:06.308 INFO:teuthology.orchestra.run.smithi107.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-12T22:08:06.318 INFO:teuthology.orchestra.run.smithi148.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 2.4 MB 00:00 2024-09-12T22:08:06.324 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:08:06.324 INFO:teuthology.orchestra.run.smithi148.stdout:Total 14 MB/s | 213 MB 00:14 2024-09-12T22:08:06.342 INFO:teuthology.orchestra.run.smithi107.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T22:08:06.369 INFO:teuthology.orchestra.run.smithi107.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 397 kB/s | 11 kB 00:00 2024-09-12T22:08:06.394 INFO:teuthology.orchestra.run.smithi107.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-12T22:08:06.443 INFO:teuthology.orchestra.run.smithi019.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-12T22:08:06.449 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:08:06.449 INFO:teuthology.orchestra.run.smithi019.stdout:Total 18 MB/s | 213 MB 00:11 2024-09-12T22:08:06.470 INFO:teuthology.orchestra.run.smithi107.stdout:(113/139): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-12T22:08:06.495 INFO:teuthology.orchestra.run.smithi107.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-09-12T22:08:06.520 INFO:teuthology.orchestra.run.smithi107.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T22:08:06.535 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-12T22:08:06.545 INFO:teuthology.orchestra.run.smithi107.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T22:08:06.571 INFO:teuthology.orchestra.run.smithi107.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:08:06.604 INFO:teuthology.orchestra.run.smithi107.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T22:08:06.646 INFO:teuthology.orchestra.run.smithi107.stdout:(119/139): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-12T22:08:06.671 INFO:teuthology.orchestra.run.smithi107.stdout:(120/139): python3-natsort-7.1.1-5.el9.noarch.r 863 kB/s | 58 kB 00:00 2024-09-12T22:08:06.674 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-12T22:08:06.674 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-12T22:08:06.705 INFO:teuthology.orchestra.run.smithi107.stdout:(121/139): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-12T22:08:06.730 INFO:teuthology.orchestra.run.smithi107.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-12T22:08:06.756 INFO:teuthology.orchestra.run.smithi107.stdout:(123/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-12T22:08:06.781 INFO:teuthology.orchestra.run.smithi107.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-12T22:08:06.806 INFO:teuthology.orchestra.run.smithi107.stdout:(125/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 892 kB/s | 90 kB 00:00 2024-09-12T22:08:06.832 INFO:teuthology.orchestra.run.smithi107.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T22:08:06.857 INFO:teuthology.orchestra.run.smithi107.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-12T22:08:06.882 INFO:teuthology.orchestra.run.smithi107.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T22:08:06.907 INFO:teuthology.orchestra.run.smithi107.stdout:(129/139): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T22:08:06.974 INFO:teuthology.orchestra.run.smithi107.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 977 kB/s | 90 kB 00:00 2024-09-12T22:08:07.000 INFO:teuthology.orchestra.run.smithi107.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-12T22:08:07.017 INFO:teuthology.orchestra.run.smithi107.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 475 kB/s | 20 kB 00:00 2024-09-12T22:08:07.042 INFO:teuthology.orchestra.run.smithi107.stdout:(133/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T22:08:07.067 INFO:teuthology.orchestra.run.smithi107.stdout:(134/139): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T22:08:07.117 INFO:teuthology.orchestra.run.smithi107.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T22:08:07.315 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-12T22:08:07.418 INFO:teuthology.orchestra.run.smithi107.stdout:(136/139): librbd1-19.1.1-314.g086c737f.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-12T22:08:07.452 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T22:08:07.452 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-12T22:08:07.452 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-12T22:08:07.518 INFO:teuthology.orchestra.run.smithi107.stdout:(137/139): librados2-19.1.1-314.g086c737f.el9.x 7.2 MB/s | 3.4 MB 00:00 2024-09-12T22:08:07.605 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T22:08:07.605 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T22:08:07.876 INFO:teuthology.orchestra.run.smithi107.stdout:(138/139): openssl-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 1.4 MB 00:00 2024-09-12T22:08:08.518 INFO:teuthology.orchestra.run.smithi107.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-12T22:08:08.524 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:08:08.524 INFO:teuthology.orchestra.run.smithi107.stdout:Total 13 MB/s | 213 MB 00:16 2024-09-12T22:08:08.746 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-12T22:08:08.746 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-12T22:08:09.511 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-12T22:08:09.646 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-12T22:08:09.646 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-12T22:08:09.720 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-12T22:08:09.721 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-12T22:08:09.771 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T22:08:09.771 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T22:08:11.720 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-12T22:08:11.720 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-12T22:08:14.374 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-12T22:08:14.487 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:08:14.534 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:08:14.595 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:08:14.629 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:08:14.654 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:08:14.710 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:08:15.132 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:08:15.256 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:15.361 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:15.390 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:15.464 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:15.505 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:08:15.512 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-12T22:08:15.533 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:15.638 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:08:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:15.682 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:08:15.713 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:15.744 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:15.747 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:08:15.769 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T22:08:15.776 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:15.789 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:08:15.823 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:08:15.872 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:08:15.883 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:08:15.919 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:08:15.981 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:15.982 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:08:16.011 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:16.023 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:08:16.048 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:08:16.101 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:08:16.128 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:08:16.223 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:08:16.263 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:08:16.274 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:08:16.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:08:16.341 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:16.370 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:08:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:08:16.448 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:08:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:08:16.462 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:08:16.508 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:16.532 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:08:16.557 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:16.559 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:08:16.598 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:16.630 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:08:16.640 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:08:16.668 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:16.683 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:16.690 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:08:16.727 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:16.735 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:08:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:16.773 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:08:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:16.817 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:16.850 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:08:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:08:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:16.884 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:08:16.885 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:16.912 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:16.928 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:08:16.956 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:08:16.990 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:17.018 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:17.026 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:08:17.071 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:08:17.082 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:17.106 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:17.111 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:17.132 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:17.145 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:17.146 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:08:17.259 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:08:17.288 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:08:17.325 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:17.346 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:08:17.348 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:08:17.354 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:17.378 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:08:17.413 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:08:17.466 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:08:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-12T22:08:17.486 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:08:17.530 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:08:17.563 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:08:17.569 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:08:17.603 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:08:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:08:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:08:17.638 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:08:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:08:17.652 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:08:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:08:17.705 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:08:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:08:17.744 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:08:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:08:17.756 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:08:17.773 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:08:17.796 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:08:17.797 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:08:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:08:17.838 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:08:17.840 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:08:17.867 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:08:17.880 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:08:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:08:17.907 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:08:17.951 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:08:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:08:17.981 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:08:17.988 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:08:17.999 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:08:18.024 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:08:18.043 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:08:18.048 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:08:18.062 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:08:18.071 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:08:18.081 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:08:18.113 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:08:18.121 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:08:18.141 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:08:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:08:18.186 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:08:18.200 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:08:18.231 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:08:18.257 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:18.260 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:08:18.273 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:08:18.275 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:08:18.312 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:08:18.332 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:08:18.386 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:08:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:08:18.388 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:18.403 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:08:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:18.435 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:08:18.454 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:08:18.467 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:08:18.513 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:08:18.516 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:18.516 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:08:18.556 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:08:18.560 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:08:18.585 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:18.607 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:08:18.652 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:08:18.666 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:08:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:18.694 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:08:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:18.722 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:08:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:08:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:08:18.830 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:08:18.872 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:08:18.913 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:08:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:08:19.011 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:19.014 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:08:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:08:19.056 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:08:19.075 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:08:19.105 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:08:19.113 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:08:19.153 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:08:19.154 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:08:19.155 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:08:19.179 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:08:19.193 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:08:19.239 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:08:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:08:19.273 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:08:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:08:19.299 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:08:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:08:19.361 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:08:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:08:19.403 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:08:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:08:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:08:19.446 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:08:19.447 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:08:19.471 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:08:19.476 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:08:19.484 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:08:19.487 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:08:19.515 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:08:19.519 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:08:19.525 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:08:19.531 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:08:19.551 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:08:19.552 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:08:19.580 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:08:19.581 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:08:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:08:19.616 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:08:19.647 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:08:19.649 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:08:19.649 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:08:19.683 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:08:19.691 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:08:19.708 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:08:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:08:19.730 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:08:19.734 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:08:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:08:19.762 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:08:19.775 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:08:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:08:19.817 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:08:19.818 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:08:19.837 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:08:19.869 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:08:19.889 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:08:19.893 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:08:19.904 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:08:19.921 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:08:19.938 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:08:19.947 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:08:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:08:19.974 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:08:19.976 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:08:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:08:20.022 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:08:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:08:20.045 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:08:20.060 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:08:20.067 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:08:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:08:20.091 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:08:20.108 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:08:20.166 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:08:20.170 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:08:20.211 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:08:20.251 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:08:20.263 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:08:20.293 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:08:20.293 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:08:20.297 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:08:20.318 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:08:20.335 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:08:20.351 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:08:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:08:20.449 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:08:20.485 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:08:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:08:20.536 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:08:20.566 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:08:20.575 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:08:20.598 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:08:20.599 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:08:20.631 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:08:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:08:20.708 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:08:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:08:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:08:20.787 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:08:20.822 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:08:20.841 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:08:20.873 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:08:20.882 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:08:20.883 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:08:20.905 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:08:20.909 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:08:20.927 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:08:20.938 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:08:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:08:20.955 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:08:20.960 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:08:20.968 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:08:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:08:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:08:21.002 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:08:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:08:21.036 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:08:21.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:08:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:08:21.079 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:08:21.095 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:08:21.109 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:08:21.112 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:08:21.202 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:08:21.251 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:08:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:08:21.282 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:08:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:08:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:08:21.327 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:08:21.337 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:08:21.381 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:08:21.393 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:08:21.396 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:08:21.418 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:08:21.455 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:08:21.475 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:08:21.487 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:08:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:08:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:08:21.626 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:08:21.673 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:08:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:08:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:08:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:08:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:08:22.038 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:08:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:08:22.111 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:08:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:08:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:08:22.160 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:08:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:08:22.240 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:08:22.268 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:08:22.268 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:08:22.288 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:08:22.301 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:08:22.322 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:08:22.393 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:08:22.401 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:08:22.423 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:08:22.435 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:08:22.436 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:08:22.456 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:08:22.472 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:08:22.488 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:08:22.518 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:08:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:08:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:08:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:08:22.620 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:08:22.654 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:08:22.656 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:08:22.658 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:08:22.703 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:08:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:08:22.751 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:08:22.783 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:08:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:08:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:08:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:08:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:08:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:08:23.423 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:08:23.473 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:08:23.509 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:08:23.536 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:08:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:08:23.570 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:08:23.606 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:08:23.682 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:08:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:08:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:08:23.864 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:08:23.897 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:08:23.907 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:08:23.950 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:24.040 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:24.079 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:08:24.092 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:08:24.121 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:08:24.130 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:08:24.200 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:08:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:08:24.652 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:24.709 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:24.740 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:08:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:08:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:08:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:08:24.938 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:08:24.948 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:08:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:08:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:08:25.027 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:08:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:08:25.087 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:08:25.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:08:25.336 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:25.415 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:08:25.427 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:25.458 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:08:25.459 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:25.494 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:08:25.559 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:25.589 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:08:25.629 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:08:25.972 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:08:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:26.107 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:08:26.133 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:08:26.161 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:08:26.233 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:26.263 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:08:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:08:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:08:26.333 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:08:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:08:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:26.766 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:08:26.797 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:08:26.837 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:08:26.999 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:27.028 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:27.314 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:08:27.345 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:27.416 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:08:27.447 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:08:27.595 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:27.709 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:27.710 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:08:27.710 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:08:27.710 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:27.741 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:28.430 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:28.470 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:28.677 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:28.712 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:29.155 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:29.155 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:08:29.155 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:08:29.155 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:29.225 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:29.291 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:29.332 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:29.414 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:29.415 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:08:29.415 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:08:29.415 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:29.450 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:30.340 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:08:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:30.471 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:08:30.471 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:08:30.471 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:08:30.471 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:30.507 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:39.445 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:39.445 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-09-12T22:08:39.445 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-09-12T22:08:39.445 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-09-12T22:08:39.446 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-09-12T22:08:39.446 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-09-12T22:08:39.446 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-09-12T22:08:39.446 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-09-12T22:08:39.446 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:39.621 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:39.637 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:39.638 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:39.638 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:08:39.638 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:40.840 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:40.840 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-12T22:08:40.840 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-12T22:08:40.840 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-12T22:08:40.840 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-12T22:08:40.841 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-12T22:08:40.841 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-12T22:08:40.841 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-12T22:08:40.841 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:41.012 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:41.028 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:41.029 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:41.029 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:08:41.029 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:41.124 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:41.152 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:08:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:41.152 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:41.339 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:41.339 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-09-12T22:08:41.339 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-09-12T22:08:41.339 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-09-12T22:08:41.339 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-09-12T22:08:41.339 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-09-12T22:08:41.339 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-09-12T22:08:41.340 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-09-12T22:08:41.340 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:41.383 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:41.407 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:08:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:41.407 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:41.519 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:41.535 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:41.535 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:41.535 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:08:41.535 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:08:41.801 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-09-12T22:08:41.801 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-09-12T22:08:41.801 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-09-12T22:08:41.801 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-09-12T22:08:41.801 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-09-12T22:08:41.802 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-09-12T22:08:41.802 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-09-12T22:08:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:41.851 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:41.875 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:41.875 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:08:41.875 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:41.875 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:41.875 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:41.981 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:08:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:08:41.984 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:41.984 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:08:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:42.029 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:08:42.084 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:08:42.266 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:08:42.318 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:08:42.394 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:08:42.483 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:08:42.532 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:42.559 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:42.559 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:42.559 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:08:42.559 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:42.559 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:42.559 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:42.622 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:08:42.678 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:08:42.717 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:08:42.745 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:08:42.782 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:42.806 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:42.806 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:08:42.806 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:42.806 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:43.072 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:43.099 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:43.100 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:43.100 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:43.100 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:08:43.100 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:43.100 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:43.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:43.127 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:43.175 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:08:43.245 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:08:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:43.272 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:43.273 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:43.273 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:08:43.273 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:43.273 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:43.273 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:43.275 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:43.331 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:43.355 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:43.355 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:43.355 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:08:43.356 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:43.356 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:43.356 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:08:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:08:43.471 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:43.497 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:08:43.497 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:43.498 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:08:43.498 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:43.498 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:08:43.498 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:08:43.693 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:08:43.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:43.742 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:08:43.754 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:08:43.754 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:43.754 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:08:43.754 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:43.754 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:08:43.754 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:43.815 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:43.820 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:08:43.839 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:43.839 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:43.840 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:08:43.840 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:43.840 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:43.840 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:43.907 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:08:43.954 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:08:44.012 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:08:44.040 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:08:44.075 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:08:44.088 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:08:44.124 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:08:44.152 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:08:44.191 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:44.214 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:08:44.214 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:44.214 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:08:44.214 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:44.214 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:08:44.214 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:44.269 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:08:44.320 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:44.321 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:08:44.324 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:08:44.352 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:44.369 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:08:44.424 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:08:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:08:44.518 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:08:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:44.608 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:44.611 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:08:44.640 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:08:44.660 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:08:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:08:44.703 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:08:44.703 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:08:44.731 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:44.739 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:08:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:08:44.767 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:08:44.834 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:08:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:08:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:08:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:08:45.070 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:08:45.190 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:45.247 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:08:45.312 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:08:45.316 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:45.347 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:45.364 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:45.465 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:08:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:08:45.622 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:08:45.646 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:45.669 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:45.669 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:45.669 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:08:45.669 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:45.669 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:45.670 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:45.679 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:08:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:45.713 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:45.725 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:45.775 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:45.808 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:45.823 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:08:45.879 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:08:46.452 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:46.490 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:46.744 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:08:46.778 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:46.785 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:46.813 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:08:46.849 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:46.873 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:46.873 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:46.873 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:08:46.873 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:46.873 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:46.874 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:46.917 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:46.940 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:46.940 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:46.940 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:08:46.940 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:47.062 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:08:47.119 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:47.143 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:47.143 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:08:47.144 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:47.144 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:47.242 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:47.266 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:47.266 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:47.266 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:08:47.266 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:47.266 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:47.266 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:08:47.306 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:08:47.367 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:08:47.508 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:47.532 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:47.641 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:08:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:47.810 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:08:47.834 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:47.860 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:47.860 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:47.860 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:08:47.860 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:47.860 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:47.860 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:08:47.910 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:47.922 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:48.024 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:08:48.031 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:08:48.055 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:48.079 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:08:48.079 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:48.079 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:08:48.079 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:48.079 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:08:48.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:48.086 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:08:48.130 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:48.142 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:08:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:08:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:08:48.314 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:08:48.348 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:48.371 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:48.371 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:48.371 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:08:48.371 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:48.372 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:48.372 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:48.415 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:48.438 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:48.438 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:48.438 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:08:48.438 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:48.772 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:48.772 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:08:48.772 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:48.772 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:08:49.071 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:08:49.104 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:49.129 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:49.129 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:49.129 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:08:49.129 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:49.129 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:49.129 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:49.171 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:49.195 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:49.195 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:49.195 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:08:49.196 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:49.228 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:08:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:08:49.282 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:49.282 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:08:49.282 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:49.282 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:08:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:49.325 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:49.348 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:08:49.348 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:49.348 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:08:49.348 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:49.513 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:49.538 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:49.538 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:49.538 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:08:49.538 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:49.538 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:49.538 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:08:49.651 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:49.674 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:08:49.674 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:08:49.675 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:08:49.675 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:49.675 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:08:49.675 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:08:51.838 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:08:51.878 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:08:51.920 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:08:51.952 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:08:51.978 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:08:52.798 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:08:52.905 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:08:52.972 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:08:53.085 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:08:53.117 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:08:53.168 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:08:53.168 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:53.268 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:53.268 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:53.353 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:53.360 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:08:53.409 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:08:53.417 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:08:53.450 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:08:53.483 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:08:53.509 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:08:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:08:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:08:54.294 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:08:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:08:54.348 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:08:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:08:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:08:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:08:54.443 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:08:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:08:54.501 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:08:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:08:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:08:54.626 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:08:54.664 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:08:54.698 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:08:54.698 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:54.930 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:08:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:08:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:08:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:08:55.438 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:08:55.438 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:08:55.467 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:08:55.501 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:08:55.501 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:55.525 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:08:55.583 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:08:55.585 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:55.585 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:55.676 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:08:55.677 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:55.704 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:08:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:08:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:08:55.746 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:08:55.830 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:55.915 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:08:55.982 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:08:58.873 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:08:58.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:08:58.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:08:58.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:08:58.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:08:58.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:08:58.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:08:58.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:08:58.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:08:58.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:08:58.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:08:58.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:08:58.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:08:58.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:08:58.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:08:58.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:08:58.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:08:58.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:08:58.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:08:58.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:09:00.280 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:09:00.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:09:00.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:09:00.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:09:00.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:09:00.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:09:00.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:09:00.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:09:00.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:09:00.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:09:00.287 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:09:00.288 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:09:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:09:00.290 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:09:00.291 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:09:00.292 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:09:00.292 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:09:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:09:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:09:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:09:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:09:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:09:00.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:09:00.971 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:09:00.972 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:09:00.973 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:09:00.974 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:09:00.975 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:09:00.976 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:09:00.977 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:09:00.978 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:09:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:09:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:09:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:09:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:09:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:09:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:09:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:09:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:09:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:09:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:09:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:09:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:09:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:09:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:09:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:09:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:09:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:09:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:09:01.254 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:09:01.254 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:01.254 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-09-12T22:09:01.254 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.254 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.254 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.255 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.256 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:09:01.257 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:09:01.258 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:09:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:09:01.260 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:09:01.261 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:09:01.262 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.263 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:09:01.264 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:09:01.265 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:09:01.266 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:01.266 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-12T22:09:01.604 DEBUG:teuthology.parallel:result is None 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:09:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:09:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:09:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:09:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:09:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:09:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:09:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:09:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:09:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:02.370 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-12T22:09:02.702 DEBUG:teuthology.parallel:result is None 2024-09-12T22:09:03.344 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:09:03.344 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:09:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:09:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:09:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:09:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:09:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:09:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:09:03.356 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:09:03.356 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:03.356 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T22:09:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:09:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:03.453 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-09-12T22:09:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:09:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:09:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:09:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:09:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:09:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:09:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:09:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:09:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:09:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:09:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:03.465 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-12T22:09:03.685 DEBUG:teuthology.parallel:result is None 2024-09-12T22:09:03.796 DEBUG:teuthology.parallel:result is None 2024-09-12T22:09:03.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:09:03.945 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:09:03.968 INFO:teuthology.orchestra.run.smithi019.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:09:03.969 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:09:03.969 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:09:03.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:09:04.114 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:09:04.136 INFO:teuthology.orchestra.run.smithi107.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:09:04.136 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:09:04.137 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:09:04.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:09:04.278 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:09:04.304 INFO:teuthology.orchestra.run.smithi148.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:09:04.304 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:09:04.304 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:09:04.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:09:04.444 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:09:04.471 INFO:teuthology.orchestra.run.smithi164.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:09:04.471 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:09:04.471 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:09:04.473 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T22:09:04.473 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:04.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:09:04.505 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:04.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:09:04.534 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:04.534 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:09:04.566 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:04.566 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:09:04.598 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T22:09:04.599 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:04.599 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:09:04.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:09:04.697 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:04.697 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:09:04.723 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:09:04.789 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:04.790 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:09:04.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:09:04.889 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:04.889 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:09:04.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:09:04.988 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T22:09:04.989 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:04.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:09:05.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:09:05.089 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:05.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:09:05.115 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:09:05.181 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:05.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:09:05.211 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:09:05.279 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:05.279 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:09:05.308 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:09:05.378 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T22:09:05.378 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:05.378 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:09:05.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:09:05.479 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:05.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:09:05.505 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:09:05.570 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:05.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:09:05.600 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:09:05.674 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:05.805 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:09:05.835 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:09:05.904 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T22:09:05.984 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T22:09:05.984 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-09-12T22:09:05.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-09-12T22:09:05.990 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-09-12T22:09:05.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-09-12T22:09:06.021 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T22:09:06.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:09:06.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:09:06.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:09:06.063 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:09:06.090 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T22:09:06.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:09:06.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:09:06.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:09:06.133 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:09:06.170 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T22:09:06.170 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T22:09:06.171 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7902919', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8861, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOI8C/uRa3GIGuTsgrSBJ4Xl+Y+3cqBHPLOcOEHtcu470zoiKNZ2A2y8ZMvUEoj+TMihHnCc3KvpcBVI7gTKDT8=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOvv7OGgKDSl5fED1gCBOpGZNG2O7T14lvMGbvJ98YueXT55/MRJaqU7gEA4BgnBsXrJwKah5StG45TqoI7r1k=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTriyqD+q3kt4Ipx70QbmDLOSLFj/k3BAoKLsRorJzUwM/fxKhfN3KBM7cDk7zoEU2w7j5itVIJuiL20zWPc30=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNelOMKzff3xB+VAlk9Wh493qUVkkVP1X5ppv3jx5A6R51Ffcdb7nSGRkd6OYqB+sEN6aOwcBzArntoDSvaTiM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_21:32:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T22:09:06.171 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:09:06.197 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:09:06.200 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:09:06.202 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:09:06.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:09:06.255 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:09:06.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:09:06.259 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:09:06.287 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:06.287 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:09:06.338 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:09:06.338 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-09-12T22:09:06.394 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:09:06.394 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:06.395 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T22:09:06.395 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:06.395 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:06.395 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 22:08:56.094635029 +0000 2024-09-12T22:09:06.395 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 22:07:02.404419528 +0000 2024-09-12T22:09:06.395 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 22:07:02.404419528 +0000 2024-09-12T22:09:06.395 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 22:07:02.404419528 +0000 2024-09-12T22:09:06.395 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:09:06.459 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T22:09:06.459 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T22:09:06.459 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000273304 s, 1.9 MB/s 2024-09-12T22:09:06.460 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:09:06.516 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 22:08:56.094635029 +0000 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 22:07:02.727414067 +0000 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 22:07:02.727414067 +0000 2024-09-12T22:09:06.573 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 22:07:02.727414067 +0000 2024-09-12T22:09:06.573 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:09:06.636 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T22:09:06.636 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T22:09:06.636 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000171913 s, 3.0 MB/s 2024-09-12T22:09:06.637 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:09:06.693 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-09-12T22:09:06.749 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:09:06.749 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:06.749 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T22:09:06.749 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:06.749 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:06.749 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 22:08:56.095635012 +0000 2024-09-12T22:09:06.749 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 22:07:03.045408691 +0000 2024-09-12T22:09:06.750 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 22:07:03.045408691 +0000 2024-09-12T22:09:06.750 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 22:07:03.045408691 +0000 2024-09-12T22:09:06.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:09:06.812 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T22:09:06.812 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T22:09:06.812 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000212031 s, 2.4 MB/s 2024-09-12T22:09:06.813 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:09:06.869 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-09-12T22:09:06.924 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:09:06.924 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:06.924 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T22:09:06.924 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:06.924 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:06.924 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 22:08:56.095635012 +0000 2024-09-12T22:09:06.925 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 22:07:03.359403382 +0000 2024-09-12T22:09:06.925 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 22:07:03.359403382 +0000 2024-09-12T22:09:06.925 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 22:07:03.359403382 +0000 2024-09-12T22:09:06.925 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:09:06.986 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T22:09:06.987 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T22:09:06.987 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000157852 s, 3.2 MB/s 2024-09-12T22:09:06.988 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:09:07.043 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:09:07.043 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:07.044 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:09:07.063 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:09:07.063 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-12T22:09:07.121 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:09:07.121 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:07.121 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T22:09:07.121 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:07.121 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:07.121 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:08:55.293024020 +0000 2024-09-12T22:09:07.121 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:07:03.552734528 +0000 2024-09-12T22:09:07.122 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:07:03.552734528 +0000 2024-09-12T22:09:07.122 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:07:03.552734528 +0000 2024-09-12T22:09:07.122 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:09:07.188 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:09:07.188 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:09:07.188 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000295596 s, 1.7 MB/s 2024-09-12T22:09:07.189 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:09:07.248 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-12T22:09:07.305 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:08:55.293024020 +0000 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:07:03.887726864 +0000 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:07:03.887726864 +0000 2024-09-12T22:09:07.306 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:07:03.887726864 +0000 2024-09-12T22:09:07.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:09:07.371 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:09:07.371 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:09:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000238862 s, 2.1 MB/s 2024-09-12T22:09:07.373 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:09:07.430 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-12T22:09:07.486 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:09:07.486 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:07.486 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T22:09:07.486 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:07.486 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:07.486 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:08:55.294023997 +0000 2024-09-12T22:09:07.486 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:07:04.226719108 +0000 2024-09-12T22:09:07.487 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:07:04.226719108 +0000 2024-09-12T22:09:07.487 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:07:04.226719108 +0000 2024-09-12T22:09:07.487 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:09:07.550 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:09:07.550 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:09:07.550 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000207218 s, 2.5 MB/s 2024-09-12T22:09:07.552 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:09:07.608 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-12T22:09:07.664 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:09:07.664 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:07.664 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T22:09:07.664 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:07.664 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:07.664 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:08:55.294023997 +0000 2024-09-12T22:09:07.664 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:07:04.554711604 +0000 2024-09-12T22:09:07.665 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:07:04.554711604 +0000 2024-09-12T22:09:07.665 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:07:04.554711604 +0000 2024-09-12T22:09:07.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:09:07.727 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:09:07.728 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:09:07.728 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000202555 s, 2.5 MB/s 2024-09-12T22:09:07.729 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:09:07.785 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:09:07.785 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:07.785 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:09:07.804 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:09:07.805 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-09-12T22:09:07.863 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-12 22:08:53.793613184 +0000 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-12 22:07:04.109213373 +0000 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-12 22:07:04.109213373 +0000 2024-09-12T22:09:07.864 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-12 22:07:04.109213373 +0000 2024-09-12T22:09:07.864 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:09:07.932 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-12T22:09:07.932 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-12T22:09:07.933 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000348023 s, 1.5 MB/s 2024-09-12T22:09:07.934 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:09:07.992 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-09-12T22:09:08.050 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-12 22:08:53.793613184 +0000 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-12 22:07:04.447208194 +0000 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-12 22:07:04.447208194 +0000 2024-09-12T22:09:08.051 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-12 22:07:04.447208194 +0000 2024-09-12T22:09:08.051 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:09:08.117 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-12T22:09:08.117 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-12T22:09:08.117 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000204712 s, 2.5 MB/s 2024-09-12T22:09:08.119 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:09:08.176 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-09-12T22:09:08.233 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-12 22:08:53.794613168 +0000 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-12 22:07:04.765203322 +0000 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-12 22:07:04.765203322 +0000 2024-09-12T22:09:08.234 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-12 22:07:04.765203322 +0000 2024-09-12T22:09:08.234 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:09:08.299 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-12T22:09:08.299 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-12T22:09:08.299 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000220853 s, 2.3 MB/s 2024-09-12T22:09:08.300 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:09:08.358 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-09-12T22:09:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:09:08.415 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:09:08.415 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T22:09:08.415 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:09:08.415 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:09:08.415 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-12 22:08:53.794613168 +0000 2024-09-12T22:09:08.415 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-12 22:07:05.084198435 +0000 2024-09-12T22:09:08.416 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-12 22:07:05.084198435 +0000 2024-09-12T22:09:08.416 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-12 22:07:05.084198435 +0000 2024-09-12T22:09:08.416 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:09:08.479 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-12T22:09:08.479 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-12T22:09:08.479 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000214768 s, 2.4 MB/s 2024-09-12T22:09:08.481 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:09:08.537 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:09:08.537 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:09:08.537 INFO:tasks.ceph:Generating config... 2024-09-12T22:09:08.539 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T22:09:08.539 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T22:09:08.539 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T22:09:08.539 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T22:09:08.539 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T22:09:08.539 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T22:09:08.539 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-12T22:09:08.539 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-12T22:09:08.539 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T22:09:08.539 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T22:09:08.539 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T22:09:08.539 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T22:09:08.540 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T22:09:08.540 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T22:09:08.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T22:09:08.620 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T22:09:08.623 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T22:09:08.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:09:08.697 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]'), ('mon.c', '[v2:172.21.15.19:3302,v1:172.21.15.19:6791]')] 2024-09-12T22:09:08.698 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-09-12T22:09:08.698 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:08.699 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:09:08.754 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --addv b '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]' --addv c '[v2:172.21.15.19:3302,v1:172.21.15.19:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:08.843 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:08.843 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid 2fe6789e-9afe-4094-9a02-5d2cb3971ecc 2024-09-12T22:09:08.843 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-12T22:09:08.843 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-09-12T22:09:08.843 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 2fe6789e-9afe-4094-9a02-5d2cb3971ecc 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-09-12T22:09:08.843236+0000 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T22:09:08.843236+0000 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.b 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] mon.c 2024-09-12T22:09:08.844 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T22:09:08.845 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:09:08.861 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2fe6789e-9afe-4094-9a02-5d2cb3971ecc... 2024-09-12T22:09:08.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:09:08.903 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:09:08.906 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:09:08.908 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.946 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.948 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 2fe6789e-9afe-4094-9a02-5d2cb3971ecc 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-09-12T22:09:08.949 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-09-12T22:09:08.950 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-09-12T22:09:08.951 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore compression algorithm = snappy 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore compression mode = aggressive 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:09:08.952 INFO:teuthology.orchestra.run.smithi019.stdout: osd max markdown count = 1000 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T22:09:08.953 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.954 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-09-12T22:09:08.955 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:09:08.956 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:09:08.956 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-09-12T22:09:08.956 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-09-12T22:09:08.956 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-09-12T22:09:08.956 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-09-12T22:09:08.956 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-12T22:09:08.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-12T22:09:08.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-12T22:09:08.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 2fe6789e-9afe-4094-9a02-5d2cb3971ecc 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.960 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.961 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression algorithm = snappy 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression mode = aggressive 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-12T22:09:08.962 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: osd max markdown count = 1000 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-12T22:09:08.963 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-12T22:09:08.964 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:09:08.965 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-12T22:09:08.966 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-09-12T22:09:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:09:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 2fe6789e-9afe-4094-9a02-5d2cb3971ecc 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-09-12T22:09:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-09-12T22:09:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression algorithm = snappy 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression mode = aggressive 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-09-12T22:09:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: osd max markdown count = 1000 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-12T22:09:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-09-12T22:09:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:09:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-09-12T22:09:08.976 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-09-12T22:09:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:09:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:09:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-09-12T22:09:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 2fe6789e-9afe-4094-9a02-5d2cb3971ecc 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression algorithm = snappy 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression mode = aggressive 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2024-09-12T22:09:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: osd max markdown count = 1000 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:09:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:09:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-09-12T22:09:08.990 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2024-09-12T22:09:08.990 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T22:09:08.991 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T22:09:09.075 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T22:09:09.075 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:09.075 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T22:09:09.091 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:09.091 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T22:09:09.146 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T22:09:09.146 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:09.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:09:09.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:09:09.222 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:09.222 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:09.278 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T22:09:09.278 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:09.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:09:09.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:09:09.319 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:09.319 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:09.377 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:09:09.377 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:09.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:09:09.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:09:09.419 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:09.419 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:09.477 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:09:09.477 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:09.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:09:09.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:09:09.517 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:09.517 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:09.573 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T22:09:09.574 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T22:09:09.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:09:09.627 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:09:09.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:09:09.682 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:09:09.685 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T22:09:09.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:09:09.737 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:09:09.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T22:09:09.764 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T22:09:09.765 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T22:09:09.847 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T22:09:09.861 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T22:09:09.861 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:09:09.861 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T22:09:09.891 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:09:09.891 INFO:tasks.ceph:role: osd.0 2024-09-12T22:09:09.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T22:09:09.891 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:09:09.967 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:09:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:09:09.968 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:09:10.473 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-12T22:09:10.475 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-12T22:09:10.475 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T22:09:10.618 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T22:09:10.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:10.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T22:09:10.745+0000 7fa827e20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T22:09:10.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T22:09:10.746+0000 7fa827e20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T22:09:10.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T22:09:10.746+0000 7fa827e20640 -1 bdev(0x56063b3e3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T22:09:10.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T22:09:10.746+0000 7fa827e20640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T22:09:14.153 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T22:09:14.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T22:09:14.213 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:09:14.213 INFO:tasks.ceph:role: osd.1 2024-09-12T22:09:14.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:09:14.213 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:09:14.289 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:09:14.811 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-12T22:09:14.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-12T22:09:14.814 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T22:09:14.945 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T22:09:14.981 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:15.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:09:15.104+0000 7f1b9120f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T22:09:15.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:09:15.106+0000 7f1b9120f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T22:09:15.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:09:15.106+0000 7f1b9120f640 -1 bdev(0x55a402081800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T22:09:15.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:09:15.106+0000 7f1b9120f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T22:09:18.290 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T22:09:18.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T22:09:18.351 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:09:18.351 INFO:tasks.ceph:role: osd.2 2024-09-12T22:09:18.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:09:18.351 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:09:18.427 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:09:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:09:18.427 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:09:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:09:18.428 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:09:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:09:18.428 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:09:18.428 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:09:18.428 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:09:18.428 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:09:18.949 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-12T22:09:18.951 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-12T22:09:18.951 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T22:09:19.101 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T22:09:19.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:19.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-12T22:09:19.248+0000 7f4b15ce2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T22:09:19.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-12T22:09:19.250+0000 7f4b15ce2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T22:09:19.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-12T22:09:19.250+0000 7f4b15ce2640 -1 bdev(0x561e5d22d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T22:09:19.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-12T22:09:19.250+0000 7f4b15ce2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T22:09:22.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T22:09:22.222 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T22:09:22.222 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:22.222 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T22:09:22.253 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:22.254 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T22:09:22.324 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:22.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T22:09:22.394 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:22.394 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T22:09:22.424 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:22.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T22:09:22.455 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:22.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T22:09:22.485 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:09:22.485 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T22:09:22.503 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T22:09:22.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T22:09:22.569 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-09-12T22:09:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCFZuNmsgZoJRAApTjOAQrg863hLBUfvFNsOg== 2024-09-12T22:09:22.569 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-09-12T22:09:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCFZuNmLqSqKBAAfsL6fH6+tIWoN3ICSEFcUQ== 2024-09-12T22:09:22.569 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCFZuNm5OntKxAAtbDbAV4r2ocSbuoho+6/DA== 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCGZuNmHNZ1LBAADs+Gp5FQAE1nH1CPhHgcDQ== 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCLZuNmZrc/BhAAc8o01XiEmuSxifevUNB0GQ== 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCPZuNmwzDZDhAApWAaXCBpRa+dPyZv1fQsaQ== 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T22:09:22.570 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCFZuNmzUuEMhAAALupLD3gSGQm3TBFUBINsg== 2024-09-12T22:09:22.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:09:22.663 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:09:22.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T22:09:22.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:09:22.825 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:09:22.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:09:22.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T22:09:22.986 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T22:09:22.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T22:09:23.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:09:23.110 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T22:09:23.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T22:09:23.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:09:23.300 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T22:09:23.326 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T22:09:23.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:09:23.489 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T22:09:23.514 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:09:23.569 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T22:09:23.569 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T22:09:23.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T22:09:23.611 INFO:tasks.ceph.mon.a:Started 2024-09-12T22:09:23.611 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T22:09:23.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T22:09:23.613 INFO:tasks.ceph.mon.b:Started 2024-09-12T22:09:23.613 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T22:09:23.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T22:09:23.616 INFO:tasks.ceph.mon.c:Started 2024-09-12T22:09:23.616 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T22:09:23.616 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T22:09:23.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T22:09:23.618 INFO:tasks.ceph.mgr.x:Started 2024-09-12T22:09:23.619 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T22:09:23.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T22:09:23.621 INFO:tasks.ceph.mgr.y:Started 2024-09-12T22:09:23.621 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T22:09:23.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T22:09:28.923 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:28.922+0000 7f2b31d2f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:09:28.924 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:28.922+0000 7f6604612040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:09:28.967 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:28.966+0000 7f2b31d2f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:09:28.967 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:28.966+0000 7f6604612040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:09:29.120 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:29.119+0000 7f6604612040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:09:29.120 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:29.119+0000 7f2b31d2f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:09:29.173 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:29.172+0000 7f2b31d2f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:09:29.174 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:29.172+0000 7f6604612040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:09:29.343 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:29.342+0000 7f6604612040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:09:29.343 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:29.342+0000 7f2b31d2f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:09:29.461 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:29.460+0000 7f2b31d2f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:09:29.461 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:29.460+0000 7f6604612040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:09:29.809 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:29.807+0000 7f2b31d2f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:09:29.809 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:29.807+0000 7f6604612040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:09:29.835 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-12T22:09:29.849 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T22:09:29.849 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T22:09:29.849 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T22:09:29.849 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T22:09:29.861 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:29.860+0000 7f2b31d2f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:09:29.861 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:29.860+0000 7f6604612040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:09:29.883 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:09:29.883 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T22:09:29.914 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-12T22:09:29.914 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T22:09:29.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 65e58e9b-56bf-491e-aaa7-2c19805f71f8 0 2024-09-12T22:09:30.021 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:30.020+0000 7f6604612040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:09:30.021 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:30.020+0000 7f2b31d2f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:09:30.170 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-09-12T22:09:30.181 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 12c1612a-797e-4568-b2ad-a072c212de6a 1 2024-09-12T22:09:30.359 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-12T22:09:30.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 975ed872-557f-49b3-a957-216e3ae8dbb6 2 2024-09-12T22:09:30.543 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-09-12T22:09:30.554 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T22:09:30.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T22:09:30.556 INFO:tasks.ceph.osd.0:Started 2024-09-12T22:09:30.556 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T22:09:30.556 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T22:09:30.559 INFO:tasks.ceph.osd.1:Started 2024-09-12T22:09:30.559 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T22:09:30.559 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T22:09:30.562 INFO:tasks.ceph.osd.2:Started 2024-09-12T22:09:30.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:30.737 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:30.737 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:30.541441+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:30.748 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T22:09:30.748 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T22:09:31.027 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.025+0000 7f6604612040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:09:31.027 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.026+0000 7f2b31d2f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:09:31.050 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:31.084 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.083+0000 7f2b31d2f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:09:31.085 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.083+0000 7f6604612040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:09:31.217 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T22:09:31.217 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":5,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:30.541441+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:31.227 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:09:31.484 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.483+0000 7f2b31d2f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:09:31.485 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.483+0000 7f6604612040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:09:31.575 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.574+0000 7f2b31d2f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:09:31.575 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.574+0000 7f6604612040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:09:31.689 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.688+0000 7f6604612040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:09:31.689 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.688+0000 7f2b31d2f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:09:31.724 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:09:31.722+0000 7fd08b61e640 -1 Falling back to public interface 2024-09-12T22:09:31.738 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.737+0000 7f6604612040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:09:31.739 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.737+0000 7f2b31d2f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:09:31.861 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.859+0000 7f6604612040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:09:31.861 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.859+0000 7f2b31d2f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:09:31.917 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.916+0000 7f2b31d2f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:09:31.918 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.916+0000 7f6604612040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:09:31.965 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:31.964+0000 7f2b31d2f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:09:31.965 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:31.964+0000 7f6604612040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:09:31.978 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:09:31.977+0000 7fcb64411640 -1 Falling back to public interface 2024-09-12T22:09:32.084 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:32.083+0000 7f6604612040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:09:32.085 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:32.083+0000 7f2b31d2f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:09:32.138 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:32.137+0000 7f2b31d2f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:09:32.138 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:32.137+0000 7f6604612040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:09:32.193 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:32.191+0000 7f2b31d2f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:09:32.193 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:32.191+0000 7f6604612040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:09:32.236 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:09:32.233+0000 7f7d1440b640 -1 Falling back to public interface 2024-09-12T22:09:32.265 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:32.264+0000 7f2b31d2f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:09:32.265 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:32.264+0000 7f6604612040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:09:32.313 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:32.311+0000 7f2b31d2f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:09:32.313 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:32.312+0000 7f6604612040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:09:32.360 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:32.359+0000 7f6604612040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:09:32.360 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:32.359+0000 7f2b31d2f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:09:33.059 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:33.058+0000 7f2b31d2f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:09:33.060 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:09:33.058+0000 7f6604612040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:09:34.075 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:34.074+0000 7f2ad1ce8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T22:09:34.076 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:09:34.074+0000 7f2ad1ce8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T22:09:35.477 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:09:35.475+0000 7fd08b61e640 -1 osd.2 0 log_to_monitors true 2024-09-12T22:09:35.736 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:09:35.734+0000 7f7d1440b640 -1 osd.0 0 log_to_monitors true 2024-09-12T22:09:35.971 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:09:35.970+0000 7fcb64411640 -1 osd.1 0 log_to_monitors true 2024-09-12T22:09:37.528 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:37.782 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:09:37.780+0000 7fd087872640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T22:09:37.791 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:09:37.789+0000 7fd07ee7e640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:09:37.809 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:09:37.807+0000 7f7d1060d640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T22:09:37.816 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:09:37.815+0000 7fcb5fced640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T22:09:37.823 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:09:37.822+0000 7f7d07c19640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:09:37.824 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T22:09:37.824 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":7,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:37.078968+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:37.830 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:09:37.829+0000 7fcb57b0d640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:09:37.835 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:09:44.137 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:44.430 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T22:09:44.431 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":11,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:41.787130+0000","last_up_change":"2024-09-12T22:09:38.783190+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6801","nonce":2383753808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6803","nonce":2383753808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6807","nonce":2383753808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6805","nonce":2383753808}]},"public_addr":"172.21.15.164:6801/2383753808","cluster_addr":"172.21.15.164:6803/2383753808","heartbeat_back_addr":"172.21.15.164:6807/2383753808","heartbeat_front_addr":"172.21.15.164:6805/2383753808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:44.442 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T22:09:44.442 INFO:tasks.ceph:Creating RBD pool 2024-09-12T22:09:44.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T22:09:44.803 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'rbd' created 2024-09-12T22:09:44.815 DEBUG:teuthology.orchestra.run.smithi019:> rbd --cluster ceph pool init rbd 2024-09-12T22:09:47.836 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T22:09:47.837 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T22:09:47.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T22:09:47.843 INFO:tasks.ceph.mds.a:Started 2024-09-12T22:09:47.843 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T22:09:47.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:09:47.925 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T22:09:48.178 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:48.178 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"btime":"2024-09-12T22:09:47:928191+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6803/363514776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":363514776},{"type":"v1","addr":"172.21.15.19:6803","nonce":363514776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T22:09:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-09-12T22:09:48.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T22:09:48.480 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:48.480 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T22:09:48.480 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:09:48.480 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T22:09:48.481 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T22:09:48.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:09:48.481 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:09:48.481 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 2, 2024-09-12T22:09:48.481 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": "rbd" 2024-09-12T22:09:48.481 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:09:48.481 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T22:09:48.492 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T22:09:48.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T22:09:48.933 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T22:09:48.947 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T22:09:49.935 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T22:09:49.953 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T22:09:50.956 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T22:09:50.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:51.276 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:51.276 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:50.289952+0000","last_up_change":"2024-09-12T22:09:38.783190+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6801","nonce":2383753808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6803","nonce":2383753808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6807","nonce":2383753808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6805","nonce":2383753808}]},"public_addr":"172.21.15.164:6801/2383753808","cluster_addr":"172.21.15.164:6803/2383753808","heartbeat_back_addr":"172.21.15.164:6807/2383753808","heartbeat_front_addr":"172.21.15.164:6805/2383753808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:51.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:51.578 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:51.579 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:50.289952+0000","last_up_change":"2024-09-12T22:09:38.783190+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6801","nonce":2383753808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6803","nonce":2383753808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6807","nonce":2383753808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6805","nonce":2383753808}]},"public_addr":"172.21.15.164:6801/2383753808","cluster_addr":"172.21.15.164:6803/2383753808","heartbeat_back_addr":"172.21.15.164:6807/2383753808","heartbeat_front_addr":"172.21.15.164:6805/2383753808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:51.592 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T22:09:51.981 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T22:09:51.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T22:09:52.934 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T22:09:52.934+0000 7f70af66b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T22:09:52.984 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T22:09:52.984 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:09:53.311 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:53.312 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:09:50.290318+0000","modified":"2024-09-12T22:09:52.306690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/363514776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":363514776},{"type":"v1","addr":"172.21.15.19:6803","nonce":363514776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-12T22:09:53.312 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:09:53.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:53.615 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:53.615 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:51.956951+0000","last_up_change":"2024-09-12T22:09:38.783190+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6801","nonce":2383753808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6803","nonce":2383753808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6807","nonce":2383753808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6805","nonce":2383753808}]},"public_addr":"172.21.15.164:6801/2383753808","cluster_addr":"172.21.15.164:6803/2383753808","heartbeat_back_addr":"172.21.15.164:6807/2383753808","heartbeat_front_addr":"172.21.15.164:6805/2383753808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:53.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:09:53.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:09:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:53.926 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:09:53.934 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T22:09:53.747132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81616,"kb_used_data":528,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033904,"statfs":{"total":289910292480,"available":289826717696,"internally_reserved":0,"allocated":540672,"data_stored":1306707,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.679801"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938252+0000","last_change":"2024-09-12T22:09:48.938252+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938252+0000","last_undegraded":"2024-09-12T22:09:48.938252+0000","last_fullsized":"2024-09-12T22:09:48.938252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939650+0000","last_change":"2024-09-12T22:09:48.939650+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939650+0000","last_undegraded":"2024-09-12T22:09:48.939650+0000","last_fullsized":"2024-09-12T22:09:48.939650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938402+0000","last_change":"2024-09-12T22:09:48.938402+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938402+0000","last_undegraded":"2024-09-12T22:09:48.938402+0000","last_fullsized":"2024-09-12T22:09:48.938402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937747+0000","last_change":"2024-09-12T22:09:48.937747+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937747+0000","last_undegraded":"2024-09-12T22:09:48.937747+0000","last_fullsized":"2024-09-12T22:09:48.937747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937720+0000","last_change":"2024-09-12T22:09:48.937720+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937720+0000","last_undegraded":"2024-09-12T22:09:48.937720+0000","last_fullsized":"2024-09-12T22:09:48.937720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937598+0000","last_change":"2024-09-12T22:09:48.937598+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937598+0000","last_undegraded":"2024-09-12T22:09:48.937598+0000","last_fullsized":"2024-09-12T22:09:48.937598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938570+0000","last_change":"2024-09-12T22:09:48.938570+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938570+0000","last_undegraded":"2024-09-12T22:09:48.938570+0000","last_fullsized":"2024-09-12T22:09:48.938570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937650+0000","last_change":"2024-09-12T22:09:48.937650+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937650+0000","last_undegraded":"2024-09-12T22:09:48.937650+0000","last_fullsized":"2024-09-12T22:09:48.937650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938996+0000","last_change":"2024-09-12T22:09:48.938996+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938996+0000","last_undegraded":"2024-09-12T22:09:48.938996+0000","last_fullsized":"2024-09-12T22:09:48.938996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937515+0000","last_change":"2024-09-12T22:09:48.937515+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937515+0000","last_undegraded":"2024-09-12T22:09:48.937515+0000","last_fullsized":"2024-09-12T22:09:48.937515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937672+0000","last_change":"2024-09-12T22:09:48.937672+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937672+0000","last_undegraded":"2024-09-12T22:09:48.937672+0000","last_fullsized":"2024-09-12T22:09:48.937672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938493+0000","last_change":"2024-09-12T22:09:48.938493+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938493+0000","last_undegraded":"2024-09-12T22:09:48.938493+0000","last_fullsized":"2024-09-12T22:09:48.938493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939306+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:48.939306+0000","last_peered":"2024-09-12T22:09:48.939306+0000","last_clean":"2024-09-12T22:09:48.939306+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:48.939306+0000","last_undegraded":"2024-09-12T22:09:48.939306+0000","last_fullsized":"2024-09-12T22:09:48.939306+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939383+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:48.939383+0000","last_peered":"2024-09-12T22:09:48.939383+0000","last_clean":"2024-09-12T22:09:48.939383+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:48.939383+0000","last_undegraded":"2024-09-12T22:09:48.939383+0000","last_fullsized":"2024-09-12T22:09:48.939383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938916+0000","last_change":"2024-09-12T22:09:48.938916+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938916+0000","last_undegraded":"2024-09-12T22:09:48.938916+0000","last_fullsized":"2024-09-12T22:09:48.938916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939248+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:48.939248+0000","last_peered":"2024-09-12T22:09:48.939248+0000","last_clean":"2024-09-12T22:09:48.939248+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:48.939248+0000","last_undegraded":"2024-09-12T22:09:48.939248+0000","last_fullsized":"2024-09-12T22:09:48.939248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938898+0000","last_change":"2024-09-12T22:09:48.938898+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938898+0000","last_undegraded":"2024-09-12T22:09:48.938898+0000","last_fullsized":"2024-09-12T22:09:48.938898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937084+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:48.937084+0000","last_peered":"2024-09-12T22:09:48.937084+0000","last_clean":"2024-09-12T22:09:48.937084+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:48.937084+0000","last_undegraded":"2024-09-12T22:09:48.937084+0000","last_fullsized":"2024-09-12T22:09:48.937084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937511+0000","last_change":"2024-09-12T22:09:48.937511+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937511+0000","last_undegraded":"2024-09-12T22:09:48.937511+0000","last_fullsized":"2024-09-12T22:09:48.937511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939429+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:48.939429+0000","last_peered":"2024-09-12T22:09:48.939429+0000","last_clean":"2024-09-12T22:09:48.939429+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:48.939429+0000","last_undegraded":"2024-09-12T22:09:48.939429+0000","last_fullsized":"2024-09-12T22:09:48.939429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937537+0000","last_change":"2024-09-12T22:09:48.937537+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937537+0000","last_undegraded":"2024-09-12T22:09:48.937537+0000","last_fullsized":"2024-09-12T22:09:48.937537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937772+0000","last_change":"2024-09-12T22:09:48.937772+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937772+0000","last_undegraded":"2024-09-12T22:09:48.937772+0000","last_fullsized":"2024-09-12T22:09:48.937772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937046+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:48.937046+0000","last_peered":"2024-09-12T22:09:48.937046+0000","last_clean":"2024-09-12T22:09:48.937046+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:48.937046+0000","last_undegraded":"2024-09-12T22:09:48.937046+0000","last_fullsized":"2024-09-12T22:09:48.937046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938900+0000","last_change":"2024-09-12T22:09:48.938900+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938900+0000","last_undegraded":"2024-09-12T22:09:48.938900+0000","last_fullsized":"2024-09-12T22:09:48.938900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939024+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:48.939024+0000","last_peered":"2024-09-12T22:09:48.939024+0000","last_clean":"2024-09-12T22:09:48.939024+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:48.939024+0000","last_undegraded":"2024-09-12T22:09:48.939024+0000","last_fullsized":"2024-09-12T22:09:48.939024+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938942+0000","last_change":"2024-09-12T22:09:48.938942+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938942+0000","last_undegraded":"2024-09-12T22:09:48.938942+0000","last_fullsized":"2024-09-12T22:09:48.938942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937076+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:48.937076+0000","last_peered":"2024-09-12T22:09:48.937076+0000","last_clean":"2024-09-12T22:09:48.937076+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:48.937076+0000","last_undegraded":"2024-09-12T22:09:48.937076+0000","last_fullsized":"2024-09-12T22:09:48.937076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938974+0000","last_change":"2024-09-12T22:09:48.938974+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938974+0000","last_undegraded":"2024-09-12T22:09:48.938974+0000","last_fullsized":"2024-09-12T22:09:48.938974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939499+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:48.939499+0000","last_peered":"2024-09-12T22:09:48.939499+0000","last_clean":"2024-09-12T22:09:48.939499+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:48.939499+0000","last_undegraded":"2024-09-12T22:09:48.939499+0000","last_fullsized":"2024-09-12T22:09:48.939499+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938391+0000","last_change":"2024-09-12T22:09:48.938391+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938391+0000","last_undegraded":"2024-09-12T22:09:48.938391+0000","last_fullsized":"2024-09-12T22:09:48.938391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937586+0000","last_change":"2024-09-12T22:09:48.937586+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937586+0000","last_undegraded":"2024-09-12T22:09:48.937586+0000","last_fullsized":"2024-09-12T22:09:48.937586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937729+0000","last_change":"2024-09-12T22:09:48.937729+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937729+0000","last_undegraded":"2024-09-12T22:09:48.937729+0000","last_fullsized":"2024-09-12T22:09:48.937729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939758+0000","last_change":"2024-09-12T22:09:48.939758+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939758+0000","last_undegraded":"2024-09-12T22:09:48.939758+0000","last_fullsized":"2024-09-12T22:09:48.939758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939793+0000","last_change":"2024-09-12T22:09:48.939793+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939793+0000","last_undegraded":"2024-09-12T22:09:48.939793+0000","last_fullsized":"2024-09-12T22:09:48.939793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939828+0000","last_change":"2024-09-12T22:09:48.939828+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939828+0000","last_undegraded":"2024-09-12T22:09:48.939828+0000","last_fullsized":"2024-09-12T22:09:48.939828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937599+0000","last_change":"2024-09-12T22:09:48.937599+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937599+0000","last_undegraded":"2024-09-12T22:09:48.937599+0000","last_fullsized":"2024-09-12T22:09:48.937599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937507+0000","last_change":"2024-09-12T22:09:48.937507+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937507+0000","last_undegraded":"2024-09-12T22:09:48.937507+0000","last_fullsized":"2024-09-12T22:09:48.937507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938832+0000","last_change":"2024-09-12T22:09:48.938832+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938832+0000","last_undegraded":"2024-09-12T22:09:48.938832+0000","last_fullsized":"2024-09-12T22:09:48.938832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938384+0000","last_change":"2024-09-12T22:09:48.938384+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938384+0000","last_undegraded":"2024-09-12T22:09:48.938384+0000","last_fullsized":"2024-09-12T22:09:48.938384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939807+0000","last_change":"2024-09-12T22:09:48.939807+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939807+0000","last_undegraded":"2024-09-12T22:09:48.939807+0000","last_fullsized":"2024-09-12T22:09:48.939807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.940560+0000","last_change":"2024-09-12T22:09:48.940560+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.940560+0000","last_undegraded":"2024-09-12T22:09:48.940560+0000","last_fullsized":"2024-09-12T22:09:48.940560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":630963,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":635130,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":40614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:09:53.939 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:09:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:54.271 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:09:54.281 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T22:09:53.747132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81616,"kb_used_data":528,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033904,"statfs":{"total":289910292480,"available":289826717696,"internally_reserved":0,"allocated":540672,"data_stored":1306707,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.679801"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938252+0000","last_change":"2024-09-12T22:09:48.938252+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938252+0000","last_undegraded":"2024-09-12T22:09:48.938252+0000","last_fullsized":"2024-09-12T22:09:48.938252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939650+0000","last_change":"2024-09-12T22:09:48.939650+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939650+0000","last_undegraded":"2024-09-12T22:09:48.939650+0000","last_fullsized":"2024-09-12T22:09:48.939650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938402+0000","last_change":"2024-09-12T22:09:48.938402+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938402+0000","last_undegraded":"2024-09-12T22:09:48.938402+0000","last_fullsized":"2024-09-12T22:09:48.938402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937747+0000","last_change":"2024-09-12T22:09:48.937747+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937747+0000","last_undegraded":"2024-09-12T22:09:48.937747+0000","last_fullsized":"2024-09-12T22:09:48.937747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937720+0000","last_change":"2024-09-12T22:09:48.937720+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937720+0000","last_undegraded":"2024-09-12T22:09:48.937720+0000","last_fullsized":"2024-09-12T22:09:48.937720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937598+0000","last_change":"2024-09-12T22:09:48.937598+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937598+0000","last_undegraded":"2024-09-12T22:09:48.937598+0000","last_fullsized":"2024-09-12T22:09:48.937598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938570+0000","last_change":"2024-09-12T22:09:48.938570+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938570+0000","last_undegraded":"2024-09-12T22:09:48.938570+0000","last_fullsized":"2024-09-12T22:09:48.938570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937650+0000","last_change":"2024-09-12T22:09:48.937650+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937650+0000","last_undegraded":"2024-09-12T22:09:48.937650+0000","last_fullsized":"2024-09-12T22:09:48.937650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938996+0000","last_change":"2024-09-12T22:09:48.938996+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938996+0000","last_undegraded":"2024-09-12T22:09:48.938996+0000","last_fullsized":"2024-09-12T22:09:48.938996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937515+0000","last_change":"2024-09-12T22:09:48.937515+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937515+0000","last_undegraded":"2024-09-12T22:09:48.937515+0000","last_fullsized":"2024-09-12T22:09:48.937515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937672+0000","last_change":"2024-09-12T22:09:48.937672+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937672+0000","last_undegraded":"2024-09-12T22:09:48.937672+0000","last_fullsized":"2024-09-12T22:09:48.937672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938493+0000","last_change":"2024-09-12T22:09:48.938493+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938493+0000","last_undegraded":"2024-09-12T22:09:48.938493+0000","last_fullsized":"2024-09-12T22:09:48.938493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939306+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:48.939306+0000","last_peered":"2024-09-12T22:09:48.939306+0000","last_clean":"2024-09-12T22:09:48.939306+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:48.939306+0000","last_undegraded":"2024-09-12T22:09:48.939306+0000","last_fullsized":"2024-09-12T22:09:48.939306+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939383+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:48.939383+0000","last_peered":"2024-09-12T22:09:48.939383+0000","last_clean":"2024-09-12T22:09:48.939383+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:48.939383+0000","last_undegraded":"2024-09-12T22:09:48.939383+0000","last_fullsized":"2024-09-12T22:09:48.939383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938916+0000","last_change":"2024-09-12T22:09:48.938916+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938916+0000","last_undegraded":"2024-09-12T22:09:48.938916+0000","last_fullsized":"2024-09-12T22:09:48.938916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939248+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:48.939248+0000","last_peered":"2024-09-12T22:09:48.939248+0000","last_clean":"2024-09-12T22:09:48.939248+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:48.939248+0000","last_undegraded":"2024-09-12T22:09:48.939248+0000","last_fullsized":"2024-09-12T22:09:48.939248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938898+0000","last_change":"2024-09-12T22:09:48.938898+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938898+0000","last_undegraded":"2024-09-12T22:09:48.938898+0000","last_fullsized":"2024-09-12T22:09:48.938898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937084+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:48.937084+0000","last_peered":"2024-09-12T22:09:48.937084+0000","last_clean":"2024-09-12T22:09:48.937084+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:48.937084+0000","last_undegraded":"2024-09-12T22:09:48.937084+0000","last_fullsized":"2024-09-12T22:09:48.937084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937511+0000","last_change":"2024-09-12T22:09:48.937511+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937511+0000","last_undegraded":"2024-09-12T22:09:48.937511+0000","last_fullsized":"2024-09-12T22:09:48.937511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939429+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:48.939429+0000","last_peered":"2024-09-12T22:09:48.939429+0000","last_clean":"2024-09-12T22:09:48.939429+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:48.939429+0000","last_undegraded":"2024-09-12T22:09:48.939429+0000","last_fullsized":"2024-09-12T22:09:48.939429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937537+0000","last_change":"2024-09-12T22:09:48.937537+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937537+0000","last_undegraded":"2024-09-12T22:09:48.937537+0000","last_fullsized":"2024-09-12T22:09:48.937537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937772+0000","last_change":"2024-09-12T22:09:48.937772+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937772+0000","last_undegraded":"2024-09-12T22:09:48.937772+0000","last_fullsized":"2024-09-12T22:09:48.937772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937046+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:48.937046+0000","last_peered":"2024-09-12T22:09:48.937046+0000","last_clean":"2024-09-12T22:09:48.937046+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:48.937046+0000","last_undegraded":"2024-09-12T22:09:48.937046+0000","last_fullsized":"2024-09-12T22:09:48.937046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938900+0000","last_change":"2024-09-12T22:09:48.938900+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938900+0000","last_undegraded":"2024-09-12T22:09:48.938900+0000","last_fullsized":"2024-09-12T22:09:48.938900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939024+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:48.939024+0000","last_peered":"2024-09-12T22:09:48.939024+0000","last_clean":"2024-09-12T22:09:48.939024+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:48.939024+0000","last_undegraded":"2024-09-12T22:09:48.939024+0000","last_fullsized":"2024-09-12T22:09:48.939024+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938942+0000","last_change":"2024-09-12T22:09:48.938942+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938942+0000","last_undegraded":"2024-09-12T22:09:48.938942+0000","last_fullsized":"2024-09-12T22:09:48.938942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937076+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:48.937076+0000","last_peered":"2024-09-12T22:09:48.937076+0000","last_clean":"2024-09-12T22:09:48.937076+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:48.937076+0000","last_undegraded":"2024-09-12T22:09:48.937076+0000","last_fullsized":"2024-09-12T22:09:48.937076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938974+0000","last_change":"2024-09-12T22:09:48.938974+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938974+0000","last_undegraded":"2024-09-12T22:09:48.938974+0000","last_fullsized":"2024-09-12T22:09:48.938974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939499+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:48.939499+0000","last_peered":"2024-09-12T22:09:48.939499+0000","last_clean":"2024-09-12T22:09:48.939499+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:48.939499+0000","last_undegraded":"2024-09-12T22:09:48.939499+0000","last_fullsized":"2024-09-12T22:09:48.939499+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938391+0000","last_change":"2024-09-12T22:09:48.938391+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938391+0000","last_undegraded":"2024-09-12T22:09:48.938391+0000","last_fullsized":"2024-09-12T22:09:48.938391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937586+0000","last_change":"2024-09-12T22:09:48.937586+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937586+0000","last_undegraded":"2024-09-12T22:09:48.937586+0000","last_fullsized":"2024-09-12T22:09:48.937586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937729+0000","last_change":"2024-09-12T22:09:48.937729+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937729+0000","last_undegraded":"2024-09-12T22:09:48.937729+0000","last_fullsized":"2024-09-12T22:09:48.937729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939758+0000","last_change":"2024-09-12T22:09:48.939758+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939758+0000","last_undegraded":"2024-09-12T22:09:48.939758+0000","last_fullsized":"2024-09-12T22:09:48.939758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939793+0000","last_change":"2024-09-12T22:09:48.939793+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939793+0000","last_undegraded":"2024-09-12T22:09:48.939793+0000","last_fullsized":"2024-09-12T22:09:48.939793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939828+0000","last_change":"2024-09-12T22:09:48.939828+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939828+0000","last_undegraded":"2024-09-12T22:09:48.939828+0000","last_fullsized":"2024-09-12T22:09:48.939828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937599+0000","last_change":"2024-09-12T22:09:48.937599+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937599+0000","last_undegraded":"2024-09-12T22:09:48.937599+0000","last_fullsized":"2024-09-12T22:09:48.937599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937507+0000","last_change":"2024-09-12T22:09:48.937507+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937507+0000","last_undegraded":"2024-09-12T22:09:48.937507+0000","last_fullsized":"2024-09-12T22:09:48.937507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938832+0000","last_change":"2024-09-12T22:09:48.938832+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938832+0000","last_undegraded":"2024-09-12T22:09:48.938832+0000","last_fullsized":"2024-09-12T22:09:48.938832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938384+0000","last_change":"2024-09-12T22:09:48.938384+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938384+0000","last_undegraded":"2024-09-12T22:09:48.938384+0000","last_fullsized":"2024-09-12T22:09:48.938384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939807+0000","last_change":"2024-09-12T22:09:48.939807+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939807+0000","last_undegraded":"2024-09-12T22:09:48.939807+0000","last_fullsized":"2024-09-12T22:09:48.939807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.940560+0000","last_change":"2024-09-12T22:09:48.940560+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.940560+0000","last_undegraded":"2024-09-12T22:09:48.940560+0000","last_fullsized":"2024-09-12T22:09:48.940560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":630963,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":635130,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":40614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:09:54.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:09:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:09:54.623 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T22:09:53.747132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81616,"kb_used_data":528,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033904,"statfs":{"total":289910292480,"available":289826717696,"internally_reserved":0,"allocated":540672,"data_stored":1306707,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.679801"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938252+0000","last_change":"2024-09-12T22:09:48.938252+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938252+0000","last_undegraded":"2024-09-12T22:09:48.938252+0000","last_fullsized":"2024-09-12T22:09:48.938252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939650+0000","last_change":"2024-09-12T22:09:48.939650+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939650+0000","last_undegraded":"2024-09-12T22:09:48.939650+0000","last_fullsized":"2024-09-12T22:09:48.939650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938402+0000","last_change":"2024-09-12T22:09:48.938402+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938402+0000","last_undegraded":"2024-09-12T22:09:48.938402+0000","last_fullsized":"2024-09-12T22:09:48.938402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937747+0000","last_change":"2024-09-12T22:09:48.937747+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937747+0000","last_undegraded":"2024-09-12T22:09:48.937747+0000","last_fullsized":"2024-09-12T22:09:48.937747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937720+0000","last_change":"2024-09-12T22:09:48.937720+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937720+0000","last_undegraded":"2024-09-12T22:09:48.937720+0000","last_fullsized":"2024-09-12T22:09:48.937720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937598+0000","last_change":"2024-09-12T22:09:48.937598+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937598+0000","last_undegraded":"2024-09-12T22:09:48.937598+0000","last_fullsized":"2024-09-12T22:09:48.937598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938570+0000","last_change":"2024-09-12T22:09:48.938570+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938570+0000","last_undegraded":"2024-09-12T22:09:48.938570+0000","last_fullsized":"2024-09-12T22:09:48.938570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937650+0000","last_change":"2024-09-12T22:09:48.937650+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937650+0000","last_undegraded":"2024-09-12T22:09:48.937650+0000","last_fullsized":"2024-09-12T22:09:48.937650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938996+0000","last_change":"2024-09-12T22:09:48.938996+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938996+0000","last_undegraded":"2024-09-12T22:09:48.938996+0000","last_fullsized":"2024-09-12T22:09:48.938996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937515+0000","last_change":"2024-09-12T22:09:48.937515+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937515+0000","last_undegraded":"2024-09-12T22:09:48.937515+0000","last_fullsized":"2024-09-12T22:09:48.937515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937672+0000","last_change":"2024-09-12T22:09:48.937672+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937672+0000","last_undegraded":"2024-09-12T22:09:48.937672+0000","last_fullsized":"2024-09-12T22:09:48.937672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938493+0000","last_change":"2024-09-12T22:09:48.938493+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938493+0000","last_undegraded":"2024-09-12T22:09:48.938493+0000","last_fullsized":"2024-09-12T22:09:48.938493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939306+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:48.939306+0000","last_peered":"2024-09-12T22:09:48.939306+0000","last_clean":"2024-09-12T22:09:48.939306+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:48.939306+0000","last_undegraded":"2024-09-12T22:09:48.939306+0000","last_fullsized":"2024-09-12T22:09:48.939306+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939383+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:48.939383+0000","last_peered":"2024-09-12T22:09:48.939383+0000","last_clean":"2024-09-12T22:09:48.939383+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:48.939383+0000","last_undegraded":"2024-09-12T22:09:48.939383+0000","last_fullsized":"2024-09-12T22:09:48.939383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938916+0000","last_change":"2024-09-12T22:09:48.938916+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938916+0000","last_undegraded":"2024-09-12T22:09:48.938916+0000","last_fullsized":"2024-09-12T22:09:48.938916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939248+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:48.939248+0000","last_peered":"2024-09-12T22:09:48.939248+0000","last_clean":"2024-09-12T22:09:48.939248+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:48.939248+0000","last_undegraded":"2024-09-12T22:09:48.939248+0000","last_fullsized":"2024-09-12T22:09:48.939248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938898+0000","last_change":"2024-09-12T22:09:48.938898+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938898+0000","last_undegraded":"2024-09-12T22:09:48.938898+0000","last_fullsized":"2024-09-12T22:09:48.938898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937084+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:48.937084+0000","last_peered":"2024-09-12T22:09:48.937084+0000","last_clean":"2024-09-12T22:09:48.937084+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:48.937084+0000","last_undegraded":"2024-09-12T22:09:48.937084+0000","last_fullsized":"2024-09-12T22:09:48.937084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937511+0000","last_change":"2024-09-12T22:09:48.937511+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937511+0000","last_undegraded":"2024-09-12T22:09:48.937511+0000","last_fullsized":"2024-09-12T22:09:48.937511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":23,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939429+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:48.939429+0000","last_peered":"2024-09-12T22:09:48.939429+0000","last_clean":"2024-09-12T22:09:48.939429+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:48.939429+0000","last_undegraded":"2024-09-12T22:09:48.939429+0000","last_fullsized":"2024-09-12T22:09:48.939429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937537+0000","last_change":"2024-09-12T22:09:48.937537+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937537+0000","last_undegraded":"2024-09-12T22:09:48.937537+0000","last_fullsized":"2024-09-12T22:09:48.937537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937772+0000","last_change":"2024-09-12T22:09:48.937772+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937772+0000","last_undegraded":"2024-09-12T22:09:48.937772+0000","last_fullsized":"2024-09-12T22:09:48.937772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937046+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:48.937046+0000","last_peered":"2024-09-12T22:09:48.937046+0000","last_clean":"2024-09-12T22:09:48.937046+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:48.937046+0000","last_undegraded":"2024-09-12T22:09:48.937046+0000","last_fullsized":"2024-09-12T22:09:48.937046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938900+0000","last_change":"2024-09-12T22:09:48.938900+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938900+0000","last_undegraded":"2024-09-12T22:09:48.938900+0000","last_fullsized":"2024-09-12T22:09:48.938900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939024+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:48.939024+0000","last_peered":"2024-09-12T22:09:48.939024+0000","last_clean":"2024-09-12T22:09:48.939024+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:48.939024+0000","last_undegraded":"2024-09-12T22:09:48.939024+0000","last_fullsized":"2024-09-12T22:09:48.939024+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938942+0000","last_change":"2024-09-12T22:09:48.938942+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938942+0000","last_undegraded":"2024-09-12T22:09:48.938942+0000","last_fullsized":"2024-09-12T22:09:48.938942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.937076+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:48.937076+0000","last_peered":"2024-09-12T22:09:48.937076+0000","last_clean":"2024-09-12T22:09:48.937076+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:48.937076+0000","last_undegraded":"2024-09-12T22:09:48.937076+0000","last_fullsized":"2024-09-12T22:09:48.937076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938974+0000","last_change":"2024-09-12T22:09:48.938974+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938974+0000","last_undegraded":"2024-09-12T22:09:48.938974+0000","last_fullsized":"2024-09-12T22:09:48.938974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:09:48.939499+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:48.939499+0000","last_peered":"2024-09-12T22:09:48.939499+0000","last_clean":"2024-09-12T22:09:48.939499+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:48.939499+0000","last_undegraded":"2024-09-12T22:09:48.939499+0000","last_fullsized":"2024-09-12T22:09:48.939499+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938391+0000","last_change":"2024-09-12T22:09:48.938391+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938391+0000","last_undegraded":"2024-09-12T22:09:48.938391+0000","last_fullsized":"2024-09-12T22:09:48.938391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937586+0000","last_change":"2024-09-12T22:09:48.937586+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937586+0000","last_undegraded":"2024-09-12T22:09:48.937586+0000","last_fullsized":"2024-09-12T22:09:48.937586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937729+0000","last_change":"2024-09-12T22:09:48.937729+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937729+0000","last_undegraded":"2024-09-12T22:09:48.937729+0000","last_fullsized":"2024-09-12T22:09:48.937729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939758+0000","last_change":"2024-09-12T22:09:48.939758+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939758+0000","last_undegraded":"2024-09-12T22:09:48.939758+0000","last_fullsized":"2024-09-12T22:09:48.939758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939793+0000","last_change":"2024-09-12T22:09:48.939793+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939793+0000","last_undegraded":"2024-09-12T22:09:48.939793+0000","last_fullsized":"2024-09-12T22:09:48.939793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939828+0000","last_change":"2024-09-12T22:09:48.939828+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939828+0000","last_undegraded":"2024-09-12T22:09:48.939828+0000","last_fullsized":"2024-09-12T22:09:48.939828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937599+0000","last_change":"2024-09-12T22:09:48.937599+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937599+0000","last_undegraded":"2024-09-12T22:09:48.937599+0000","last_fullsized":"2024-09-12T22:09:48.937599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.937507+0000","last_change":"2024-09-12T22:09:48.937507+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.937507+0000","last_undegraded":"2024-09-12T22:09:48.937507+0000","last_fullsized":"2024-09-12T22:09:48.937507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938832+0000","last_change":"2024-09-12T22:09:48.938832+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938832+0000","last_undegraded":"2024-09-12T22:09:48.938832+0000","last_fullsized":"2024-09-12T22:09:48.938832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.938384+0000","last_change":"2024-09-12T22:09:48.938384+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.938384+0000","last_undegraded":"2024-09-12T22:09:48.938384+0000","last_fullsized":"2024-09-12T22:09:48.938384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.939807+0000","last_change":"2024-09-12T22:09:48.939807+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.939807+0000","last_undegraded":"2024-09-12T22:09:48.939807+0000","last_fullsized":"2024-09-12T22:09:48.939807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:09:49.932788+0000","last_change":"2024-09-12T22:09:49.932788+0000","last_active":"2024-09-12T22:09:49.932788+0000","last_peered":"2024-09-12T22:09:49.932788+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:49.932788+0000","last_undegraded":"2024-09-12T22:09:49.932788+0000","last_fullsized":"2024-09-12T22:09:49.932788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-09-12T22:09:48.940560+0000","last_change":"2024-09-12T22:09:48.940560+0000","last_active":"2024-09-12T22:09:48.929113+0000","last_peered":"2024-09-12T22:09:48.929113+0000","last_clean":"2024-09-12T22:09:48.929113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:09:48.940560+0000","last_undegraded":"2024-09-12T22:09:48.940560+0000","last_fullsized":"2024-09-12T22:09:48.940560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":630963,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":635130,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":40614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:09:54.627 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-09-12T22:09:54.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.627 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-09-12T22:09:54.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.628 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-09-12T22:09:54.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.628 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-09-12T22:09:54.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.628 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:PG 4.37 is not active+clean 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.629 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-09-12T22:09:54.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.630 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-09-12T22:09:54.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.630 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-09-12T22:09:54.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2f is not active+clean 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.631 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2d is not active+clean 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-09-12T22:09:54.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:PG 4.29 is not active+clean 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:PG 4.26 is not active+clean 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-09-12T22:09:54.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:PG 4.23 is not active+clean 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:PG 4.21 is not active+clean 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.634 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-09-12T22:09:54.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.635 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-12T22:09:54.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.635 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-12T22:09:54.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938252+0000', 'last_change': '2024-09-12T22:09:48.938252+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938252+0000', 'last_undegraded': '2024-09-12T22:09:48.938252+0000', 'last_fullsized': '2024-09-12T22:09:48.938252+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.635 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.939650+0000', 'last_change': '2024-09-12T22:09:48.939650+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.939650+0000', 'last_undegraded': '2024-09-12T22:09:48.939650+0000', 'last_fullsized': '2024-09-12T22:09:48.939650+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938402+0000', 'last_change': '2024-09-12T22:09:48.938402+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938402+0000', 'last_undegraded': '2024-09-12T22:09:48.938402+0000', 'last_fullsized': '2024-09-12T22:09:48.938402+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.636 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937747+0000', 'last_change': '2024-09-12T22:09:48.937747+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937747+0000', 'last_undegraded': '2024-09-12T22:09:48.937747+0000', 'last_fullsized': '2024-09-12T22:09:48.937747+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937720+0000', 'last_change': '2024-09-12T22:09:48.937720+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937720+0000', 'last_undegraded': '2024-09-12T22:09:48.937720+0000', 'last_fullsized': '2024-09-12T22:09:48.937720+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937598+0000', 'last_change': '2024-09-12T22:09:48.937598+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937598+0000', 'last_undegraded': '2024-09-12T22:09:48.937598+0000', 'last_fullsized': '2024-09-12T22:09:48.937598+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-12T22:09:54.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938570+0000', 'last_change': '2024-09-12T22:09:48.938570+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938570+0000', 'last_undegraded': '2024-09-12T22:09:48.938570+0000', 'last_fullsized': '2024-09-12T22:09:48.938570+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937650+0000', 'last_change': '2024-09-12T22:09:48.937650+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937650+0000', 'last_undegraded': '2024-09-12T22:09:48.937650+0000', 'last_fullsized': '2024-09-12T22:09:48.937650+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.638 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-12T22:09:54.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938996+0000', 'last_change': '2024-09-12T22:09:48.938996+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938996+0000', 'last_undegraded': '2024-09-12T22:09:48.938996+0000', 'last_fullsized': '2024-09-12T22:09:48.938996+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.639 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-12T22:09:54.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.639 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-12T22:09:54.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937515+0000', 'last_change': '2024-09-12T22:09:48.937515+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937515+0000', 'last_undegraded': '2024-09-12T22:09:48.937515+0000', 'last_fullsized': '2024-09-12T22:09:48.937515+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.640 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-12T22:09:54.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.640 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T22:09:54.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937672+0000', 'last_change': '2024-09-12T22:09:48.937672+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937672+0000', 'last_undegraded': '2024-09-12T22:09:48.937672+0000', 'last_fullsized': '2024-09-12T22:09:48.937672+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.640 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-12T22:09:54.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.640 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938493+0000', 'last_change': '2024-09-12T22:09:48.938493+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938493+0000', 'last_undegraded': '2024-09-12T22:09:48.938493+0000', 'last_fullsized': '2024-09-12T22:09:48.938493+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938916+0000', 'last_change': '2024-09-12T22:09:48.938916+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938916+0000', 'last_undegraded': '2024-09-12T22:09:48.938916+0000', 'last_fullsized': '2024-09-12T22:09:48.938916+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938898+0000', 'last_change': '2024-09-12T22:09:48.938898+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938898+0000', 'last_undegraded': '2024-09-12T22:09:48.938898+0000', 'last_fullsized': '2024-09-12T22:09:48.938898+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-12T22:09:54.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937511+0000', 'last_change': '2024-09-12T22:09:48.937511+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937511+0000', 'last_undegraded': '2024-09-12T22:09:48.937511+0000', 'last_fullsized': '2024-09-12T22:09:48.937511+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937537+0000', 'last_change': '2024-09-12T22:09:48.937537+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937537+0000', 'last_undegraded': '2024-09-12T22:09:48.937537+0000', 'last_fullsized': '2024-09-12T22:09:48.937537+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-12T22:09:54.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937772+0000', 'last_change': '2024-09-12T22:09:48.937772+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937772+0000', 'last_undegraded': '2024-09-12T22:09:48.937772+0000', 'last_fullsized': '2024-09-12T22:09:48.937772+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938900+0000', 'last_change': '2024-09-12T22:09:48.938900+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938900+0000', 'last_undegraded': '2024-09-12T22:09:48.938900+0000', 'last_fullsized': '2024-09-12T22:09:48.938900+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.643 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938942+0000', 'last_change': '2024-09-12T22:09:48.938942+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938942+0000', 'last_undegraded': '2024-09-12T22:09:48.938942+0000', 'last_fullsized': '2024-09-12T22:09:48.938942+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938974+0000', 'last_change': '2024-09-12T22:09:48.938974+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938974+0000', 'last_undegraded': '2024-09-12T22:09:48.938974+0000', 'last_fullsized': '2024-09-12T22:09:48.938974+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-12T22:09:54.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938391+0000', 'last_change': '2024-09-12T22:09:48.938391+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938391+0000', 'last_undegraded': '2024-09-12T22:09:48.938391+0000', 'last_fullsized': '2024-09-12T22:09:48.938391+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937586+0000', 'last_change': '2024-09-12T22:09:48.937586+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937586+0000', 'last_undegraded': '2024-09-12T22:09:48.937586+0000', 'last_fullsized': '2024-09-12T22:09:48.937586+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937729+0000', 'last_change': '2024-09-12T22:09:48.937729+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937729+0000', 'last_undegraded': '2024-09-12T22:09:48.937729+0000', 'last_fullsized': '2024-09-12T22:09:48.937729+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-12T22:09:54.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.939758+0000', 'last_change': '2024-09-12T22:09:48.939758+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.939758+0000', 'last_undegraded': '2024-09-12T22:09:48.939758+0000', 'last_fullsized': '2024-09-12T22:09:48.939758+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.939793+0000', 'last_change': '2024-09-12T22:09:48.939793+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.939793+0000', 'last_undegraded': '2024-09-12T22:09:48.939793+0000', 'last_fullsized': '2024-09-12T22:09:48.939793+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-12T22:09:54.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.939828+0000', 'last_change': '2024-09-12T22:09:48.939828+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.939828+0000', 'last_undegraded': '2024-09-12T22:09:48.939828+0000', 'last_fullsized': '2024-09-12T22:09:48.939828+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937599+0000', 'last_change': '2024-09-12T22:09:48.937599+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937599+0000', 'last_undegraded': '2024-09-12T22:09:48.937599+0000', 'last_fullsized': '2024-09-12T22:09:48.937599+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-12T22:09:54.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.937507+0000', 'last_change': '2024-09-12T22:09:48.937507+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.937507+0000', 'last_undegraded': '2024-09-12T22:09:48.937507+0000', 'last_fullsized': '2024-09-12T22:09:48.937507+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.648 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-12T22:09:54.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.648 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-12T22:09:54.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938832+0000', 'last_change': '2024-09-12T22:09:48.938832+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938832+0000', 'last_undegraded': '2024-09-12T22:09:48.938832+0000', 'last_fullsized': '2024-09-12T22:09:48.938832+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T22:09:54.648 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-12T22:09:54.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T22:09:54.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.938384+0000', 'last_change': '2024-09-12T22:09:48.938384+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.938384+0000', 'last_undegraded': '2024-09-12T22:09:48.938384+0000', 'last_fullsized': '2024-09-12T22:09:48.938384+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:09:54.649 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-12T22:09:54.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.649 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-12T22:09:54.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.939807+0000', 'last_change': '2024-09-12T22:09:48.939807+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.939807+0000', 'last_undegraded': '2024-09-12T22:09:48.939807+0000', 'last_fullsized': '2024-09-12T22:09:48.939807+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.649 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-12T22:09:54.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:09:49.932788+0000', 'last_change': '2024-09-12T22:09:49.932788+0000', 'last_active': '2024-09-12T22:09:49.932788+0000', 'last_peered': '2024-09-12T22:09:49.932788+0000', 'last_clean': '2024-09-12T22:09:49.932788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:49.932788+0000', 'last_undegraded': '2024-09-12T22:09:49.932788+0000', 'last_fullsized': '2024-09-12T22:09:49.932788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:49.932788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:09:54.650 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-12T22:09:54.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:09:48.940560+0000', 'last_change': '2024-09-12T22:09:48.940560+0000', 'last_active': '2024-09-12T22:09:48.929113+0000', 'last_peered': '2024-09-12T22:09:48.929113+0000', 'last_clean': '2024-09-12T22:09:48.929113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:09:48.940560+0000', 'last_undegraded': '2024-09-12T22:09:48.940560+0000', 'last_fullsized': '2024-09-12T22:09:48.940560+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'last_clean_scrub_stamp': '2024-09-12T22:09:48.929113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:09:54.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T22:09:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:55.018 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":3,"num_up_osds":3,"osd_up_since":1726178978,"num_in_osds":3,"osd_in_since":1726178970,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":4,"data_bytes":590387,"bytes_used":83574784,"bytes_avail":289826717696,"bytes_total":289910292480,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208,"write_bytes_sec":495,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4204}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T22:09:28.784186+0000","services":{}},"progress_events":{}} 2024-09-12T22:09:55.030 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T22:09:55.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:09:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:55.327 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:09:55.336 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T22:09:55.068332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90096,"kb_used_data":680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025424,"statfs":{"total":289910292480,"available":289818034176,"internally_reserved":0,"allocated":696320,"data_stored":1362612,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.127716"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750001+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:09:53.750001+0000","last_peered":"2024-09-12T22:09:53.750001+0000","last_clean":"2024-09-12T22:09:53.750001+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:09:53.750001+0000","last_undegraded":"2024-09-12T22:09:53.750001+0000","last_fullsized":"2024-09-12T22:09:53.750001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749767+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:09:53.749767+0000","last_peered":"2024-09-12T22:09:53.749767+0000","last_clean":"2024-09-12T22:09:53.749767+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:09:53.749767+0000","last_undegraded":"2024-09-12T22:09:53.749767+0000","last_fullsized":"2024-09-12T22:09:53.749767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750605+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:09:53.750605+0000","last_peered":"2024-09-12T22:09:53.750605+0000","last_clean":"2024-09-12T22:09:53.750605+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:09:53.750605+0000","last_undegraded":"2024-09-12T22:09:53.750605+0000","last_fullsized":"2024-09-12T22:09:53.750605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749637+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:09:53.749637+0000","last_peered":"2024-09-12T22:09:53.749637+0000","last_clean":"2024-09-12T22:09:53.749637+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:09:53.749637+0000","last_undegraded":"2024-09-12T22:09:53.749637+0000","last_fullsized":"2024-09-12T22:09:53.749637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749717+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:09:53.749717+0000","last_peered":"2024-09-12T22:09:53.749717+0000","last_clean":"2024-09-12T22:09:53.749717+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:09:53.749717+0000","last_undegraded":"2024-09-12T22:09:53.749717+0000","last_fullsized":"2024-09-12T22:09:53.749717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749658+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:09:53.749658+0000","last_peered":"2024-09-12T22:09:53.749658+0000","last_clean":"2024-09-12T22:09:53.749658+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:09:53.749658+0000","last_undegraded":"2024-09-12T22:09:53.749658+0000","last_fullsized":"2024-09-12T22:09:53.749658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749412+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:09:53.749412+0000","last_peered":"2024-09-12T22:09:53.749412+0000","last_clean":"2024-09-12T22:09:53.749412+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:09:53.749412+0000","last_undegraded":"2024-09-12T22:09:53.749412+0000","last_fullsized":"2024-09-12T22:09:53.749412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749670+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:09:53.749670+0000","last_peered":"2024-09-12T22:09:53.749670+0000","last_clean":"2024-09-12T22:09:53.749670+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:09:53.749670+0000","last_undegraded":"2024-09-12T22:09:53.749670+0000","last_fullsized":"2024-09-12T22:09:53.749670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749859+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:09:53.749859+0000","last_peered":"2024-09-12T22:09:53.749859+0000","last_clean":"2024-09-12T22:09:53.749859+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:09:53.749859+0000","last_undegraded":"2024-09-12T22:09:53.749859+0000","last_fullsized":"2024-09-12T22:09:53.749859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750477+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:09:53.750477+0000","last_peered":"2024-09-12T22:09:53.750477+0000","last_clean":"2024-09-12T22:09:53.750477+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:09:53.750477+0000","last_undegraded":"2024-09-12T22:09:53.750477+0000","last_fullsized":"2024-09-12T22:09:53.750477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749676+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:09:53.749676+0000","last_peered":"2024-09-12T22:09:53.749676+0000","last_clean":"2024-09-12T22:09:53.749676+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:09:53.749676+0000","last_undegraded":"2024-09-12T22:09:53.749676+0000","last_fullsized":"2024-09-12T22:09:53.749676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749472+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:09:53.749472+0000","last_peered":"2024-09-12T22:09:53.749472+0000","last_clean":"2024-09-12T22:09:53.749472+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:09:53.749472+0000","last_undegraded":"2024-09-12T22:09:53.749472+0000","last_fullsized":"2024-09-12T22:09:53.749472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749748+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:09:53.749748+0000","last_peered":"2024-09-12T22:09:53.749748+0000","last_clean":"2024-09-12T22:09:53.749748+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:09:53.749748+0000","last_undegraded":"2024-09-12T22:09:53.749748+0000","last_fullsized":"2024-09-12T22:09:53.749748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749709+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:09:53.749709+0000","last_peered":"2024-09-12T22:09:53.749709+0000","last_clean":"2024-09-12T22:09:53.749709+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:09:53.749709+0000","last_undegraded":"2024-09-12T22:09:53.749709+0000","last_fullsized":"2024-09-12T22:09:53.749709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749470+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:09:53.749470+0000","last_peered":"2024-09-12T22:09:53.749470+0000","last_clean":"2024-09-12T22:09:53.749470+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:09:53.749470+0000","last_undegraded":"2024-09-12T22:09:53.749470+0000","last_fullsized":"2024-09-12T22:09:53.749470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750125+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:09:53.750125+0000","last_peered":"2024-09-12T22:09:53.750125+0000","last_clean":"2024-09-12T22:09:53.750125+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:09:53.750125+0000","last_undegraded":"2024-09-12T22:09:53.750125+0000","last_fullsized":"2024-09-12T22:09:53.750125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750087+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:09:53.750087+0000","last_peered":"2024-09-12T22:09:53.750087+0000","last_clean":"2024-09-12T22:09:53.750087+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:09:53.750087+0000","last_undegraded":"2024-09-12T22:09:53.750087+0000","last_fullsized":"2024-09-12T22:09:53.750087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749423+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:09:53.749423+0000","last_peered":"2024-09-12T22:09:53.749423+0000","last_clean":"2024-09-12T22:09:53.749423+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:09:53.749423+0000","last_undegraded":"2024-09-12T22:09:53.749423+0000","last_fullsized":"2024-09-12T22:09:53.749423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750165+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:09:53.750165+0000","last_peered":"2024-09-12T22:09:53.750165+0000","last_clean":"2024-09-12T22:09:53.750165+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:09:53.750165+0000","last_undegraded":"2024-09-12T22:09:53.750165+0000","last_fullsized":"2024-09-12T22:09:53.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750012+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:09:53.750012+0000","last_peered":"2024-09-12T22:09:53.750012+0000","last_clean":"2024-09-12T22:09:53.750012+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:09:53.750012+0000","last_undegraded":"2024-09-12T22:09:53.750012+0000","last_fullsized":"2024-09-12T22:09:53.750012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749271+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:09:53.749271+0000","last_peered":"2024-09-12T22:09:53.749271+0000","last_clean":"2024-09-12T22:09:53.749271+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:09:53.749271+0000","last_undegraded":"2024-09-12T22:09:53.749271+0000","last_fullsized":"2024-09-12T22:09:53.749271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748773+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:09:53.748773+0000","last_peered":"2024-09-12T22:09:53.748773+0000","last_clean":"2024-09-12T22:09:53.748773+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:09:53.748773+0000","last_undegraded":"2024-09-12T22:09:53.748773+0000","last_fullsized":"2024-09-12T22:09:53.748773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748970+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:09:53.748970+0000","last_peered":"2024-09-12T22:09:53.748970+0000","last_clean":"2024-09-12T22:09:53.748970+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:09:53.748970+0000","last_undegraded":"2024-09-12T22:09:53.748970+0000","last_fullsized":"2024-09-12T22:09:53.748970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750109+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:09:53.750109+0000","last_peered":"2024-09-12T22:09:53.750109+0000","last_clean":"2024-09-12T22:09:53.750109+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:09:53.750109+0000","last_undegraded":"2024-09-12T22:09:53.750109+0000","last_fullsized":"2024-09-12T22:09:53.750109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749671+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:09:53.749671+0000","last_peered":"2024-09-12T22:09:53.749671+0000","last_clean":"2024-09-12T22:09:53.749671+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:09:53.749671+0000","last_undegraded":"2024-09-12T22:09:53.749671+0000","last_fullsized":"2024-09-12T22:09:53.749671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750625+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:09:53.750625+0000","last_peered":"2024-09-12T22:09:53.750625+0000","last_clean":"2024-09-12T22:09:53.750625+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:09:53.750625+0000","last_undegraded":"2024-09-12T22:09:53.750625+0000","last_fullsized":"2024-09-12T22:09:53.750625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749979+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:09:53.749979+0000","last_peered":"2024-09-12T22:09:53.749979+0000","last_clean":"2024-09-12T22:09:53.749979+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:09:53.749979+0000","last_undegraded":"2024-09-12T22:09:53.749979+0000","last_fullsized":"2024-09-12T22:09:53.749979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749252+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:09:53.749252+0000","last_peered":"2024-09-12T22:09:53.749252+0000","last_clean":"2024-09-12T22:09:53.749252+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:09:53.749252+0000","last_undegraded":"2024-09-12T22:09:53.749252+0000","last_fullsized":"2024-09-12T22:09:53.749252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749388+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:09:53.749388+0000","last_peered":"2024-09-12T22:09:53.749388+0000","last_clean":"2024-09-12T22:09:53.749388+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:09:53.749388+0000","last_undegraded":"2024-09-12T22:09:53.749388+0000","last_fullsized":"2024-09-12T22:09:53.749388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748833+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:09:53.748833+0000","last_peered":"2024-09-12T22:09:53.748833+0000","last_clean":"2024-09-12T22:09:53.748833+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:09:53.748833+0000","last_undegraded":"2024-09-12T22:09:53.748833+0000","last_fullsized":"2024-09-12T22:09:53.748833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749543+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:09:53.749543+0000","last_peered":"2024-09-12T22:09:53.749543+0000","last_clean":"2024-09-12T22:09:53.749543+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:09:53.749543+0000","last_undegraded":"2024-09-12T22:09:53.749543+0000","last_fullsized":"2024-09-12T22:09:53.749543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749826+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:09:53.749826+0000","last_peered":"2024-09-12T22:09:53.749826+0000","last_clean":"2024-09-12T22:09:53.749826+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:09:53.749826+0000","last_undegraded":"2024-09-12T22:09:53.749826+0000","last_fullsized":"2024-09-12T22:09:53.749826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750152+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:09:53.750152+0000","last_peered":"2024-09-12T22:09:53.750152+0000","last_clean":"2024-09-12T22:09:53.750152+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:09:53.750152+0000","last_undegraded":"2024-09-12T22:09:53.750152+0000","last_fullsized":"2024-09-12T22:09:53.750152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749939+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:09:53.749939+0000","last_peered":"2024-09-12T22:09:53.749939+0000","last_clean":"2024-09-12T22:09:53.749939+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:09:53.749939+0000","last_undegraded":"2024-09-12T22:09:53.749939+0000","last_fullsized":"2024-09-12T22:09:53.749939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749125+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:09:53.749125+0000","last_peered":"2024-09-12T22:09:53.749125+0000","last_clean":"2024-09-12T22:09:53.749125+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:09:53.749125+0000","last_undegraded":"2024-09-12T22:09:53.749125+0000","last_fullsized":"2024-09-12T22:09:53.749125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749973+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:09:53.749973+0000","last_peered":"2024-09-12T22:09:53.749973+0000","last_clean":"2024-09-12T22:09:53.749973+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:09:53.749973+0000","last_undegraded":"2024-09-12T22:09:53.749973+0000","last_fullsized":"2024-09-12T22:09:53.749973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749274+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:09:53.749274+0000","last_peered":"2024-09-12T22:09:53.749274+0000","last_clean":"2024-09-12T22:09:53.749274+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:09:53.749274+0000","last_undegraded":"2024-09-12T22:09:53.749274+0000","last_fullsized":"2024-09-12T22:09:53.749274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749707+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:09:53.749707+0000","last_peered":"2024-09-12T22:09:53.749707+0000","last_clean":"2024-09-12T22:09:53.749707+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:09:53.749707+0000","last_undegraded":"2024-09-12T22:09:53.749707+0000","last_fullsized":"2024-09-12T22:09:53.749707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749535+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:09:53.749535+0000","last_peered":"2024-09-12T22:09:53.749535+0000","last_clean":"2024-09-12T22:09:53.749535+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:09:53.749535+0000","last_undegraded":"2024-09-12T22:09:53.749535+0000","last_fullsized":"2024-09-12T22:09:53.749535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750865+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:09:53.750865+0000","last_peered":"2024-09-12T22:09:53.750865+0000","last_clean":"2024-09-12T22:09:53.750865+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:09:53.750865+0000","last_undegraded":"2024-09-12T22:09:53.750865+0000","last_fullsized":"2024-09-12T22:09:53.750865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749054+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:09:53.749054+0000","last_peered":"2024-09-12T22:09:53.749054+0000","last_clean":"2024-09-12T22:09:53.749054+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:09:53.749054+0000","last_undegraded":"2024-09-12T22:09:53.749054+0000","last_fullsized":"2024-09-12T22:09:53.749054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750059+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:09:53.750059+0000","last_peered":"2024-09-12T22:09:53.750059+0000","last_clean":"2024-09-12T22:09:53.750059+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:09:53.750059+0000","last_undegraded":"2024-09-12T22:09:53.750059+0000","last_fullsized":"2024-09-12T22:09:53.750059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749185+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:09:53.749185+0000","last_peered":"2024-09-12T22:09:53.749185+0000","last_clean":"2024-09-12T22:09:53.749185+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:09:53.749185+0000","last_undegraded":"2024-09-12T22:09:53.749185+0000","last_fullsized":"2024-09-12T22:09:53.749185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750809+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:09:53.750809+0000","last_peered":"2024-09-12T22:09:53.750809+0000","last_clean":"2024-09-12T22:09:53.750809+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:09:53.750809+0000","last_undegraded":"2024-09-12T22:09:53.750809+0000","last_fullsized":"2024-09-12T22:09:53.750809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749978+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:09:53.749978+0000","last_peered":"2024-09-12T22:09:53.749978+0000","last_clean":"2024-09-12T22:09:53.749978+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:09:53.749978+0000","last_undegraded":"2024-09-12T22:09:53.749978+0000","last_fullsized":"2024-09-12T22:09:53.749978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750423+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:09:53.750423+0000","last_peered":"2024-09-12T22:09:53.750423+0000","last_clean":"2024-09-12T22:09:53.750423+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:09:53.750423+0000","last_undegraded":"2024-09-12T22:09:53.750423+0000","last_fullsized":"2024-09-12T22:09:53.750423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749081+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:09:53.749081+0000","last_peered":"2024-09-12T22:09:53.749081+0000","last_clean":"2024-09-12T22:09:53.749081+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:09:53.749081+0000","last_undegraded":"2024-09-12T22:09:53.749081+0000","last_fullsized":"2024-09-12T22:09:53.749081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749634+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:09:53.749634+0000","last_peered":"2024-09-12T22:09:53.749634+0000","last_clean":"2024-09-12T22:09:53.749634+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:09:53.749634+0000","last_undegraded":"2024-09-12T22:09:53.749634+0000","last_fullsized":"2024-09-12T22:09:53.749634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750221+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:09:53.750221+0000","last_peered":"2024-09-12T22:09:53.750221+0000","last_clean":"2024-09-12T22:09:53.750221+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:09:53.750221+0000","last_undegraded":"2024-09-12T22:09:53.750221+0000","last_fullsized":"2024-09-12T22:09:53.750221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750007+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:09:53.750007+0000","last_peered":"2024-09-12T22:09:53.750007+0000","last_clean":"2024-09-12T22:09:53.750007+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:09:53.750007+0000","last_undegraded":"2024-09-12T22:09:53.750007+0000","last_fullsized":"2024-09-12T22:09:53.750007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750743+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:09:53.750743+0000","last_peered":"2024-09-12T22:09:53.750743+0000","last_clean":"2024-09-12T22:09:53.750743+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:09:53.750743+0000","last_undegraded":"2024-09-12T22:09:53.750743+0000","last_fullsized":"2024-09-12T22:09:53.750743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749327+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:09:53.749327+0000","last_peered":"2024-09-12T22:09:53.749327+0000","last_clean":"2024-09-12T22:09:53.749327+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:09:53.749327+0000","last_undegraded":"2024-09-12T22:09:53.749327+0000","last_fullsized":"2024-09-12T22:09:53.749327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750671+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:09:53.750671+0000","last_peered":"2024-09-12T22:09:53.750671+0000","last_clean":"2024-09-12T22:09:53.750671+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:09:53.750671+0000","last_undegraded":"2024-09-12T22:09:53.750671+0000","last_fullsized":"2024-09-12T22:09:53.750671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749007+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:09:53.749007+0000","last_peered":"2024-09-12T22:09:53.749007+0000","last_clean":"2024-09-12T22:09:53.749007+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:09:53.749007+0000","last_undegraded":"2024-09-12T22:09:53.749007+0000","last_fullsized":"2024-09-12T22:09:53.749007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749791+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:09:53.749791+0000","last_peered":"2024-09-12T22:09:53.749791+0000","last_clean":"2024-09-12T22:09:53.749791+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:09:53.749791+0000","last_undegraded":"2024-09-12T22:09:53.749791+0000","last_fullsized":"2024-09-12T22:09:53.749791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749768+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:53.749768+0000","last_peered":"2024-09-12T22:09:53.749768+0000","last_clean":"2024-09-12T22:09:53.749768+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:53.749768+0000","last_undegraded":"2024-09-12T22:09:53.749768+0000","last_fullsized":"2024-09-12T22:09:53.749768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750374+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:53.750374+0000","last_peered":"2024-09-12T22:09:53.750374+0000","last_clean":"2024-09-12T22:09:53.750374+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:53.750374+0000","last_undegraded":"2024-09-12T22:09:53.750374+0000","last_fullsized":"2024-09-12T22:09:53.750374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749291+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:09:53.749291+0000","last_peered":"2024-09-12T22:09:53.749291+0000","last_clean":"2024-09-12T22:09:53.749291+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:09:53.749291+0000","last_undegraded":"2024-09-12T22:09:53.749291+0000","last_fullsized":"2024-09-12T22:09:53.749291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750817+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:09:53.750817+0000","last_peered":"2024-09-12T22:09:53.750817+0000","last_clean":"2024-09-12T22:09:53.750817+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:09:53.750817+0000","last_undegraded":"2024-09-12T22:09:53.750817+0000","last_fullsized":"2024-09-12T22:09:53.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749794+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:53.749794+0000","last_peered":"2024-09-12T22:09:53.749794+0000","last_clean":"2024-09-12T22:09:53.749794+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:53.749794+0000","last_undegraded":"2024-09-12T22:09:53.749794+0000","last_fullsized":"2024-09-12T22:09:53.749794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749238+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:09:53.749238+0000","last_peered":"2024-09-12T22:09:53.749238+0000","last_clean":"2024-09-12T22:09:53.749238+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:09:53.749238+0000","last_undegraded":"2024-09-12T22:09:53.749238+0000","last_fullsized":"2024-09-12T22:09:53.749238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750000+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:09:53.750000+0000","last_peered":"2024-09-12T22:09:53.750000+0000","last_clean":"2024-09-12T22:09:53.750000+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:09:53.750000+0000","last_undegraded":"2024-09-12T22:09:53.750000+0000","last_fullsized":"2024-09-12T22:09:53.750000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749507+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:53.749507+0000","last_peered":"2024-09-12T22:09:53.749507+0000","last_clean":"2024-09-12T22:09:53.749507+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:53.749507+0000","last_undegraded":"2024-09-12T22:09:53.749507+0000","last_fullsized":"2024-09-12T22:09:53.749507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749111+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:09:53.749111+0000","last_peered":"2024-09-12T22:09:53.749111+0000","last_clean":"2024-09-12T22:09:53.749111+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:09:53.749111+0000","last_undegraded":"2024-09-12T22:09:53.749111+0000","last_fullsized":"2024-09-12T22:09:53.749111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749820+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:09:53.749820+0000","last_peered":"2024-09-12T22:09:53.749820+0000","last_clean":"2024-09-12T22:09:53.749820+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:09:53.749820+0000","last_undegraded":"2024-09-12T22:09:53.749820+0000","last_fullsized":"2024-09-12T22:09:53.749820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750106+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:53.750106+0000","last_peered":"2024-09-12T22:09:53.750106+0000","last_clean":"2024-09-12T22:09:53.750106+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:53.750106+0000","last_undegraded":"2024-09-12T22:09:53.750106+0000","last_fullsized":"2024-09-12T22:09:53.750106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750197+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:09:53.750197+0000","last_peered":"2024-09-12T22:09:53.750197+0000","last_clean":"2024-09-12T22:09:53.750197+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:09:53.750197+0000","last_undegraded":"2024-09-12T22:09:53.750197+0000","last_fullsized":"2024-09-12T22:09:53.750197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749361+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:09:53.749361+0000","last_peered":"2024-09-12T22:09:53.749361+0000","last_clean":"2024-09-12T22:09:53.749361+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:09:53.749361+0000","last_undegraded":"2024-09-12T22:09:53.749361+0000","last_fullsized":"2024-09-12T22:09:53.749361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750864+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:09:53.750864+0000","last_peered":"2024-09-12T22:09:53.750864+0000","last_clean":"2024-09-12T22:09:53.750864+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:09:53.750864+0000","last_undegraded":"2024-09-12T22:09:53.750864+0000","last_fullsized":"2024-09-12T22:09:53.750864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749640+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:53.749640+0000","last_peered":"2024-09-12T22:09:53.749640+0000","last_clean":"2024-09-12T22:09:53.749640+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:53.749640+0000","last_undegraded":"2024-09-12T22:09:53.749640+0000","last_fullsized":"2024-09-12T22:09:53.749640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749568+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:09:53.749568+0000","last_peered":"2024-09-12T22:09:53.749568+0000","last_clean":"2024-09-12T22:09:53.749568+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:09:53.749568+0000","last_undegraded":"2024-09-12T22:09:53.749568+0000","last_fullsized":"2024-09-12T22:09:53.749568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749527+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:09:53.749527+0000","last_peered":"2024-09-12T22:09:53.749527+0000","last_clean":"2024-09-12T22:09:53.749527+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:09:53.749527+0000","last_undegraded":"2024-09-12T22:09:53.749527+0000","last_fullsized":"2024-09-12T22:09:53.749527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750254+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:53.750254+0000","last_peered":"2024-09-12T22:09:53.750254+0000","last_clean":"2024-09-12T22:09:53.750254+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:53.750254+0000","last_undegraded":"2024-09-12T22:09:53.750254+0000","last_fullsized":"2024-09-12T22:09:53.750254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749473+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:09:53.749473+0000","last_peered":"2024-09-12T22:09:53.749473+0000","last_clean":"2024-09-12T22:09:53.749473+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:09:53.749473+0000","last_undegraded":"2024-09-12T22:09:53.749473+0000","last_fullsized":"2024-09-12T22:09:53.749473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750097+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:09:53.750097+0000","last_peered":"2024-09-12T22:09:53.750097+0000","last_clean":"2024-09-12T22:09:53.750097+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:09:53.750097+0000","last_undegraded":"2024-09-12T22:09:53.750097+0000","last_fullsized":"2024-09-12T22:09:53.750097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750040+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:53.750040+0000","last_peered":"2024-09-12T22:09:53.750040+0000","last_clean":"2024-09-12T22:09:53.750040+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:53.750040+0000","last_undegraded":"2024-09-12T22:09:53.750040+0000","last_fullsized":"2024-09-12T22:09:53.750040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749990+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:09:53.749990+0000","last_peered":"2024-09-12T22:09:53.749990+0000","last_clean":"2024-09-12T22:09:53.749990+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:09:53.749990+0000","last_undegraded":"2024-09-12T22:09:53.749990+0000","last_fullsized":"2024-09-12T22:09:53.749990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750937+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:53.750937+0000","last_peered":"2024-09-12T22:09:53.750937+0000","last_clean":"2024-09-12T22:09:53.750937+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:53.750937+0000","last_undegraded":"2024-09-12T22:09:53.750937+0000","last_fullsized":"2024-09-12T22:09:53.750937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749167+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:09:53.749167+0000","last_peered":"2024-09-12T22:09:53.749167+0000","last_clean":"2024-09-12T22:09:53.749167+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:09:53.749167+0000","last_undegraded":"2024-09-12T22:09:53.749167+0000","last_fullsized":"2024-09-12T22:09:53.749167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750122+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:09:53.750122+0000","last_peered":"2024-09-12T22:09:53.750122+0000","last_clean":"2024-09-12T22:09:53.750122+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:09:53.750122+0000","last_undegraded":"2024-09-12T22:09:53.750122+0000","last_fullsized":"2024-09-12T22:09:53.750122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750372+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:09:53.750372+0000","last_peered":"2024-09-12T22:09:53.750372+0000","last_clean":"2024-09-12T22:09:53.750372+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:09:53.750372+0000","last_undegraded":"2024-09-12T22:09:53.750372+0000","last_fullsized":"2024-09-12T22:09:53.750372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749023+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:09:53.749023+0000","last_peered":"2024-09-12T22:09:53.749023+0000","last_clean":"2024-09-12T22:09:53.749023+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:09:53.749023+0000","last_undegraded":"2024-09-12T22:09:53.749023+0000","last_fullsized":"2024-09-12T22:09:53.749023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750174+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:09:53.750174+0000","last_peered":"2024-09-12T22:09:53.750174+0000","last_clean":"2024-09-12T22:09:53.750174+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:09:53.750174+0000","last_undegraded":"2024-09-12T22:09:53.750174+0000","last_fullsized":"2024-09-12T22:09:53.750174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750667+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:09:53.750667+0000","last_peered":"2024-09-12T22:09:53.750667+0000","last_clean":"2024-09-12T22:09:53.750667+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:09:53.750667+0000","last_undegraded":"2024-09-12T22:09:53.750667+0000","last_fullsized":"2024-09-12T22:09:53.750667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748940+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:09:53.748940+0000","last_peered":"2024-09-12T22:09:53.748940+0000","last_clean":"2024-09-12T22:09:53.748940+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:09:53.748940+0000","last_undegraded":"2024-09-12T22:09:53.748940+0000","last_fullsized":"2024-09-12T22:09:53.748940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749960+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:09:53.749960+0000","last_peered":"2024-09-12T22:09:53.749960+0000","last_clean":"2024-09-12T22:09:53.749960+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:09:53.749960+0000","last_undegraded":"2024-09-12T22:09:53.749960+0000","last_fullsized":"2024-09-12T22:09:53.749960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750337+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:09:53.750337+0000","last_peered":"2024-09-12T22:09:53.750337+0000","last_clean":"2024-09-12T22:09:53.750337+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:09:53.750337+0000","last_undegraded":"2024-09-12T22:09:53.750337+0000","last_fullsized":"2024-09-12T22:09:53.750337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748927+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:09:53.748927+0000","last_peered":"2024-09-12T22:09:53.748927+0000","last_clean":"2024-09-12T22:09:53.748927+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:09:53.748927+0000","last_undegraded":"2024-09-12T22:09:53.748927+0000","last_fullsized":"2024-09-12T22:09:53.748927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749615+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:09:53.749615+0000","last_peered":"2024-09-12T22:09:53.749615+0000","last_clean":"2024-09-12T22:09:53.749615+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:09:53.749615+0000","last_undegraded":"2024-09-12T22:09:53.749615+0000","last_fullsized":"2024-09-12T22:09:53.749615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749070+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:09:53.749070+0000","last_peered":"2024-09-12T22:09:53.749070+0000","last_clean":"2024-09-12T22:09:53.749070+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:09:53.749070+0000","last_undegraded":"2024-09-12T22:09:53.749070+0000","last_fullsized":"2024-09-12T22:09:53.749070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749881+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:09:53.749881+0000","last_peered":"2024-09-12T22:09:53.749881+0000","last_clean":"2024-09-12T22:09:53.749881+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:09:53.749881+0000","last_undegraded":"2024-09-12T22:09:53.749881+0000","last_fullsized":"2024-09-12T22:09:53.749881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749463+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:09:53.749463+0000","last_peered":"2024-09-12T22:09:53.749463+0000","last_clean":"2024-09-12T22:09:53.749463+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:09:53.749463+0000","last_undegraded":"2024-09-12T22:09:53.749463+0000","last_fullsized":"2024-09-12T22:09:53.749463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749643+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:09:53.749643+0000","last_peered":"2024-09-12T22:09:53.749643+0000","last_clean":"2024-09-12T22:09:53.749643+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:09:53.749643+0000","last_undegraded":"2024-09-12T22:09:53.749643+0000","last_fullsized":"2024-09-12T22:09:53.749643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749562+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:09:53.749562+0000","last_peered":"2024-09-12T22:09:53.749562+0000","last_clean":"2024-09-12T22:09:53.749562+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:09:53.749562+0000","last_undegraded":"2024-09-12T22:09:53.749562+0000","last_fullsized":"2024-09-12T22:09:53.749562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750238+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:09:53.750238+0000","last_peered":"2024-09-12T22:09:53.750238+0000","last_clean":"2024-09-12T22:09:53.750238+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:09:53.750238+0000","last_undegraded":"2024-09-12T22:09:53.750238+0000","last_fullsized":"2024-09-12T22:09:53.750238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749930+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:09:53.749930+0000","last_peered":"2024-09-12T22:09:53.749930+0000","last_clean":"2024-09-12T22:09:53.749930+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:09:53.749930+0000","last_undegraded":"2024-09-12T22:09:53.749930+0000","last_fullsized":"2024-09-12T22:09:53.749930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750002+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:09:53.750002+0000","last_peered":"2024-09-12T22:09:53.750002+0000","last_clean":"2024-09-12T22:09:53.750002+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:09:53.750002+0000","last_undegraded":"2024-09-12T22:09:53.750002+0000","last_fullsized":"2024-09-12T22:09:53.750002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749490+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:09:53.749490+0000","last_peered":"2024-09-12T22:09:53.749490+0000","last_clean":"2024-09-12T22:09:53.749490+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:09:53.749490+0000","last_undegraded":"2024-09-12T22:09:53.749490+0000","last_fullsized":"2024-09-12T22:09:53.749490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749863+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:09:53.749863+0000","last_peered":"2024-09-12T22:09:53.749863+0000","last_clean":"2024-09-12T22:09:53.749863+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:09:53.749863+0000","last_undegraded":"2024-09-12T22:09:53.749863+0000","last_fullsized":"2024-09-12T22:09:53.749863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749656+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:09:53.749656+0000","last_peered":"2024-09-12T22:09:53.749656+0000","last_clean":"2024-09-12T22:09:53.749656+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:09:53.749656+0000","last_undegraded":"2024-09-12T22:09:53.749656+0000","last_fullsized":"2024-09-12T22:09:53.749656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749951+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:09:53.749951+0000","last_peered":"2024-09-12T22:09:53.749951+0000","last_clean":"2024-09-12T22:09:53.749951+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:09:53.749951+0000","last_undegraded":"2024-09-12T22:09:53.749951+0000","last_fullsized":"2024-09-12T22:09:53.749951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":253952,"data_stored":651168,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":651803,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:09:58.342 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:09:58.651 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:09:58.662 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T22:09:57.068766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90096,"kb_used_data":680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025424,"statfs":{"total":289910292480,"available":289818034176,"internally_reserved":0,"allocated":696320,"data_stored":1362612,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.114931"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750001+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:09:53.750001+0000","last_peered":"2024-09-12T22:09:53.750001+0000","last_clean":"2024-09-12T22:09:53.750001+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:09:53.750001+0000","last_undegraded":"2024-09-12T22:09:53.750001+0000","last_fullsized":"2024-09-12T22:09:53.750001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749767+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:09:53.749767+0000","last_peered":"2024-09-12T22:09:53.749767+0000","last_clean":"2024-09-12T22:09:53.749767+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:09:53.749767+0000","last_undegraded":"2024-09-12T22:09:53.749767+0000","last_fullsized":"2024-09-12T22:09:53.749767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750605+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:09:53.750605+0000","last_peered":"2024-09-12T22:09:53.750605+0000","last_clean":"2024-09-12T22:09:53.750605+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:09:53.750605+0000","last_undegraded":"2024-09-12T22:09:53.750605+0000","last_fullsized":"2024-09-12T22:09:53.750605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749637+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:09:53.749637+0000","last_peered":"2024-09-12T22:09:53.749637+0000","last_clean":"2024-09-12T22:09:53.749637+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:09:53.749637+0000","last_undegraded":"2024-09-12T22:09:53.749637+0000","last_fullsized":"2024-09-12T22:09:53.749637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749717+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:09:53.749717+0000","last_peered":"2024-09-12T22:09:53.749717+0000","last_clean":"2024-09-12T22:09:53.749717+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:09:53.749717+0000","last_undegraded":"2024-09-12T22:09:53.749717+0000","last_fullsized":"2024-09-12T22:09:53.749717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749658+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:09:53.749658+0000","last_peered":"2024-09-12T22:09:53.749658+0000","last_clean":"2024-09-12T22:09:53.749658+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:09:53.749658+0000","last_undegraded":"2024-09-12T22:09:53.749658+0000","last_fullsized":"2024-09-12T22:09:53.749658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749412+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:09:53.749412+0000","last_peered":"2024-09-12T22:09:53.749412+0000","last_clean":"2024-09-12T22:09:53.749412+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:09:53.749412+0000","last_undegraded":"2024-09-12T22:09:53.749412+0000","last_fullsized":"2024-09-12T22:09:53.749412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749670+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:09:53.749670+0000","last_peered":"2024-09-12T22:09:53.749670+0000","last_clean":"2024-09-12T22:09:53.749670+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:09:53.749670+0000","last_undegraded":"2024-09-12T22:09:53.749670+0000","last_fullsized":"2024-09-12T22:09:53.749670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749859+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:09:53.749859+0000","last_peered":"2024-09-12T22:09:53.749859+0000","last_clean":"2024-09-12T22:09:53.749859+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:09:53.749859+0000","last_undegraded":"2024-09-12T22:09:53.749859+0000","last_fullsized":"2024-09-12T22:09:53.749859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750477+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:09:53.750477+0000","last_peered":"2024-09-12T22:09:53.750477+0000","last_clean":"2024-09-12T22:09:53.750477+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:09:53.750477+0000","last_undegraded":"2024-09-12T22:09:53.750477+0000","last_fullsized":"2024-09-12T22:09:53.750477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749676+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:09:53.749676+0000","last_peered":"2024-09-12T22:09:53.749676+0000","last_clean":"2024-09-12T22:09:53.749676+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:09:53.749676+0000","last_undegraded":"2024-09-12T22:09:53.749676+0000","last_fullsized":"2024-09-12T22:09:53.749676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749472+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:09:53.749472+0000","last_peered":"2024-09-12T22:09:53.749472+0000","last_clean":"2024-09-12T22:09:53.749472+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:09:53.749472+0000","last_undegraded":"2024-09-12T22:09:53.749472+0000","last_fullsized":"2024-09-12T22:09:53.749472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749748+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:09:53.749748+0000","last_peered":"2024-09-12T22:09:53.749748+0000","last_clean":"2024-09-12T22:09:53.749748+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:09:53.749748+0000","last_undegraded":"2024-09-12T22:09:53.749748+0000","last_fullsized":"2024-09-12T22:09:53.749748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749709+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:09:53.749709+0000","last_peered":"2024-09-12T22:09:53.749709+0000","last_clean":"2024-09-12T22:09:53.749709+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:09:53.749709+0000","last_undegraded":"2024-09-12T22:09:53.749709+0000","last_fullsized":"2024-09-12T22:09:53.749709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749470+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:09:53.749470+0000","last_peered":"2024-09-12T22:09:53.749470+0000","last_clean":"2024-09-12T22:09:53.749470+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:09:53.749470+0000","last_undegraded":"2024-09-12T22:09:53.749470+0000","last_fullsized":"2024-09-12T22:09:53.749470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750125+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:09:53.750125+0000","last_peered":"2024-09-12T22:09:53.750125+0000","last_clean":"2024-09-12T22:09:53.750125+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:09:53.750125+0000","last_undegraded":"2024-09-12T22:09:53.750125+0000","last_fullsized":"2024-09-12T22:09:53.750125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750087+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:09:53.750087+0000","last_peered":"2024-09-12T22:09:53.750087+0000","last_clean":"2024-09-12T22:09:53.750087+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:09:53.750087+0000","last_undegraded":"2024-09-12T22:09:53.750087+0000","last_fullsized":"2024-09-12T22:09:53.750087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749423+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:09:53.749423+0000","last_peered":"2024-09-12T22:09:53.749423+0000","last_clean":"2024-09-12T22:09:53.749423+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:09:53.749423+0000","last_undegraded":"2024-09-12T22:09:53.749423+0000","last_fullsized":"2024-09-12T22:09:53.749423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750165+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:09:53.750165+0000","last_peered":"2024-09-12T22:09:53.750165+0000","last_clean":"2024-09-12T22:09:53.750165+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:09:53.750165+0000","last_undegraded":"2024-09-12T22:09:53.750165+0000","last_fullsized":"2024-09-12T22:09:53.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750012+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:09:53.750012+0000","last_peered":"2024-09-12T22:09:53.750012+0000","last_clean":"2024-09-12T22:09:53.750012+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:09:53.750012+0000","last_undegraded":"2024-09-12T22:09:53.750012+0000","last_fullsized":"2024-09-12T22:09:53.750012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749271+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:09:53.749271+0000","last_peered":"2024-09-12T22:09:53.749271+0000","last_clean":"2024-09-12T22:09:53.749271+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:09:53.749271+0000","last_undegraded":"2024-09-12T22:09:53.749271+0000","last_fullsized":"2024-09-12T22:09:53.749271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748773+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:09:53.748773+0000","last_peered":"2024-09-12T22:09:53.748773+0000","last_clean":"2024-09-12T22:09:53.748773+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:09:53.748773+0000","last_undegraded":"2024-09-12T22:09:53.748773+0000","last_fullsized":"2024-09-12T22:09:53.748773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748970+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:09:53.748970+0000","last_peered":"2024-09-12T22:09:53.748970+0000","last_clean":"2024-09-12T22:09:53.748970+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:09:53.748970+0000","last_undegraded":"2024-09-12T22:09:53.748970+0000","last_fullsized":"2024-09-12T22:09:53.748970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750109+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:09:53.750109+0000","last_peered":"2024-09-12T22:09:53.750109+0000","last_clean":"2024-09-12T22:09:53.750109+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:09:53.750109+0000","last_undegraded":"2024-09-12T22:09:53.750109+0000","last_fullsized":"2024-09-12T22:09:53.750109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749671+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:09:53.749671+0000","last_peered":"2024-09-12T22:09:53.749671+0000","last_clean":"2024-09-12T22:09:53.749671+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:09:53.749671+0000","last_undegraded":"2024-09-12T22:09:53.749671+0000","last_fullsized":"2024-09-12T22:09:53.749671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750625+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:09:53.750625+0000","last_peered":"2024-09-12T22:09:53.750625+0000","last_clean":"2024-09-12T22:09:53.750625+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:09:53.750625+0000","last_undegraded":"2024-09-12T22:09:53.750625+0000","last_fullsized":"2024-09-12T22:09:53.750625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749979+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:09:53.749979+0000","last_peered":"2024-09-12T22:09:53.749979+0000","last_clean":"2024-09-12T22:09:53.749979+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:09:53.749979+0000","last_undegraded":"2024-09-12T22:09:53.749979+0000","last_fullsized":"2024-09-12T22:09:53.749979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749252+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:09:53.749252+0000","last_peered":"2024-09-12T22:09:53.749252+0000","last_clean":"2024-09-12T22:09:53.749252+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:09:53.749252+0000","last_undegraded":"2024-09-12T22:09:53.749252+0000","last_fullsized":"2024-09-12T22:09:53.749252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749388+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:09:53.749388+0000","last_peered":"2024-09-12T22:09:53.749388+0000","last_clean":"2024-09-12T22:09:53.749388+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:09:53.749388+0000","last_undegraded":"2024-09-12T22:09:53.749388+0000","last_fullsized":"2024-09-12T22:09:53.749388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748833+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:09:53.748833+0000","last_peered":"2024-09-12T22:09:53.748833+0000","last_clean":"2024-09-12T22:09:53.748833+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:09:53.748833+0000","last_undegraded":"2024-09-12T22:09:53.748833+0000","last_fullsized":"2024-09-12T22:09:53.748833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749543+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:09:53.749543+0000","last_peered":"2024-09-12T22:09:53.749543+0000","last_clean":"2024-09-12T22:09:53.749543+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:09:53.749543+0000","last_undegraded":"2024-09-12T22:09:53.749543+0000","last_fullsized":"2024-09-12T22:09:53.749543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749826+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:09:53.749826+0000","last_peered":"2024-09-12T22:09:53.749826+0000","last_clean":"2024-09-12T22:09:53.749826+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:09:53.749826+0000","last_undegraded":"2024-09-12T22:09:53.749826+0000","last_fullsized":"2024-09-12T22:09:53.749826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750152+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:09:53.750152+0000","last_peered":"2024-09-12T22:09:53.750152+0000","last_clean":"2024-09-12T22:09:53.750152+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:09:53.750152+0000","last_undegraded":"2024-09-12T22:09:53.750152+0000","last_fullsized":"2024-09-12T22:09:53.750152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749939+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:09:53.749939+0000","last_peered":"2024-09-12T22:09:53.749939+0000","last_clean":"2024-09-12T22:09:53.749939+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:09:53.749939+0000","last_undegraded":"2024-09-12T22:09:53.749939+0000","last_fullsized":"2024-09-12T22:09:53.749939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749125+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:09:53.749125+0000","last_peered":"2024-09-12T22:09:53.749125+0000","last_clean":"2024-09-12T22:09:53.749125+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:09:53.749125+0000","last_undegraded":"2024-09-12T22:09:53.749125+0000","last_fullsized":"2024-09-12T22:09:53.749125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749973+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:09:53.749973+0000","last_peered":"2024-09-12T22:09:53.749973+0000","last_clean":"2024-09-12T22:09:53.749973+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:09:53.749973+0000","last_undegraded":"2024-09-12T22:09:53.749973+0000","last_fullsized":"2024-09-12T22:09:53.749973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749274+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:09:53.749274+0000","last_peered":"2024-09-12T22:09:53.749274+0000","last_clean":"2024-09-12T22:09:53.749274+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:09:53.749274+0000","last_undegraded":"2024-09-12T22:09:53.749274+0000","last_fullsized":"2024-09-12T22:09:53.749274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749707+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:09:53.749707+0000","last_peered":"2024-09-12T22:09:53.749707+0000","last_clean":"2024-09-12T22:09:53.749707+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:09:53.749707+0000","last_undegraded":"2024-09-12T22:09:53.749707+0000","last_fullsized":"2024-09-12T22:09:53.749707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749535+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:09:53.749535+0000","last_peered":"2024-09-12T22:09:53.749535+0000","last_clean":"2024-09-12T22:09:53.749535+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:09:53.749535+0000","last_undegraded":"2024-09-12T22:09:53.749535+0000","last_fullsized":"2024-09-12T22:09:53.749535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750865+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:09:53.750865+0000","last_peered":"2024-09-12T22:09:53.750865+0000","last_clean":"2024-09-12T22:09:53.750865+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:09:53.750865+0000","last_undegraded":"2024-09-12T22:09:53.750865+0000","last_fullsized":"2024-09-12T22:09:53.750865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749054+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:09:53.749054+0000","last_peered":"2024-09-12T22:09:53.749054+0000","last_clean":"2024-09-12T22:09:53.749054+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:09:53.749054+0000","last_undegraded":"2024-09-12T22:09:53.749054+0000","last_fullsized":"2024-09-12T22:09:53.749054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750059+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:09:53.750059+0000","last_peered":"2024-09-12T22:09:53.750059+0000","last_clean":"2024-09-12T22:09:53.750059+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:09:53.750059+0000","last_undegraded":"2024-09-12T22:09:53.750059+0000","last_fullsized":"2024-09-12T22:09:53.750059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749185+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:09:53.749185+0000","last_peered":"2024-09-12T22:09:53.749185+0000","last_clean":"2024-09-12T22:09:53.749185+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:09:53.749185+0000","last_undegraded":"2024-09-12T22:09:53.749185+0000","last_fullsized":"2024-09-12T22:09:53.749185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750809+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:09:53.750809+0000","last_peered":"2024-09-12T22:09:53.750809+0000","last_clean":"2024-09-12T22:09:53.750809+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:09:53.750809+0000","last_undegraded":"2024-09-12T22:09:53.750809+0000","last_fullsized":"2024-09-12T22:09:53.750809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749978+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:09:53.749978+0000","last_peered":"2024-09-12T22:09:53.749978+0000","last_clean":"2024-09-12T22:09:53.749978+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:09:53.749978+0000","last_undegraded":"2024-09-12T22:09:53.749978+0000","last_fullsized":"2024-09-12T22:09:53.749978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750423+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:09:53.750423+0000","last_peered":"2024-09-12T22:09:53.750423+0000","last_clean":"2024-09-12T22:09:53.750423+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:09:53.750423+0000","last_undegraded":"2024-09-12T22:09:53.750423+0000","last_fullsized":"2024-09-12T22:09:53.750423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749081+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:09:53.749081+0000","last_peered":"2024-09-12T22:09:53.749081+0000","last_clean":"2024-09-12T22:09:53.749081+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:09:53.749081+0000","last_undegraded":"2024-09-12T22:09:53.749081+0000","last_fullsized":"2024-09-12T22:09:53.749081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749634+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:09:53.749634+0000","last_peered":"2024-09-12T22:09:53.749634+0000","last_clean":"2024-09-12T22:09:53.749634+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:09:53.749634+0000","last_undegraded":"2024-09-12T22:09:53.749634+0000","last_fullsized":"2024-09-12T22:09:53.749634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750221+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:09:53.750221+0000","last_peered":"2024-09-12T22:09:53.750221+0000","last_clean":"2024-09-12T22:09:53.750221+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:09:53.750221+0000","last_undegraded":"2024-09-12T22:09:53.750221+0000","last_fullsized":"2024-09-12T22:09:53.750221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750007+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:09:53.750007+0000","last_peered":"2024-09-12T22:09:53.750007+0000","last_clean":"2024-09-12T22:09:53.750007+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:09:53.750007+0000","last_undegraded":"2024-09-12T22:09:53.750007+0000","last_fullsized":"2024-09-12T22:09:53.750007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750743+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:09:53.750743+0000","last_peered":"2024-09-12T22:09:53.750743+0000","last_clean":"2024-09-12T22:09:53.750743+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:09:53.750743+0000","last_undegraded":"2024-09-12T22:09:53.750743+0000","last_fullsized":"2024-09-12T22:09:53.750743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749327+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:09:53.749327+0000","last_peered":"2024-09-12T22:09:53.749327+0000","last_clean":"2024-09-12T22:09:53.749327+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:09:53.749327+0000","last_undegraded":"2024-09-12T22:09:53.749327+0000","last_fullsized":"2024-09-12T22:09:53.749327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750671+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:09:53.750671+0000","last_peered":"2024-09-12T22:09:53.750671+0000","last_clean":"2024-09-12T22:09:53.750671+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:09:53.750671+0000","last_undegraded":"2024-09-12T22:09:53.750671+0000","last_fullsized":"2024-09-12T22:09:53.750671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749007+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:09:53.749007+0000","last_peered":"2024-09-12T22:09:53.749007+0000","last_clean":"2024-09-12T22:09:53.749007+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:09:53.749007+0000","last_undegraded":"2024-09-12T22:09:53.749007+0000","last_fullsized":"2024-09-12T22:09:53.749007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749791+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:09:53.749791+0000","last_peered":"2024-09-12T22:09:53.749791+0000","last_clean":"2024-09-12T22:09:53.749791+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:09:53.749791+0000","last_undegraded":"2024-09-12T22:09:53.749791+0000","last_fullsized":"2024-09-12T22:09:53.749791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749768+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:53.749768+0000","last_peered":"2024-09-12T22:09:53.749768+0000","last_clean":"2024-09-12T22:09:53.749768+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:53.749768+0000","last_undegraded":"2024-09-12T22:09:53.749768+0000","last_fullsized":"2024-09-12T22:09:53.749768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750374+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:53.750374+0000","last_peered":"2024-09-12T22:09:53.750374+0000","last_clean":"2024-09-12T22:09:53.750374+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:53.750374+0000","last_undegraded":"2024-09-12T22:09:53.750374+0000","last_fullsized":"2024-09-12T22:09:53.750374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749291+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:09:53.749291+0000","last_peered":"2024-09-12T22:09:53.749291+0000","last_clean":"2024-09-12T22:09:53.749291+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:09:53.749291+0000","last_undegraded":"2024-09-12T22:09:53.749291+0000","last_fullsized":"2024-09-12T22:09:53.749291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750817+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:09:53.750817+0000","last_peered":"2024-09-12T22:09:53.750817+0000","last_clean":"2024-09-12T22:09:53.750817+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:09:53.750817+0000","last_undegraded":"2024-09-12T22:09:53.750817+0000","last_fullsized":"2024-09-12T22:09:53.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749794+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:53.749794+0000","last_peered":"2024-09-12T22:09:53.749794+0000","last_clean":"2024-09-12T22:09:53.749794+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:53.749794+0000","last_undegraded":"2024-09-12T22:09:53.749794+0000","last_fullsized":"2024-09-12T22:09:53.749794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749238+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:09:53.749238+0000","last_peered":"2024-09-12T22:09:53.749238+0000","last_clean":"2024-09-12T22:09:53.749238+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:09:53.749238+0000","last_undegraded":"2024-09-12T22:09:53.749238+0000","last_fullsized":"2024-09-12T22:09:53.749238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750000+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:09:53.750000+0000","last_peered":"2024-09-12T22:09:53.750000+0000","last_clean":"2024-09-12T22:09:53.750000+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:09:53.750000+0000","last_undegraded":"2024-09-12T22:09:53.750000+0000","last_fullsized":"2024-09-12T22:09:53.750000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749507+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:53.749507+0000","last_peered":"2024-09-12T22:09:53.749507+0000","last_clean":"2024-09-12T22:09:53.749507+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:53.749507+0000","last_undegraded":"2024-09-12T22:09:53.749507+0000","last_fullsized":"2024-09-12T22:09:53.749507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749111+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:09:53.749111+0000","last_peered":"2024-09-12T22:09:53.749111+0000","last_clean":"2024-09-12T22:09:53.749111+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:09:53.749111+0000","last_undegraded":"2024-09-12T22:09:53.749111+0000","last_fullsized":"2024-09-12T22:09:53.749111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749820+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:09:53.749820+0000","last_peered":"2024-09-12T22:09:53.749820+0000","last_clean":"2024-09-12T22:09:53.749820+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:09:53.749820+0000","last_undegraded":"2024-09-12T22:09:53.749820+0000","last_fullsized":"2024-09-12T22:09:53.749820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750106+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:53.750106+0000","last_peered":"2024-09-12T22:09:53.750106+0000","last_clean":"2024-09-12T22:09:53.750106+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:53.750106+0000","last_undegraded":"2024-09-12T22:09:53.750106+0000","last_fullsized":"2024-09-12T22:09:53.750106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750197+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:09:53.750197+0000","last_peered":"2024-09-12T22:09:53.750197+0000","last_clean":"2024-09-12T22:09:53.750197+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:09:53.750197+0000","last_undegraded":"2024-09-12T22:09:53.750197+0000","last_fullsized":"2024-09-12T22:09:53.750197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749361+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:09:53.749361+0000","last_peered":"2024-09-12T22:09:53.749361+0000","last_clean":"2024-09-12T22:09:53.749361+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:09:53.749361+0000","last_undegraded":"2024-09-12T22:09:53.749361+0000","last_fullsized":"2024-09-12T22:09:53.749361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750864+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:09:53.750864+0000","last_peered":"2024-09-12T22:09:53.750864+0000","last_clean":"2024-09-12T22:09:53.750864+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:09:53.750864+0000","last_undegraded":"2024-09-12T22:09:53.750864+0000","last_fullsized":"2024-09-12T22:09:53.750864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749640+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:53.749640+0000","last_peered":"2024-09-12T22:09:53.749640+0000","last_clean":"2024-09-12T22:09:53.749640+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:53.749640+0000","last_undegraded":"2024-09-12T22:09:53.749640+0000","last_fullsized":"2024-09-12T22:09:53.749640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749568+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:09:53.749568+0000","last_peered":"2024-09-12T22:09:53.749568+0000","last_clean":"2024-09-12T22:09:53.749568+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:09:53.749568+0000","last_undegraded":"2024-09-12T22:09:53.749568+0000","last_fullsized":"2024-09-12T22:09:53.749568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749527+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:09:53.749527+0000","last_peered":"2024-09-12T22:09:53.749527+0000","last_clean":"2024-09-12T22:09:53.749527+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:09:53.749527+0000","last_undegraded":"2024-09-12T22:09:53.749527+0000","last_fullsized":"2024-09-12T22:09:53.749527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750254+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:53.750254+0000","last_peered":"2024-09-12T22:09:53.750254+0000","last_clean":"2024-09-12T22:09:53.750254+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:53.750254+0000","last_undegraded":"2024-09-12T22:09:53.750254+0000","last_fullsized":"2024-09-12T22:09:53.750254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749473+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:09:53.749473+0000","last_peered":"2024-09-12T22:09:53.749473+0000","last_clean":"2024-09-12T22:09:53.749473+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:09:53.749473+0000","last_undegraded":"2024-09-12T22:09:53.749473+0000","last_fullsized":"2024-09-12T22:09:53.749473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750097+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:09:53.750097+0000","last_peered":"2024-09-12T22:09:53.750097+0000","last_clean":"2024-09-12T22:09:53.750097+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:09:53.750097+0000","last_undegraded":"2024-09-12T22:09:53.750097+0000","last_fullsized":"2024-09-12T22:09:53.750097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750040+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:53.750040+0000","last_peered":"2024-09-12T22:09:53.750040+0000","last_clean":"2024-09-12T22:09:53.750040+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:53.750040+0000","last_undegraded":"2024-09-12T22:09:53.750040+0000","last_fullsized":"2024-09-12T22:09:53.750040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749990+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:09:53.749990+0000","last_peered":"2024-09-12T22:09:53.749990+0000","last_clean":"2024-09-12T22:09:53.749990+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:09:53.749990+0000","last_undegraded":"2024-09-12T22:09:53.749990+0000","last_fullsized":"2024-09-12T22:09:53.749990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750937+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:53.750937+0000","last_peered":"2024-09-12T22:09:53.750937+0000","last_clean":"2024-09-12T22:09:53.750937+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:53.750937+0000","last_undegraded":"2024-09-12T22:09:53.750937+0000","last_fullsized":"2024-09-12T22:09:53.750937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749167+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:09:53.749167+0000","last_peered":"2024-09-12T22:09:53.749167+0000","last_clean":"2024-09-12T22:09:53.749167+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:09:53.749167+0000","last_undegraded":"2024-09-12T22:09:53.749167+0000","last_fullsized":"2024-09-12T22:09:53.749167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750122+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:09:53.750122+0000","last_peered":"2024-09-12T22:09:53.750122+0000","last_clean":"2024-09-12T22:09:53.750122+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:09:53.750122+0000","last_undegraded":"2024-09-12T22:09:53.750122+0000","last_fullsized":"2024-09-12T22:09:53.750122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750372+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:09:53.750372+0000","last_peered":"2024-09-12T22:09:53.750372+0000","last_clean":"2024-09-12T22:09:53.750372+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:09:53.750372+0000","last_undegraded":"2024-09-12T22:09:53.750372+0000","last_fullsized":"2024-09-12T22:09:53.750372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749023+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:09:53.749023+0000","last_peered":"2024-09-12T22:09:53.749023+0000","last_clean":"2024-09-12T22:09:53.749023+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:09:53.749023+0000","last_undegraded":"2024-09-12T22:09:53.749023+0000","last_fullsized":"2024-09-12T22:09:53.749023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750174+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:09:53.750174+0000","last_peered":"2024-09-12T22:09:53.750174+0000","last_clean":"2024-09-12T22:09:53.750174+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:09:53.750174+0000","last_undegraded":"2024-09-12T22:09:53.750174+0000","last_fullsized":"2024-09-12T22:09:53.750174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750667+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:09:53.750667+0000","last_peered":"2024-09-12T22:09:53.750667+0000","last_clean":"2024-09-12T22:09:53.750667+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:09:53.750667+0000","last_undegraded":"2024-09-12T22:09:53.750667+0000","last_fullsized":"2024-09-12T22:09:53.750667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748940+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:09:53.748940+0000","last_peered":"2024-09-12T22:09:53.748940+0000","last_clean":"2024-09-12T22:09:53.748940+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:09:53.748940+0000","last_undegraded":"2024-09-12T22:09:53.748940+0000","last_fullsized":"2024-09-12T22:09:53.748940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749960+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:09:53.749960+0000","last_peered":"2024-09-12T22:09:53.749960+0000","last_clean":"2024-09-12T22:09:53.749960+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:09:53.749960+0000","last_undegraded":"2024-09-12T22:09:53.749960+0000","last_fullsized":"2024-09-12T22:09:53.749960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750337+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:09:53.750337+0000","last_peered":"2024-09-12T22:09:53.750337+0000","last_clean":"2024-09-12T22:09:53.750337+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:09:53.750337+0000","last_undegraded":"2024-09-12T22:09:53.750337+0000","last_fullsized":"2024-09-12T22:09:53.750337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748927+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:09:53.748927+0000","last_peered":"2024-09-12T22:09:53.748927+0000","last_clean":"2024-09-12T22:09:53.748927+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:09:53.748927+0000","last_undegraded":"2024-09-12T22:09:53.748927+0000","last_fullsized":"2024-09-12T22:09:53.748927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749615+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:09:53.749615+0000","last_peered":"2024-09-12T22:09:53.749615+0000","last_clean":"2024-09-12T22:09:53.749615+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:09:53.749615+0000","last_undegraded":"2024-09-12T22:09:53.749615+0000","last_fullsized":"2024-09-12T22:09:53.749615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749070+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:09:53.749070+0000","last_peered":"2024-09-12T22:09:53.749070+0000","last_clean":"2024-09-12T22:09:53.749070+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:09:53.749070+0000","last_undegraded":"2024-09-12T22:09:53.749070+0000","last_fullsized":"2024-09-12T22:09:53.749070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749881+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:09:53.749881+0000","last_peered":"2024-09-12T22:09:53.749881+0000","last_clean":"2024-09-12T22:09:53.749881+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:09:53.749881+0000","last_undegraded":"2024-09-12T22:09:53.749881+0000","last_fullsized":"2024-09-12T22:09:53.749881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749463+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:09:53.749463+0000","last_peered":"2024-09-12T22:09:53.749463+0000","last_clean":"2024-09-12T22:09:53.749463+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:09:53.749463+0000","last_undegraded":"2024-09-12T22:09:53.749463+0000","last_fullsized":"2024-09-12T22:09:53.749463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749643+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:09:53.749643+0000","last_peered":"2024-09-12T22:09:53.749643+0000","last_clean":"2024-09-12T22:09:53.749643+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:09:53.749643+0000","last_undegraded":"2024-09-12T22:09:53.749643+0000","last_fullsized":"2024-09-12T22:09:53.749643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749562+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:09:53.749562+0000","last_peered":"2024-09-12T22:09:53.749562+0000","last_clean":"2024-09-12T22:09:53.749562+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:09:53.749562+0000","last_undegraded":"2024-09-12T22:09:53.749562+0000","last_fullsized":"2024-09-12T22:09:53.749562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750238+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:09:53.750238+0000","last_peered":"2024-09-12T22:09:53.750238+0000","last_clean":"2024-09-12T22:09:53.750238+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:09:53.750238+0000","last_undegraded":"2024-09-12T22:09:53.750238+0000","last_fullsized":"2024-09-12T22:09:53.750238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749930+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:09:53.749930+0000","last_peered":"2024-09-12T22:09:53.749930+0000","last_clean":"2024-09-12T22:09:53.749930+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:09:53.749930+0000","last_undegraded":"2024-09-12T22:09:53.749930+0000","last_fullsized":"2024-09-12T22:09:53.749930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750002+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:09:53.750002+0000","last_peered":"2024-09-12T22:09:53.750002+0000","last_clean":"2024-09-12T22:09:53.750002+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:09:53.750002+0000","last_undegraded":"2024-09-12T22:09:53.750002+0000","last_fullsized":"2024-09-12T22:09:53.750002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749490+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:09:53.749490+0000","last_peered":"2024-09-12T22:09:53.749490+0000","last_clean":"2024-09-12T22:09:53.749490+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:09:53.749490+0000","last_undegraded":"2024-09-12T22:09:53.749490+0000","last_fullsized":"2024-09-12T22:09:53.749490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749863+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:09:53.749863+0000","last_peered":"2024-09-12T22:09:53.749863+0000","last_clean":"2024-09-12T22:09:53.749863+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:09:53.749863+0000","last_undegraded":"2024-09-12T22:09:53.749863+0000","last_fullsized":"2024-09-12T22:09:53.749863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749656+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:09:53.749656+0000","last_peered":"2024-09-12T22:09:53.749656+0000","last_clean":"2024-09-12T22:09:53.749656+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:09:53.749656+0000","last_undegraded":"2024-09-12T22:09:53.749656+0000","last_fullsized":"2024-09-12T22:09:53.749656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749951+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:09:53.749951+0000","last_peered":"2024-09-12T22:09:53.749951+0000","last_clean":"2024-09-12T22:09:53.749951+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:09:53.749951+0000","last_undegraded":"2024-09-12T22:09:53.749951+0000","last_fullsized":"2024-09-12T22:09:53.749951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":253952,"data_stored":651168,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":651803,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:09:58.667 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:09:58.668 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T22:09:58.668 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T22:09:58.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T22:09:58.669 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T22:09:59.044 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:59.056 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":844105264},{"type":"v1","addr":"172.21.15.19:6801","nonce":844105264}]},"active_addr":"172.21.15.19:6801/844105264","active_change":"2024-09-12T22:09:33.060851+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3946227904}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1739601822}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2567522153}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":4177662422}]}]} 2024-09-12T22:09:59.060 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T22:09:59.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:09:59.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:59.352 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:59.352 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:53.744997+0000","last_up_change":"2024-09-12T22:09:38.783190+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6801","nonce":2383753808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6803","nonce":2383753808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6807","nonce":2383753808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6805","nonce":2383753808}]},"public_addr":"172.21.15.164:6801/2383753808","cluster_addr":"172.21.15.164:6803/2383753808","heartbeat_back_addr":"172.21.15.164:6807/2383753808","heartbeat_front_addr":"172.21.15.164:6805/2383753808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:59.364 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:09:59.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:09:59.654 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:09:59.654 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:53.744997+0000","last_up_change":"2024-09-12T22:09:38.783190+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6801","nonce":2383753808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6803","nonce":2383753808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6807","nonce":2383753808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6805","nonce":2383753808}]},"public_addr":"172.21.15.164:6801/2383753808","cluster_addr":"172.21.15.164:6803/2383753808","heartbeat_back_addr":"172.21.15.164:6807/2383753808","heartbeat_front_addr":"172.21.15.164:6805/2383753808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:09:59.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:09:59.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:09:59.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:09:59.815 INFO:teuthology.orchestra.run.smithi019.stdout:34359738376 2024-09-12T22:09:59.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:09:59.820 INFO:teuthology.orchestra.run.smithi019.stdout:34359738376 2024-09-12T22:09:59.820 INFO:teuthology.orchestra.run.smithi019.stdout:34359738375 2024-09-12T22:09:59.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:09:59.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:10:00.154 INFO:teuthology.orchestra.run.smithi019.stdout:34359738374 2024-09-12T22:10:00.158 INFO:teuthology.orchestra.run.smithi019.stdout:34359738374 2024-09-12T22:10:00.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738374 for osd.0 2024-09-12T22:10:00.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738374 for osd.1 2024-09-12T22:10:00.199 INFO:teuthology.orchestra.run.smithi019.stdout:34359738373 2024-09-12T22:10:00.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.2 2024-09-12T22:10:01.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:10:01.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:10:01.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:10:01.491 INFO:teuthology.orchestra.run.smithi019.stdout:34359738376 2024-09-12T22:10:01.502 INFO:teuthology.orchestra.run.smithi019.stdout:34359738376 2024-09-12T22:10:01.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.1 2024-09-12T22:10:01.505 DEBUG:teuthology.parallel:result is None 2024-09-12T22:10:01.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.0 2024-09-12T22:10:01.516 DEBUG:teuthology.parallel:result is None 2024-09-12T22:10:01.538 INFO:teuthology.orchestra.run.smithi019.stdout:34359738375 2024-09-12T22:10:01.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-12T22:10:01.553 DEBUG:teuthology.parallel:result is None 2024-09-12T22:10:01.553 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:10:01.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:10:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:01.888 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:10:01.898 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T22:10:01.069413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.103995"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750001+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:09:53.750001+0000","last_peered":"2024-09-12T22:09:53.750001+0000","last_clean":"2024-09-12T22:09:53.750001+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:09:53.750001+0000","last_undegraded":"2024-09-12T22:09:53.750001+0000","last_fullsized":"2024-09-12T22:09:53.750001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749767+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:09:53.749767+0000","last_peered":"2024-09-12T22:09:53.749767+0000","last_clean":"2024-09-12T22:09:53.749767+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:09:53.749767+0000","last_undegraded":"2024-09-12T22:09:53.749767+0000","last_fullsized":"2024-09-12T22:09:53.749767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750605+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:09:53.750605+0000","last_peered":"2024-09-12T22:09:53.750605+0000","last_clean":"2024-09-12T22:09:53.750605+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:09:53.750605+0000","last_undegraded":"2024-09-12T22:09:53.750605+0000","last_fullsized":"2024-09-12T22:09:53.750605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749637+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:09:53.749637+0000","last_peered":"2024-09-12T22:09:53.749637+0000","last_clean":"2024-09-12T22:09:53.749637+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:09:53.749637+0000","last_undegraded":"2024-09-12T22:09:53.749637+0000","last_fullsized":"2024-09-12T22:09:53.749637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749717+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:09:53.749717+0000","last_peered":"2024-09-12T22:09:53.749717+0000","last_clean":"2024-09-12T22:09:53.749717+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:09:53.749717+0000","last_undegraded":"2024-09-12T22:09:53.749717+0000","last_fullsized":"2024-09-12T22:09:53.749717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749658+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:09:53.749658+0000","last_peered":"2024-09-12T22:09:53.749658+0000","last_clean":"2024-09-12T22:09:53.749658+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:09:53.749658+0000","last_undegraded":"2024-09-12T22:09:53.749658+0000","last_fullsized":"2024-09-12T22:09:53.749658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749412+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:09:53.749412+0000","last_peered":"2024-09-12T22:09:53.749412+0000","last_clean":"2024-09-12T22:09:53.749412+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:09:53.749412+0000","last_undegraded":"2024-09-12T22:09:53.749412+0000","last_fullsized":"2024-09-12T22:09:53.749412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749670+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:09:53.749670+0000","last_peered":"2024-09-12T22:09:53.749670+0000","last_clean":"2024-09-12T22:09:53.749670+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:09:53.749670+0000","last_undegraded":"2024-09-12T22:09:53.749670+0000","last_fullsized":"2024-09-12T22:09:53.749670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749859+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:09:53.749859+0000","last_peered":"2024-09-12T22:09:53.749859+0000","last_clean":"2024-09-12T22:09:53.749859+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:09:53.749859+0000","last_undegraded":"2024-09-12T22:09:53.749859+0000","last_fullsized":"2024-09-12T22:09:53.749859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750477+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:09:53.750477+0000","last_peered":"2024-09-12T22:09:53.750477+0000","last_clean":"2024-09-12T22:09:53.750477+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:09:53.750477+0000","last_undegraded":"2024-09-12T22:09:53.750477+0000","last_fullsized":"2024-09-12T22:09:53.750477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749676+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:09:53.749676+0000","last_peered":"2024-09-12T22:09:53.749676+0000","last_clean":"2024-09-12T22:09:53.749676+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:09:53.749676+0000","last_undegraded":"2024-09-12T22:09:53.749676+0000","last_fullsized":"2024-09-12T22:09:53.749676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749472+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:09:53.749472+0000","last_peered":"2024-09-12T22:09:53.749472+0000","last_clean":"2024-09-12T22:09:53.749472+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:09:53.749472+0000","last_undegraded":"2024-09-12T22:09:53.749472+0000","last_fullsized":"2024-09-12T22:09:53.749472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749748+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:09:53.749748+0000","last_peered":"2024-09-12T22:09:53.749748+0000","last_clean":"2024-09-12T22:09:53.749748+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:09:53.749748+0000","last_undegraded":"2024-09-12T22:09:53.749748+0000","last_fullsized":"2024-09-12T22:09:53.749748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749709+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:09:53.749709+0000","last_peered":"2024-09-12T22:09:53.749709+0000","last_clean":"2024-09-12T22:09:53.749709+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:09:53.749709+0000","last_undegraded":"2024-09-12T22:09:53.749709+0000","last_fullsized":"2024-09-12T22:09:53.749709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749470+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:09:53.749470+0000","last_peered":"2024-09-12T22:09:53.749470+0000","last_clean":"2024-09-12T22:09:53.749470+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:09:53.749470+0000","last_undegraded":"2024-09-12T22:09:53.749470+0000","last_fullsized":"2024-09-12T22:09:53.749470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750125+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:09:53.750125+0000","last_peered":"2024-09-12T22:09:53.750125+0000","last_clean":"2024-09-12T22:09:53.750125+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:09:53.750125+0000","last_undegraded":"2024-09-12T22:09:53.750125+0000","last_fullsized":"2024-09-12T22:09:53.750125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750087+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:09:53.750087+0000","last_peered":"2024-09-12T22:09:53.750087+0000","last_clean":"2024-09-12T22:09:53.750087+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:09:53.750087+0000","last_undegraded":"2024-09-12T22:09:53.750087+0000","last_fullsized":"2024-09-12T22:09:53.750087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749423+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:09:53.749423+0000","last_peered":"2024-09-12T22:09:53.749423+0000","last_clean":"2024-09-12T22:09:53.749423+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:09:53.749423+0000","last_undegraded":"2024-09-12T22:09:53.749423+0000","last_fullsized":"2024-09-12T22:09:53.749423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750165+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:09:53.750165+0000","last_peered":"2024-09-12T22:09:53.750165+0000","last_clean":"2024-09-12T22:09:53.750165+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:09:53.750165+0000","last_undegraded":"2024-09-12T22:09:53.750165+0000","last_fullsized":"2024-09-12T22:09:53.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750012+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:09:53.750012+0000","last_peered":"2024-09-12T22:09:53.750012+0000","last_clean":"2024-09-12T22:09:53.750012+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:09:53.750012+0000","last_undegraded":"2024-09-12T22:09:53.750012+0000","last_fullsized":"2024-09-12T22:09:53.750012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749271+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:09:53.749271+0000","last_peered":"2024-09-12T22:09:53.749271+0000","last_clean":"2024-09-12T22:09:53.749271+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:09:53.749271+0000","last_undegraded":"2024-09-12T22:09:53.749271+0000","last_fullsized":"2024-09-12T22:09:53.749271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748773+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:09:53.748773+0000","last_peered":"2024-09-12T22:09:53.748773+0000","last_clean":"2024-09-12T22:09:53.748773+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:09:53.748773+0000","last_undegraded":"2024-09-12T22:09:53.748773+0000","last_fullsized":"2024-09-12T22:09:53.748773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748970+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:09:53.748970+0000","last_peered":"2024-09-12T22:09:53.748970+0000","last_clean":"2024-09-12T22:09:53.748970+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:09:53.748970+0000","last_undegraded":"2024-09-12T22:09:53.748970+0000","last_fullsized":"2024-09-12T22:09:53.748970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750109+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:09:53.750109+0000","last_peered":"2024-09-12T22:09:53.750109+0000","last_clean":"2024-09-12T22:09:53.750109+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:09:53.750109+0000","last_undegraded":"2024-09-12T22:09:53.750109+0000","last_fullsized":"2024-09-12T22:09:53.750109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749671+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:09:53.749671+0000","last_peered":"2024-09-12T22:09:53.749671+0000","last_clean":"2024-09-12T22:09:53.749671+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:09:53.749671+0000","last_undegraded":"2024-09-12T22:09:53.749671+0000","last_fullsized":"2024-09-12T22:09:53.749671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750625+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:09:53.750625+0000","last_peered":"2024-09-12T22:09:53.750625+0000","last_clean":"2024-09-12T22:09:53.750625+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:09:53.750625+0000","last_undegraded":"2024-09-12T22:09:53.750625+0000","last_fullsized":"2024-09-12T22:09:53.750625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749979+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:09:53.749979+0000","last_peered":"2024-09-12T22:09:53.749979+0000","last_clean":"2024-09-12T22:09:53.749979+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:09:53.749979+0000","last_undegraded":"2024-09-12T22:09:53.749979+0000","last_fullsized":"2024-09-12T22:09:53.749979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749252+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:09:53.749252+0000","last_peered":"2024-09-12T22:09:53.749252+0000","last_clean":"2024-09-12T22:09:53.749252+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:09:53.749252+0000","last_undegraded":"2024-09-12T22:09:53.749252+0000","last_fullsized":"2024-09-12T22:09:53.749252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749388+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:09:53.749388+0000","last_peered":"2024-09-12T22:09:53.749388+0000","last_clean":"2024-09-12T22:09:53.749388+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:09:53.749388+0000","last_undegraded":"2024-09-12T22:09:53.749388+0000","last_fullsized":"2024-09-12T22:09:53.749388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748833+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:09:53.748833+0000","last_peered":"2024-09-12T22:09:53.748833+0000","last_clean":"2024-09-12T22:09:53.748833+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:09:53.748833+0000","last_undegraded":"2024-09-12T22:09:53.748833+0000","last_fullsized":"2024-09-12T22:09:53.748833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749543+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:09:53.749543+0000","last_peered":"2024-09-12T22:09:53.749543+0000","last_clean":"2024-09-12T22:09:53.749543+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:09:53.749543+0000","last_undegraded":"2024-09-12T22:09:53.749543+0000","last_fullsized":"2024-09-12T22:09:53.749543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749826+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:09:53.749826+0000","last_peered":"2024-09-12T22:09:53.749826+0000","last_clean":"2024-09-12T22:09:53.749826+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:09:53.749826+0000","last_undegraded":"2024-09-12T22:09:53.749826+0000","last_fullsized":"2024-09-12T22:09:53.749826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750152+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:09:53.750152+0000","last_peered":"2024-09-12T22:09:53.750152+0000","last_clean":"2024-09-12T22:09:53.750152+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:09:53.750152+0000","last_undegraded":"2024-09-12T22:09:53.750152+0000","last_fullsized":"2024-09-12T22:09:53.750152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749939+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:09:53.749939+0000","last_peered":"2024-09-12T22:09:53.749939+0000","last_clean":"2024-09-12T22:09:53.749939+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:09:53.749939+0000","last_undegraded":"2024-09-12T22:09:53.749939+0000","last_fullsized":"2024-09-12T22:09:53.749939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749125+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:09:53.749125+0000","last_peered":"2024-09-12T22:09:53.749125+0000","last_clean":"2024-09-12T22:09:53.749125+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:09:53.749125+0000","last_undegraded":"2024-09-12T22:09:53.749125+0000","last_fullsized":"2024-09-12T22:09:53.749125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749973+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:09:53.749973+0000","last_peered":"2024-09-12T22:09:53.749973+0000","last_clean":"2024-09-12T22:09:53.749973+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:09:53.749973+0000","last_undegraded":"2024-09-12T22:09:53.749973+0000","last_fullsized":"2024-09-12T22:09:53.749973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749274+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:09:53.749274+0000","last_peered":"2024-09-12T22:09:53.749274+0000","last_clean":"2024-09-12T22:09:53.749274+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:09:53.749274+0000","last_undegraded":"2024-09-12T22:09:53.749274+0000","last_fullsized":"2024-09-12T22:09:53.749274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749707+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:09:53.749707+0000","last_peered":"2024-09-12T22:09:53.749707+0000","last_clean":"2024-09-12T22:09:53.749707+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:09:53.749707+0000","last_undegraded":"2024-09-12T22:09:53.749707+0000","last_fullsized":"2024-09-12T22:09:53.749707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749535+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:09:53.749535+0000","last_peered":"2024-09-12T22:09:53.749535+0000","last_clean":"2024-09-12T22:09:53.749535+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:09:53.749535+0000","last_undegraded":"2024-09-12T22:09:53.749535+0000","last_fullsized":"2024-09-12T22:09:53.749535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750865+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:09:53.750865+0000","last_peered":"2024-09-12T22:09:53.750865+0000","last_clean":"2024-09-12T22:09:53.750865+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:09:53.750865+0000","last_undegraded":"2024-09-12T22:09:53.750865+0000","last_fullsized":"2024-09-12T22:09:53.750865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749054+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:09:53.749054+0000","last_peered":"2024-09-12T22:09:53.749054+0000","last_clean":"2024-09-12T22:09:53.749054+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:09:53.749054+0000","last_undegraded":"2024-09-12T22:09:53.749054+0000","last_fullsized":"2024-09-12T22:09:53.749054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750059+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:09:53.750059+0000","last_peered":"2024-09-12T22:09:53.750059+0000","last_clean":"2024-09-12T22:09:53.750059+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:09:53.750059+0000","last_undegraded":"2024-09-12T22:09:53.750059+0000","last_fullsized":"2024-09-12T22:09:53.750059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749185+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:09:53.749185+0000","last_peered":"2024-09-12T22:09:53.749185+0000","last_clean":"2024-09-12T22:09:53.749185+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:09:53.749185+0000","last_undegraded":"2024-09-12T22:09:53.749185+0000","last_fullsized":"2024-09-12T22:09:53.749185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750809+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:09:53.750809+0000","last_peered":"2024-09-12T22:09:53.750809+0000","last_clean":"2024-09-12T22:09:53.750809+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:09:53.750809+0000","last_undegraded":"2024-09-12T22:09:53.750809+0000","last_fullsized":"2024-09-12T22:09:53.750809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749978+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:09:53.749978+0000","last_peered":"2024-09-12T22:09:53.749978+0000","last_clean":"2024-09-12T22:09:53.749978+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:09:53.749978+0000","last_undegraded":"2024-09-12T22:09:53.749978+0000","last_fullsized":"2024-09-12T22:09:53.749978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750423+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:09:53.750423+0000","last_peered":"2024-09-12T22:09:53.750423+0000","last_clean":"2024-09-12T22:09:53.750423+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:09:53.750423+0000","last_undegraded":"2024-09-12T22:09:53.750423+0000","last_fullsized":"2024-09-12T22:09:53.750423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749081+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:09:53.749081+0000","last_peered":"2024-09-12T22:09:53.749081+0000","last_clean":"2024-09-12T22:09:53.749081+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:09:53.749081+0000","last_undegraded":"2024-09-12T22:09:53.749081+0000","last_fullsized":"2024-09-12T22:09:53.749081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749634+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:09:53.749634+0000","last_peered":"2024-09-12T22:09:53.749634+0000","last_clean":"2024-09-12T22:09:53.749634+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:09:53.749634+0000","last_undegraded":"2024-09-12T22:09:53.749634+0000","last_fullsized":"2024-09-12T22:09:53.749634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750221+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:09:53.750221+0000","last_peered":"2024-09-12T22:09:53.750221+0000","last_clean":"2024-09-12T22:09:53.750221+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:09:53.750221+0000","last_undegraded":"2024-09-12T22:09:53.750221+0000","last_fullsized":"2024-09-12T22:09:53.750221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750007+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:09:53.750007+0000","last_peered":"2024-09-12T22:09:53.750007+0000","last_clean":"2024-09-12T22:09:53.750007+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:09:53.750007+0000","last_undegraded":"2024-09-12T22:09:53.750007+0000","last_fullsized":"2024-09-12T22:09:53.750007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750743+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:09:53.750743+0000","last_peered":"2024-09-12T22:09:53.750743+0000","last_clean":"2024-09-12T22:09:53.750743+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:09:53.750743+0000","last_undegraded":"2024-09-12T22:09:53.750743+0000","last_fullsized":"2024-09-12T22:09:53.750743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749327+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:09:53.749327+0000","last_peered":"2024-09-12T22:09:53.749327+0000","last_clean":"2024-09-12T22:09:53.749327+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:09:53.749327+0000","last_undegraded":"2024-09-12T22:09:53.749327+0000","last_fullsized":"2024-09-12T22:09:53.749327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750671+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:09:53.750671+0000","last_peered":"2024-09-12T22:09:53.750671+0000","last_clean":"2024-09-12T22:09:53.750671+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:09:53.750671+0000","last_undegraded":"2024-09-12T22:09:53.750671+0000","last_fullsized":"2024-09-12T22:09:53.750671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749007+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:09:53.749007+0000","last_peered":"2024-09-12T22:09:53.749007+0000","last_clean":"2024-09-12T22:09:53.749007+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:09:53.749007+0000","last_undegraded":"2024-09-12T22:09:53.749007+0000","last_fullsized":"2024-09-12T22:09:53.749007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749791+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:09:53.749791+0000","last_peered":"2024-09-12T22:09:53.749791+0000","last_clean":"2024-09-12T22:09:53.749791+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:09:53.749791+0000","last_undegraded":"2024-09-12T22:09:53.749791+0000","last_fullsized":"2024-09-12T22:09:53.749791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749768+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:53.749768+0000","last_peered":"2024-09-12T22:09:53.749768+0000","last_clean":"2024-09-12T22:09:53.749768+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:53.749768+0000","last_undegraded":"2024-09-12T22:09:53.749768+0000","last_fullsized":"2024-09-12T22:09:53.749768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750374+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:53.750374+0000","last_peered":"2024-09-12T22:09:53.750374+0000","last_clean":"2024-09-12T22:09:53.750374+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:53.750374+0000","last_undegraded":"2024-09-12T22:09:53.750374+0000","last_fullsized":"2024-09-12T22:09:53.750374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749291+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:09:53.749291+0000","last_peered":"2024-09-12T22:09:53.749291+0000","last_clean":"2024-09-12T22:09:53.749291+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:09:53.749291+0000","last_undegraded":"2024-09-12T22:09:53.749291+0000","last_fullsized":"2024-09-12T22:09:53.749291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750817+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:09:53.750817+0000","last_peered":"2024-09-12T22:09:53.750817+0000","last_clean":"2024-09-12T22:09:53.750817+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:09:53.750817+0000","last_undegraded":"2024-09-12T22:09:53.750817+0000","last_fullsized":"2024-09-12T22:09:53.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749794+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:53.749794+0000","last_peered":"2024-09-12T22:09:53.749794+0000","last_clean":"2024-09-12T22:09:53.749794+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:53.749794+0000","last_undegraded":"2024-09-12T22:09:53.749794+0000","last_fullsized":"2024-09-12T22:09:53.749794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749238+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:09:53.749238+0000","last_peered":"2024-09-12T22:09:53.749238+0000","last_clean":"2024-09-12T22:09:53.749238+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:09:53.749238+0000","last_undegraded":"2024-09-12T22:09:53.749238+0000","last_fullsized":"2024-09-12T22:09:53.749238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750000+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:09:53.750000+0000","last_peered":"2024-09-12T22:09:53.750000+0000","last_clean":"2024-09-12T22:09:53.750000+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:09:53.750000+0000","last_undegraded":"2024-09-12T22:09:53.750000+0000","last_fullsized":"2024-09-12T22:09:53.750000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749507+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:53.749507+0000","last_peered":"2024-09-12T22:09:53.749507+0000","last_clean":"2024-09-12T22:09:53.749507+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:53.749507+0000","last_undegraded":"2024-09-12T22:09:53.749507+0000","last_fullsized":"2024-09-12T22:09:53.749507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749111+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:09:53.749111+0000","last_peered":"2024-09-12T22:09:53.749111+0000","last_clean":"2024-09-12T22:09:53.749111+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:09:53.749111+0000","last_undegraded":"2024-09-12T22:09:53.749111+0000","last_fullsized":"2024-09-12T22:09:53.749111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749820+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:09:53.749820+0000","last_peered":"2024-09-12T22:09:53.749820+0000","last_clean":"2024-09-12T22:09:53.749820+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:09:53.749820+0000","last_undegraded":"2024-09-12T22:09:53.749820+0000","last_fullsized":"2024-09-12T22:09:53.749820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750106+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:53.750106+0000","last_peered":"2024-09-12T22:09:53.750106+0000","last_clean":"2024-09-12T22:09:53.750106+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:53.750106+0000","last_undegraded":"2024-09-12T22:09:53.750106+0000","last_fullsized":"2024-09-12T22:09:53.750106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750197+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:09:53.750197+0000","last_peered":"2024-09-12T22:09:53.750197+0000","last_clean":"2024-09-12T22:09:53.750197+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:09:53.750197+0000","last_undegraded":"2024-09-12T22:09:53.750197+0000","last_fullsized":"2024-09-12T22:09:53.750197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749361+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:09:53.749361+0000","last_peered":"2024-09-12T22:09:53.749361+0000","last_clean":"2024-09-12T22:09:53.749361+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:09:53.749361+0000","last_undegraded":"2024-09-12T22:09:53.749361+0000","last_fullsized":"2024-09-12T22:09:53.749361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750864+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:09:53.750864+0000","last_peered":"2024-09-12T22:09:53.750864+0000","last_clean":"2024-09-12T22:09:53.750864+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:09:53.750864+0000","last_undegraded":"2024-09-12T22:09:53.750864+0000","last_fullsized":"2024-09-12T22:09:53.750864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749640+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:53.749640+0000","last_peered":"2024-09-12T22:09:53.749640+0000","last_clean":"2024-09-12T22:09:53.749640+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:53.749640+0000","last_undegraded":"2024-09-12T22:09:53.749640+0000","last_fullsized":"2024-09-12T22:09:53.749640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749568+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:09:53.749568+0000","last_peered":"2024-09-12T22:09:53.749568+0000","last_clean":"2024-09-12T22:09:53.749568+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:09:53.749568+0000","last_undegraded":"2024-09-12T22:09:53.749568+0000","last_fullsized":"2024-09-12T22:09:53.749568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749527+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:09:53.749527+0000","last_peered":"2024-09-12T22:09:53.749527+0000","last_clean":"2024-09-12T22:09:53.749527+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:09:53.749527+0000","last_undegraded":"2024-09-12T22:09:53.749527+0000","last_fullsized":"2024-09-12T22:09:53.749527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750254+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:53.750254+0000","last_peered":"2024-09-12T22:09:53.750254+0000","last_clean":"2024-09-12T22:09:53.750254+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:53.750254+0000","last_undegraded":"2024-09-12T22:09:53.750254+0000","last_fullsized":"2024-09-12T22:09:53.750254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749473+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:09:53.749473+0000","last_peered":"2024-09-12T22:09:53.749473+0000","last_clean":"2024-09-12T22:09:53.749473+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:09:53.749473+0000","last_undegraded":"2024-09-12T22:09:53.749473+0000","last_fullsized":"2024-09-12T22:09:53.749473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750097+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:09:53.750097+0000","last_peered":"2024-09-12T22:09:53.750097+0000","last_clean":"2024-09-12T22:09:53.750097+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:09:53.750097+0000","last_undegraded":"2024-09-12T22:09:53.750097+0000","last_fullsized":"2024-09-12T22:09:53.750097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750040+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:53.750040+0000","last_peered":"2024-09-12T22:09:53.750040+0000","last_clean":"2024-09-12T22:09:53.750040+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:53.750040+0000","last_undegraded":"2024-09-12T22:09:53.750040+0000","last_fullsized":"2024-09-12T22:09:53.750040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749990+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:09:53.749990+0000","last_peered":"2024-09-12T22:09:53.749990+0000","last_clean":"2024-09-12T22:09:53.749990+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:09:53.749990+0000","last_undegraded":"2024-09-12T22:09:53.749990+0000","last_fullsized":"2024-09-12T22:09:53.749990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750937+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:53.750937+0000","last_peered":"2024-09-12T22:09:53.750937+0000","last_clean":"2024-09-12T22:09:53.750937+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:53.750937+0000","last_undegraded":"2024-09-12T22:09:53.750937+0000","last_fullsized":"2024-09-12T22:09:53.750937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749167+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:09:53.749167+0000","last_peered":"2024-09-12T22:09:53.749167+0000","last_clean":"2024-09-12T22:09:53.749167+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:09:53.749167+0000","last_undegraded":"2024-09-12T22:09:53.749167+0000","last_fullsized":"2024-09-12T22:09:53.749167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750122+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:09:53.750122+0000","last_peered":"2024-09-12T22:09:53.750122+0000","last_clean":"2024-09-12T22:09:53.750122+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:09:53.750122+0000","last_undegraded":"2024-09-12T22:09:53.750122+0000","last_fullsized":"2024-09-12T22:09:53.750122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750372+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:09:53.750372+0000","last_peered":"2024-09-12T22:09:53.750372+0000","last_clean":"2024-09-12T22:09:53.750372+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:09:53.750372+0000","last_undegraded":"2024-09-12T22:09:53.750372+0000","last_fullsized":"2024-09-12T22:09:53.750372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749023+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:09:53.749023+0000","last_peered":"2024-09-12T22:09:53.749023+0000","last_clean":"2024-09-12T22:09:53.749023+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:09:53.749023+0000","last_undegraded":"2024-09-12T22:09:53.749023+0000","last_fullsized":"2024-09-12T22:09:53.749023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750174+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:09:53.750174+0000","last_peered":"2024-09-12T22:09:53.750174+0000","last_clean":"2024-09-12T22:09:53.750174+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:09:53.750174+0000","last_undegraded":"2024-09-12T22:09:53.750174+0000","last_fullsized":"2024-09-12T22:09:53.750174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750667+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:09:53.750667+0000","last_peered":"2024-09-12T22:09:53.750667+0000","last_clean":"2024-09-12T22:09:53.750667+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:09:53.750667+0000","last_undegraded":"2024-09-12T22:09:53.750667+0000","last_fullsized":"2024-09-12T22:09:53.750667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748940+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:09:53.748940+0000","last_peered":"2024-09-12T22:09:53.748940+0000","last_clean":"2024-09-12T22:09:53.748940+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:09:53.748940+0000","last_undegraded":"2024-09-12T22:09:53.748940+0000","last_fullsized":"2024-09-12T22:09:53.748940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749960+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:09:53.749960+0000","last_peered":"2024-09-12T22:09:53.749960+0000","last_clean":"2024-09-12T22:09:53.749960+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:09:53.749960+0000","last_undegraded":"2024-09-12T22:09:53.749960+0000","last_fullsized":"2024-09-12T22:09:53.749960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750337+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:09:53.750337+0000","last_peered":"2024-09-12T22:09:53.750337+0000","last_clean":"2024-09-12T22:09:53.750337+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:09:53.750337+0000","last_undegraded":"2024-09-12T22:09:53.750337+0000","last_fullsized":"2024-09-12T22:09:53.750337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748927+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:09:53.748927+0000","last_peered":"2024-09-12T22:09:53.748927+0000","last_clean":"2024-09-12T22:09:53.748927+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:09:53.748927+0000","last_undegraded":"2024-09-12T22:09:53.748927+0000","last_fullsized":"2024-09-12T22:09:53.748927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749615+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:09:53.749615+0000","last_peered":"2024-09-12T22:09:53.749615+0000","last_clean":"2024-09-12T22:09:53.749615+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:09:53.749615+0000","last_undegraded":"2024-09-12T22:09:53.749615+0000","last_fullsized":"2024-09-12T22:09:53.749615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749070+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:09:53.749070+0000","last_peered":"2024-09-12T22:09:53.749070+0000","last_clean":"2024-09-12T22:09:53.749070+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:09:53.749070+0000","last_undegraded":"2024-09-12T22:09:53.749070+0000","last_fullsized":"2024-09-12T22:09:53.749070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749881+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:09:53.749881+0000","last_peered":"2024-09-12T22:09:53.749881+0000","last_clean":"2024-09-12T22:09:53.749881+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:09:53.749881+0000","last_undegraded":"2024-09-12T22:09:53.749881+0000","last_fullsized":"2024-09-12T22:09:53.749881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749463+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:09:53.749463+0000","last_peered":"2024-09-12T22:09:53.749463+0000","last_clean":"2024-09-12T22:09:53.749463+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:09:53.749463+0000","last_undegraded":"2024-09-12T22:09:53.749463+0000","last_fullsized":"2024-09-12T22:09:53.749463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749643+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:09:53.749643+0000","last_peered":"2024-09-12T22:09:53.749643+0000","last_clean":"2024-09-12T22:09:53.749643+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:09:53.749643+0000","last_undegraded":"2024-09-12T22:09:53.749643+0000","last_fullsized":"2024-09-12T22:09:53.749643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749562+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:09:53.749562+0000","last_peered":"2024-09-12T22:09:53.749562+0000","last_clean":"2024-09-12T22:09:53.749562+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:09:53.749562+0000","last_undegraded":"2024-09-12T22:09:53.749562+0000","last_fullsized":"2024-09-12T22:09:53.749562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750238+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:09:53.750238+0000","last_peered":"2024-09-12T22:09:53.750238+0000","last_clean":"2024-09-12T22:09:53.750238+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:09:53.750238+0000","last_undegraded":"2024-09-12T22:09:53.750238+0000","last_fullsized":"2024-09-12T22:09:53.750238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749930+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:09:53.749930+0000","last_peered":"2024-09-12T22:09:53.749930+0000","last_clean":"2024-09-12T22:09:53.749930+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:09:53.749930+0000","last_undegraded":"2024-09-12T22:09:53.749930+0000","last_fullsized":"2024-09-12T22:09:53.749930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750002+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:09:53.750002+0000","last_peered":"2024-09-12T22:09:53.750002+0000","last_clean":"2024-09-12T22:09:53.750002+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:09:53.750002+0000","last_undegraded":"2024-09-12T22:09:53.750002+0000","last_fullsized":"2024-09-12T22:09:53.750002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749490+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:09:53.749490+0000","last_peered":"2024-09-12T22:09:53.749490+0000","last_clean":"2024-09-12T22:09:53.749490+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:09:53.749490+0000","last_undegraded":"2024-09-12T22:09:53.749490+0000","last_fullsized":"2024-09-12T22:09:53.749490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749863+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:09:53.749863+0000","last_peered":"2024-09-12T22:09:53.749863+0000","last_clean":"2024-09-12T22:09:53.749863+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:09:53.749863+0000","last_undegraded":"2024-09-12T22:09:53.749863+0000","last_fullsized":"2024-09-12T22:09:53.749863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749656+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:09:53.749656+0000","last_peered":"2024-09-12T22:09:53.749656+0000","last_clean":"2024-09-12T22:09:53.749656+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:09:53.749656+0000","last_undegraded":"2024-09-12T22:09:53.749656+0000","last_fullsized":"2024-09-12T22:09:53.749656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749951+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:09:53.749951+0000","last_peered":"2024-09-12T22:09:53.749951+0000","last_clean":"2024-09-12T22:09:53.749951+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:09:53.749951+0000","last_undegraded":"2024-09-12T22:09:53.749951+0000","last_fullsized":"2024-09-12T22:09:53.749951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:10:01.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:10:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:02.234 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:10:02.243 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T22:10:01.069413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.103995"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750001+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:09:53.750001+0000","last_peered":"2024-09-12T22:09:53.750001+0000","last_clean":"2024-09-12T22:09:53.750001+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:09:53.750001+0000","last_undegraded":"2024-09-12T22:09:53.750001+0000","last_fullsized":"2024-09-12T22:09:53.750001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749767+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:09:53.749767+0000","last_peered":"2024-09-12T22:09:53.749767+0000","last_clean":"2024-09-12T22:09:53.749767+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:09:53.749767+0000","last_undegraded":"2024-09-12T22:09:53.749767+0000","last_fullsized":"2024-09-12T22:09:53.749767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750605+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:09:53.750605+0000","last_peered":"2024-09-12T22:09:53.750605+0000","last_clean":"2024-09-12T22:09:53.750605+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:09:53.750605+0000","last_undegraded":"2024-09-12T22:09:53.750605+0000","last_fullsized":"2024-09-12T22:09:53.750605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749637+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:09:53.749637+0000","last_peered":"2024-09-12T22:09:53.749637+0000","last_clean":"2024-09-12T22:09:53.749637+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:09:53.749637+0000","last_undegraded":"2024-09-12T22:09:53.749637+0000","last_fullsized":"2024-09-12T22:09:53.749637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749717+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:09:53.749717+0000","last_peered":"2024-09-12T22:09:53.749717+0000","last_clean":"2024-09-12T22:09:53.749717+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:09:53.749717+0000","last_undegraded":"2024-09-12T22:09:53.749717+0000","last_fullsized":"2024-09-12T22:09:53.749717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749658+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:09:53.749658+0000","last_peered":"2024-09-12T22:09:53.749658+0000","last_clean":"2024-09-12T22:09:53.749658+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:09:53.749658+0000","last_undegraded":"2024-09-12T22:09:53.749658+0000","last_fullsized":"2024-09-12T22:09:53.749658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749412+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:09:53.749412+0000","last_peered":"2024-09-12T22:09:53.749412+0000","last_clean":"2024-09-12T22:09:53.749412+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:09:53.749412+0000","last_undegraded":"2024-09-12T22:09:53.749412+0000","last_fullsized":"2024-09-12T22:09:53.749412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749670+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:09:53.749670+0000","last_peered":"2024-09-12T22:09:53.749670+0000","last_clean":"2024-09-12T22:09:53.749670+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:09:53.749670+0000","last_undegraded":"2024-09-12T22:09:53.749670+0000","last_fullsized":"2024-09-12T22:09:53.749670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749859+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:09:53.749859+0000","last_peered":"2024-09-12T22:09:53.749859+0000","last_clean":"2024-09-12T22:09:53.749859+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:09:53.749859+0000","last_undegraded":"2024-09-12T22:09:53.749859+0000","last_fullsized":"2024-09-12T22:09:53.749859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750477+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:09:53.750477+0000","last_peered":"2024-09-12T22:09:53.750477+0000","last_clean":"2024-09-12T22:09:53.750477+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:09:53.750477+0000","last_undegraded":"2024-09-12T22:09:53.750477+0000","last_fullsized":"2024-09-12T22:09:53.750477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749676+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:09:53.749676+0000","last_peered":"2024-09-12T22:09:53.749676+0000","last_clean":"2024-09-12T22:09:53.749676+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:09:53.749676+0000","last_undegraded":"2024-09-12T22:09:53.749676+0000","last_fullsized":"2024-09-12T22:09:53.749676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749472+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:09:53.749472+0000","last_peered":"2024-09-12T22:09:53.749472+0000","last_clean":"2024-09-12T22:09:53.749472+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:09:53.749472+0000","last_undegraded":"2024-09-12T22:09:53.749472+0000","last_fullsized":"2024-09-12T22:09:53.749472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749748+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:09:53.749748+0000","last_peered":"2024-09-12T22:09:53.749748+0000","last_clean":"2024-09-12T22:09:53.749748+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:09:53.749748+0000","last_undegraded":"2024-09-12T22:09:53.749748+0000","last_fullsized":"2024-09-12T22:09:53.749748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749709+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:09:53.749709+0000","last_peered":"2024-09-12T22:09:53.749709+0000","last_clean":"2024-09-12T22:09:53.749709+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:09:53.749709+0000","last_undegraded":"2024-09-12T22:09:53.749709+0000","last_fullsized":"2024-09-12T22:09:53.749709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749470+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:09:53.749470+0000","last_peered":"2024-09-12T22:09:53.749470+0000","last_clean":"2024-09-12T22:09:53.749470+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:09:53.749470+0000","last_undegraded":"2024-09-12T22:09:53.749470+0000","last_fullsized":"2024-09-12T22:09:53.749470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750125+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:09:53.750125+0000","last_peered":"2024-09-12T22:09:53.750125+0000","last_clean":"2024-09-12T22:09:53.750125+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:09:53.750125+0000","last_undegraded":"2024-09-12T22:09:53.750125+0000","last_fullsized":"2024-09-12T22:09:53.750125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750087+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:09:53.750087+0000","last_peered":"2024-09-12T22:09:53.750087+0000","last_clean":"2024-09-12T22:09:53.750087+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:09:53.750087+0000","last_undegraded":"2024-09-12T22:09:53.750087+0000","last_fullsized":"2024-09-12T22:09:53.750087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749423+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:09:53.749423+0000","last_peered":"2024-09-12T22:09:53.749423+0000","last_clean":"2024-09-12T22:09:53.749423+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:09:53.749423+0000","last_undegraded":"2024-09-12T22:09:53.749423+0000","last_fullsized":"2024-09-12T22:09:53.749423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750165+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:09:53.750165+0000","last_peered":"2024-09-12T22:09:53.750165+0000","last_clean":"2024-09-12T22:09:53.750165+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:09:53.750165+0000","last_undegraded":"2024-09-12T22:09:53.750165+0000","last_fullsized":"2024-09-12T22:09:53.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750012+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:09:53.750012+0000","last_peered":"2024-09-12T22:09:53.750012+0000","last_clean":"2024-09-12T22:09:53.750012+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:09:53.750012+0000","last_undegraded":"2024-09-12T22:09:53.750012+0000","last_fullsized":"2024-09-12T22:09:53.750012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749271+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:09:53.749271+0000","last_peered":"2024-09-12T22:09:53.749271+0000","last_clean":"2024-09-12T22:09:53.749271+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:09:53.749271+0000","last_undegraded":"2024-09-12T22:09:53.749271+0000","last_fullsized":"2024-09-12T22:09:53.749271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748773+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:09:53.748773+0000","last_peered":"2024-09-12T22:09:53.748773+0000","last_clean":"2024-09-12T22:09:53.748773+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:09:53.748773+0000","last_undegraded":"2024-09-12T22:09:53.748773+0000","last_fullsized":"2024-09-12T22:09:53.748773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748970+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:09:53.748970+0000","last_peered":"2024-09-12T22:09:53.748970+0000","last_clean":"2024-09-12T22:09:53.748970+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:09:53.748970+0000","last_undegraded":"2024-09-12T22:09:53.748970+0000","last_fullsized":"2024-09-12T22:09:53.748970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750109+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:09:53.750109+0000","last_peered":"2024-09-12T22:09:53.750109+0000","last_clean":"2024-09-12T22:09:53.750109+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:09:53.750109+0000","last_undegraded":"2024-09-12T22:09:53.750109+0000","last_fullsized":"2024-09-12T22:09:53.750109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749671+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:09:53.749671+0000","last_peered":"2024-09-12T22:09:53.749671+0000","last_clean":"2024-09-12T22:09:53.749671+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:09:53.749671+0000","last_undegraded":"2024-09-12T22:09:53.749671+0000","last_fullsized":"2024-09-12T22:09:53.749671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750625+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:09:53.750625+0000","last_peered":"2024-09-12T22:09:53.750625+0000","last_clean":"2024-09-12T22:09:53.750625+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:09:53.750625+0000","last_undegraded":"2024-09-12T22:09:53.750625+0000","last_fullsized":"2024-09-12T22:09:53.750625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749979+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:09:53.749979+0000","last_peered":"2024-09-12T22:09:53.749979+0000","last_clean":"2024-09-12T22:09:53.749979+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:09:53.749979+0000","last_undegraded":"2024-09-12T22:09:53.749979+0000","last_fullsized":"2024-09-12T22:09:53.749979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749252+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:09:53.749252+0000","last_peered":"2024-09-12T22:09:53.749252+0000","last_clean":"2024-09-12T22:09:53.749252+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:09:53.749252+0000","last_undegraded":"2024-09-12T22:09:53.749252+0000","last_fullsized":"2024-09-12T22:09:53.749252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749388+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:09:53.749388+0000","last_peered":"2024-09-12T22:09:53.749388+0000","last_clean":"2024-09-12T22:09:53.749388+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:09:53.749388+0000","last_undegraded":"2024-09-12T22:09:53.749388+0000","last_fullsized":"2024-09-12T22:09:53.749388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748833+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:09:53.748833+0000","last_peered":"2024-09-12T22:09:53.748833+0000","last_clean":"2024-09-12T22:09:53.748833+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:09:53.748833+0000","last_undegraded":"2024-09-12T22:09:53.748833+0000","last_fullsized":"2024-09-12T22:09:53.748833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749543+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:09:53.749543+0000","last_peered":"2024-09-12T22:09:53.749543+0000","last_clean":"2024-09-12T22:09:53.749543+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:09:53.749543+0000","last_undegraded":"2024-09-12T22:09:53.749543+0000","last_fullsized":"2024-09-12T22:09:53.749543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749826+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:09:53.749826+0000","last_peered":"2024-09-12T22:09:53.749826+0000","last_clean":"2024-09-12T22:09:53.749826+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:09:53.749826+0000","last_undegraded":"2024-09-12T22:09:53.749826+0000","last_fullsized":"2024-09-12T22:09:53.749826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750152+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:09:53.750152+0000","last_peered":"2024-09-12T22:09:53.750152+0000","last_clean":"2024-09-12T22:09:53.750152+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:09:53.750152+0000","last_undegraded":"2024-09-12T22:09:53.750152+0000","last_fullsized":"2024-09-12T22:09:53.750152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749939+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:09:53.749939+0000","last_peered":"2024-09-12T22:09:53.749939+0000","last_clean":"2024-09-12T22:09:53.749939+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:09:53.749939+0000","last_undegraded":"2024-09-12T22:09:53.749939+0000","last_fullsized":"2024-09-12T22:09:53.749939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749125+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:09:53.749125+0000","last_peered":"2024-09-12T22:09:53.749125+0000","last_clean":"2024-09-12T22:09:53.749125+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:09:53.749125+0000","last_undegraded":"2024-09-12T22:09:53.749125+0000","last_fullsized":"2024-09-12T22:09:53.749125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749973+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:09:53.749973+0000","last_peered":"2024-09-12T22:09:53.749973+0000","last_clean":"2024-09-12T22:09:53.749973+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:09:53.749973+0000","last_undegraded":"2024-09-12T22:09:53.749973+0000","last_fullsized":"2024-09-12T22:09:53.749973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749274+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:09:53.749274+0000","last_peered":"2024-09-12T22:09:53.749274+0000","last_clean":"2024-09-12T22:09:53.749274+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:09:53.749274+0000","last_undegraded":"2024-09-12T22:09:53.749274+0000","last_fullsized":"2024-09-12T22:09:53.749274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749707+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:09:53.749707+0000","last_peered":"2024-09-12T22:09:53.749707+0000","last_clean":"2024-09-12T22:09:53.749707+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:09:53.749707+0000","last_undegraded":"2024-09-12T22:09:53.749707+0000","last_fullsized":"2024-09-12T22:09:53.749707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749535+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:09:53.749535+0000","last_peered":"2024-09-12T22:09:53.749535+0000","last_clean":"2024-09-12T22:09:53.749535+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:09:53.749535+0000","last_undegraded":"2024-09-12T22:09:53.749535+0000","last_fullsized":"2024-09-12T22:09:53.749535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750865+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:09:53.750865+0000","last_peered":"2024-09-12T22:09:53.750865+0000","last_clean":"2024-09-12T22:09:53.750865+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:09:53.750865+0000","last_undegraded":"2024-09-12T22:09:53.750865+0000","last_fullsized":"2024-09-12T22:09:53.750865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749054+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:09:53.749054+0000","last_peered":"2024-09-12T22:09:53.749054+0000","last_clean":"2024-09-12T22:09:53.749054+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:09:53.749054+0000","last_undegraded":"2024-09-12T22:09:53.749054+0000","last_fullsized":"2024-09-12T22:09:53.749054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750059+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:09:53.750059+0000","last_peered":"2024-09-12T22:09:53.750059+0000","last_clean":"2024-09-12T22:09:53.750059+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:09:53.750059+0000","last_undegraded":"2024-09-12T22:09:53.750059+0000","last_fullsized":"2024-09-12T22:09:53.750059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749185+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:09:53.749185+0000","last_peered":"2024-09-12T22:09:53.749185+0000","last_clean":"2024-09-12T22:09:53.749185+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:09:53.749185+0000","last_undegraded":"2024-09-12T22:09:53.749185+0000","last_fullsized":"2024-09-12T22:09:53.749185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750809+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:09:53.750809+0000","last_peered":"2024-09-12T22:09:53.750809+0000","last_clean":"2024-09-12T22:09:53.750809+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:09:53.750809+0000","last_undegraded":"2024-09-12T22:09:53.750809+0000","last_fullsized":"2024-09-12T22:09:53.750809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749978+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:09:53.749978+0000","last_peered":"2024-09-12T22:09:53.749978+0000","last_clean":"2024-09-12T22:09:53.749978+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:09:53.749978+0000","last_undegraded":"2024-09-12T22:09:53.749978+0000","last_fullsized":"2024-09-12T22:09:53.749978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750423+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:09:53.750423+0000","last_peered":"2024-09-12T22:09:53.750423+0000","last_clean":"2024-09-12T22:09:53.750423+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:09:53.750423+0000","last_undegraded":"2024-09-12T22:09:53.750423+0000","last_fullsized":"2024-09-12T22:09:53.750423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749081+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:09:53.749081+0000","last_peered":"2024-09-12T22:09:53.749081+0000","last_clean":"2024-09-12T22:09:53.749081+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:09:53.749081+0000","last_undegraded":"2024-09-12T22:09:53.749081+0000","last_fullsized":"2024-09-12T22:09:53.749081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749634+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:09:53.749634+0000","last_peered":"2024-09-12T22:09:53.749634+0000","last_clean":"2024-09-12T22:09:53.749634+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:09:53.749634+0000","last_undegraded":"2024-09-12T22:09:53.749634+0000","last_fullsized":"2024-09-12T22:09:53.749634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750221+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:09:53.750221+0000","last_peered":"2024-09-12T22:09:53.750221+0000","last_clean":"2024-09-12T22:09:53.750221+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:09:53.750221+0000","last_undegraded":"2024-09-12T22:09:53.750221+0000","last_fullsized":"2024-09-12T22:09:53.750221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750007+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:09:53.750007+0000","last_peered":"2024-09-12T22:09:53.750007+0000","last_clean":"2024-09-12T22:09:53.750007+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:09:53.750007+0000","last_undegraded":"2024-09-12T22:09:53.750007+0000","last_fullsized":"2024-09-12T22:09:53.750007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750743+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:09:53.750743+0000","last_peered":"2024-09-12T22:09:53.750743+0000","last_clean":"2024-09-12T22:09:53.750743+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:09:53.750743+0000","last_undegraded":"2024-09-12T22:09:53.750743+0000","last_fullsized":"2024-09-12T22:09:53.750743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749327+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:09:53.749327+0000","last_peered":"2024-09-12T22:09:53.749327+0000","last_clean":"2024-09-12T22:09:53.749327+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:09:53.749327+0000","last_undegraded":"2024-09-12T22:09:53.749327+0000","last_fullsized":"2024-09-12T22:09:53.749327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750671+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:09:53.750671+0000","last_peered":"2024-09-12T22:09:53.750671+0000","last_clean":"2024-09-12T22:09:53.750671+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:09:53.750671+0000","last_undegraded":"2024-09-12T22:09:53.750671+0000","last_fullsized":"2024-09-12T22:09:53.750671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749007+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:09:53.749007+0000","last_peered":"2024-09-12T22:09:53.749007+0000","last_clean":"2024-09-12T22:09:53.749007+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:09:53.749007+0000","last_undegraded":"2024-09-12T22:09:53.749007+0000","last_fullsized":"2024-09-12T22:09:53.749007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749791+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:09:53.749791+0000","last_peered":"2024-09-12T22:09:53.749791+0000","last_clean":"2024-09-12T22:09:53.749791+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:09:53.749791+0000","last_undegraded":"2024-09-12T22:09:53.749791+0000","last_fullsized":"2024-09-12T22:09:53.749791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749768+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:53.749768+0000","last_peered":"2024-09-12T22:09:53.749768+0000","last_clean":"2024-09-12T22:09:53.749768+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:53.749768+0000","last_undegraded":"2024-09-12T22:09:53.749768+0000","last_fullsized":"2024-09-12T22:09:53.749768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750374+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:53.750374+0000","last_peered":"2024-09-12T22:09:53.750374+0000","last_clean":"2024-09-12T22:09:53.750374+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:53.750374+0000","last_undegraded":"2024-09-12T22:09:53.750374+0000","last_fullsized":"2024-09-12T22:09:53.750374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749291+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:09:53.749291+0000","last_peered":"2024-09-12T22:09:53.749291+0000","last_clean":"2024-09-12T22:09:53.749291+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:09:53.749291+0000","last_undegraded":"2024-09-12T22:09:53.749291+0000","last_fullsized":"2024-09-12T22:09:53.749291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750817+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:09:53.750817+0000","last_peered":"2024-09-12T22:09:53.750817+0000","last_clean":"2024-09-12T22:09:53.750817+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:09:53.750817+0000","last_undegraded":"2024-09-12T22:09:53.750817+0000","last_fullsized":"2024-09-12T22:09:53.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749794+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:53.749794+0000","last_peered":"2024-09-12T22:09:53.749794+0000","last_clean":"2024-09-12T22:09:53.749794+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:53.749794+0000","last_undegraded":"2024-09-12T22:09:53.749794+0000","last_fullsized":"2024-09-12T22:09:53.749794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749238+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:09:53.749238+0000","last_peered":"2024-09-12T22:09:53.749238+0000","last_clean":"2024-09-12T22:09:53.749238+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:09:53.749238+0000","last_undegraded":"2024-09-12T22:09:53.749238+0000","last_fullsized":"2024-09-12T22:09:53.749238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750000+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:09:53.750000+0000","last_peered":"2024-09-12T22:09:53.750000+0000","last_clean":"2024-09-12T22:09:53.750000+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:09:53.750000+0000","last_undegraded":"2024-09-12T22:09:53.750000+0000","last_fullsized":"2024-09-12T22:09:53.750000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749507+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:53.749507+0000","last_peered":"2024-09-12T22:09:53.749507+0000","last_clean":"2024-09-12T22:09:53.749507+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:53.749507+0000","last_undegraded":"2024-09-12T22:09:53.749507+0000","last_fullsized":"2024-09-12T22:09:53.749507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749111+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:09:53.749111+0000","last_peered":"2024-09-12T22:09:53.749111+0000","last_clean":"2024-09-12T22:09:53.749111+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:09:53.749111+0000","last_undegraded":"2024-09-12T22:09:53.749111+0000","last_fullsized":"2024-09-12T22:09:53.749111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749820+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:09:53.749820+0000","last_peered":"2024-09-12T22:09:53.749820+0000","last_clean":"2024-09-12T22:09:53.749820+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:09:53.749820+0000","last_undegraded":"2024-09-12T22:09:53.749820+0000","last_fullsized":"2024-09-12T22:09:53.749820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750106+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:53.750106+0000","last_peered":"2024-09-12T22:09:53.750106+0000","last_clean":"2024-09-12T22:09:53.750106+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:53.750106+0000","last_undegraded":"2024-09-12T22:09:53.750106+0000","last_fullsized":"2024-09-12T22:09:53.750106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750197+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:09:53.750197+0000","last_peered":"2024-09-12T22:09:53.750197+0000","last_clean":"2024-09-12T22:09:53.750197+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:09:53.750197+0000","last_undegraded":"2024-09-12T22:09:53.750197+0000","last_fullsized":"2024-09-12T22:09:53.750197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749361+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:09:53.749361+0000","last_peered":"2024-09-12T22:09:53.749361+0000","last_clean":"2024-09-12T22:09:53.749361+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:09:53.749361+0000","last_undegraded":"2024-09-12T22:09:53.749361+0000","last_fullsized":"2024-09-12T22:09:53.749361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750864+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:09:53.750864+0000","last_peered":"2024-09-12T22:09:53.750864+0000","last_clean":"2024-09-12T22:09:53.750864+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:09:53.750864+0000","last_undegraded":"2024-09-12T22:09:53.750864+0000","last_fullsized":"2024-09-12T22:09:53.750864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749640+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:53.749640+0000","last_peered":"2024-09-12T22:09:53.749640+0000","last_clean":"2024-09-12T22:09:53.749640+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:53.749640+0000","last_undegraded":"2024-09-12T22:09:53.749640+0000","last_fullsized":"2024-09-12T22:09:53.749640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749568+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:09:53.749568+0000","last_peered":"2024-09-12T22:09:53.749568+0000","last_clean":"2024-09-12T22:09:53.749568+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:09:53.749568+0000","last_undegraded":"2024-09-12T22:09:53.749568+0000","last_fullsized":"2024-09-12T22:09:53.749568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749527+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:09:53.749527+0000","last_peered":"2024-09-12T22:09:53.749527+0000","last_clean":"2024-09-12T22:09:53.749527+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:09:53.749527+0000","last_undegraded":"2024-09-12T22:09:53.749527+0000","last_fullsized":"2024-09-12T22:09:53.749527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750254+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:53.750254+0000","last_peered":"2024-09-12T22:09:53.750254+0000","last_clean":"2024-09-12T22:09:53.750254+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:53.750254+0000","last_undegraded":"2024-09-12T22:09:53.750254+0000","last_fullsized":"2024-09-12T22:09:53.750254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749473+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:09:53.749473+0000","last_peered":"2024-09-12T22:09:53.749473+0000","last_clean":"2024-09-12T22:09:53.749473+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:09:53.749473+0000","last_undegraded":"2024-09-12T22:09:53.749473+0000","last_fullsized":"2024-09-12T22:09:53.749473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750097+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:09:53.750097+0000","last_peered":"2024-09-12T22:09:53.750097+0000","last_clean":"2024-09-12T22:09:53.750097+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:09:53.750097+0000","last_undegraded":"2024-09-12T22:09:53.750097+0000","last_fullsized":"2024-09-12T22:09:53.750097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750040+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:53.750040+0000","last_peered":"2024-09-12T22:09:53.750040+0000","last_clean":"2024-09-12T22:09:53.750040+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:53.750040+0000","last_undegraded":"2024-09-12T22:09:53.750040+0000","last_fullsized":"2024-09-12T22:09:53.750040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749990+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:09:53.749990+0000","last_peered":"2024-09-12T22:09:53.749990+0000","last_clean":"2024-09-12T22:09:53.749990+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:09:53.749990+0000","last_undegraded":"2024-09-12T22:09:53.749990+0000","last_fullsized":"2024-09-12T22:09:53.749990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750937+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:53.750937+0000","last_peered":"2024-09-12T22:09:53.750937+0000","last_clean":"2024-09-12T22:09:53.750937+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:53.750937+0000","last_undegraded":"2024-09-12T22:09:53.750937+0000","last_fullsized":"2024-09-12T22:09:53.750937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749167+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:09:53.749167+0000","last_peered":"2024-09-12T22:09:53.749167+0000","last_clean":"2024-09-12T22:09:53.749167+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:09:53.749167+0000","last_undegraded":"2024-09-12T22:09:53.749167+0000","last_fullsized":"2024-09-12T22:09:53.749167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750122+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:09:53.750122+0000","last_peered":"2024-09-12T22:09:53.750122+0000","last_clean":"2024-09-12T22:09:53.750122+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:09:53.750122+0000","last_undegraded":"2024-09-12T22:09:53.750122+0000","last_fullsized":"2024-09-12T22:09:53.750122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750372+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:09:53.750372+0000","last_peered":"2024-09-12T22:09:53.750372+0000","last_clean":"2024-09-12T22:09:53.750372+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:09:53.750372+0000","last_undegraded":"2024-09-12T22:09:53.750372+0000","last_fullsized":"2024-09-12T22:09:53.750372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749023+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:09:53.749023+0000","last_peered":"2024-09-12T22:09:53.749023+0000","last_clean":"2024-09-12T22:09:53.749023+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:09:53.749023+0000","last_undegraded":"2024-09-12T22:09:53.749023+0000","last_fullsized":"2024-09-12T22:09:53.749023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750174+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:09:53.750174+0000","last_peered":"2024-09-12T22:09:53.750174+0000","last_clean":"2024-09-12T22:09:53.750174+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:09:53.750174+0000","last_undegraded":"2024-09-12T22:09:53.750174+0000","last_fullsized":"2024-09-12T22:09:53.750174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750667+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:09:53.750667+0000","last_peered":"2024-09-12T22:09:53.750667+0000","last_clean":"2024-09-12T22:09:53.750667+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:09:53.750667+0000","last_undegraded":"2024-09-12T22:09:53.750667+0000","last_fullsized":"2024-09-12T22:09:53.750667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748940+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:09:53.748940+0000","last_peered":"2024-09-12T22:09:53.748940+0000","last_clean":"2024-09-12T22:09:53.748940+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:09:53.748940+0000","last_undegraded":"2024-09-12T22:09:53.748940+0000","last_fullsized":"2024-09-12T22:09:53.748940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749960+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:09:53.749960+0000","last_peered":"2024-09-12T22:09:53.749960+0000","last_clean":"2024-09-12T22:09:53.749960+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:09:53.749960+0000","last_undegraded":"2024-09-12T22:09:53.749960+0000","last_fullsized":"2024-09-12T22:09:53.749960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750337+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:09:53.750337+0000","last_peered":"2024-09-12T22:09:53.750337+0000","last_clean":"2024-09-12T22:09:53.750337+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:09:53.750337+0000","last_undegraded":"2024-09-12T22:09:53.750337+0000","last_fullsized":"2024-09-12T22:09:53.750337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748927+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:09:53.748927+0000","last_peered":"2024-09-12T22:09:53.748927+0000","last_clean":"2024-09-12T22:09:53.748927+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:09:53.748927+0000","last_undegraded":"2024-09-12T22:09:53.748927+0000","last_fullsized":"2024-09-12T22:09:53.748927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749615+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:09:53.749615+0000","last_peered":"2024-09-12T22:09:53.749615+0000","last_clean":"2024-09-12T22:09:53.749615+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:09:53.749615+0000","last_undegraded":"2024-09-12T22:09:53.749615+0000","last_fullsized":"2024-09-12T22:09:53.749615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749070+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:09:53.749070+0000","last_peered":"2024-09-12T22:09:53.749070+0000","last_clean":"2024-09-12T22:09:53.749070+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:09:53.749070+0000","last_undegraded":"2024-09-12T22:09:53.749070+0000","last_fullsized":"2024-09-12T22:09:53.749070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749881+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:09:53.749881+0000","last_peered":"2024-09-12T22:09:53.749881+0000","last_clean":"2024-09-12T22:09:53.749881+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:09:53.749881+0000","last_undegraded":"2024-09-12T22:09:53.749881+0000","last_fullsized":"2024-09-12T22:09:53.749881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749463+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:09:53.749463+0000","last_peered":"2024-09-12T22:09:53.749463+0000","last_clean":"2024-09-12T22:09:53.749463+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:09:53.749463+0000","last_undegraded":"2024-09-12T22:09:53.749463+0000","last_fullsized":"2024-09-12T22:09:53.749463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749643+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:09:53.749643+0000","last_peered":"2024-09-12T22:09:53.749643+0000","last_clean":"2024-09-12T22:09:53.749643+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:09:53.749643+0000","last_undegraded":"2024-09-12T22:09:53.749643+0000","last_fullsized":"2024-09-12T22:09:53.749643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749562+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:09:53.749562+0000","last_peered":"2024-09-12T22:09:53.749562+0000","last_clean":"2024-09-12T22:09:53.749562+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:09:53.749562+0000","last_undegraded":"2024-09-12T22:09:53.749562+0000","last_fullsized":"2024-09-12T22:09:53.749562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750238+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:09:53.750238+0000","last_peered":"2024-09-12T22:09:53.750238+0000","last_clean":"2024-09-12T22:09:53.750238+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:09:53.750238+0000","last_undegraded":"2024-09-12T22:09:53.750238+0000","last_fullsized":"2024-09-12T22:09:53.750238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749930+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:09:53.749930+0000","last_peered":"2024-09-12T22:09:53.749930+0000","last_clean":"2024-09-12T22:09:53.749930+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:09:53.749930+0000","last_undegraded":"2024-09-12T22:09:53.749930+0000","last_fullsized":"2024-09-12T22:09:53.749930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750002+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:09:53.750002+0000","last_peered":"2024-09-12T22:09:53.750002+0000","last_clean":"2024-09-12T22:09:53.750002+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:09:53.750002+0000","last_undegraded":"2024-09-12T22:09:53.750002+0000","last_fullsized":"2024-09-12T22:09:53.750002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749490+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:09:53.749490+0000","last_peered":"2024-09-12T22:09:53.749490+0000","last_clean":"2024-09-12T22:09:53.749490+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:09:53.749490+0000","last_undegraded":"2024-09-12T22:09:53.749490+0000","last_fullsized":"2024-09-12T22:09:53.749490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749863+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:09:53.749863+0000","last_peered":"2024-09-12T22:09:53.749863+0000","last_clean":"2024-09-12T22:09:53.749863+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:09:53.749863+0000","last_undegraded":"2024-09-12T22:09:53.749863+0000","last_fullsized":"2024-09-12T22:09:53.749863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749656+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:09:53.749656+0000","last_peered":"2024-09-12T22:09:53.749656+0000","last_clean":"2024-09-12T22:09:53.749656+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:09:53.749656+0000","last_undegraded":"2024-09-12T22:09:53.749656+0000","last_fullsized":"2024-09-12T22:09:53.749656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749951+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:09:53.749951+0000","last_peered":"2024-09-12T22:09:53.749951+0000","last_clean":"2024-09-12T22:09:53.749951+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:09:53.749951+0000","last_undegraded":"2024-09-12T22:09:53.749951+0000","last_fullsized":"2024-09-12T22:09:53.749951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:10:02.247 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:10:02.247 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T22:10:02.247 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T22:10:02.247 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T22:10:02.608 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:02.608 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T22:10:02.621 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T22:10:02.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:10:02.945 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:02.945 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:09:50.290318+0000","modified":"2024-09-12T22:09:52.306690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/363514776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":363514776},{"type":"v1","addr":"172.21.15.19:6803","nonce":363514776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-12T22:10:02.945 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:10:02.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:10:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:03.293 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:09:50.290318+0000","modified":"2024-09-12T22:09:52.306690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/363514776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":363514776},{"type":"v1","addr":"172.21.15.19:6803","nonce":363514776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-12T22:10:03.293 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:10:03.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:10:03.596 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:03.596 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:09:53.744997+0000","last_up_change":"2024-09-12T22:09:38.783190+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6801","nonce":2383753808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6803","nonce":2383753808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6807","nonce":2383753808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2383753808},{"type":"v1","addr":"172.21.15.164:6805","nonce":2383753808}]},"public_addr":"172.21.15.164:6801/2383753808","cluster_addr":"172.21.15.164:6803/2383753808","heartbeat_back_addr":"172.21.15.164:6807/2383753808","heartbeat_front_addr":"172.21.15.164:6805/2383753808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:10:03.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:10:03.932 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:03.932 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:09:50.290318+0000","modified":"2024-09-12T22:09:52.306690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/363514776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":363514776},{"type":"v1","addr":"172.21.15.19:6803","nonce":363514776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-12T22:10:03.932 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:10:04.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T22:09:50.290318+0000', 'modified': '2024-09-12T22:09:52.306690+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.19:6803/363514776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6802', 'nonce': 363514776}, {'type': 'v1', 'addr': '172.21.15.19:6803', 'nonce': 363514776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4204, 'qdb_cluster': [4204]} 2024-09-12T22:10:04.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T22:10:04.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T22:10:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:04.162+0000 7f9a1dffb640 0 client.4524 ms_handle_reset on v2:172.21.15.19:6802/363514776 2024-09-12T22:10:04.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:04.184+0000 7f9a1dffb640 0 client.4393 ms_handle_reset on v2:172.21.15.19:6802/363514776 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "2fe6789e-9afe-4094-9a02-5d2cb3971ecc", 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4204, 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 13.235902297999999, 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 5, 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 20, 2024-09-12T22:10:04.186 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 19, 2024-09-12T22:10:04.187 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 16.259645549999998 2024-09-12T22:10:04.187 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:10:04.197 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T22:10:04.208 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T22:10:04.208 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-12T22:10:04.208 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T22:10:04.208 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T22:10:04.208 DEBUG:teuthology.orchestra.run.smithi019:> sync 2024-09-12T22:10:04.321 DEBUG:teuthology.orchestra.run.smithi107:> sync 2024-09-12T22:10:04.484 DEBUG:teuthology.orchestra.run.smithi148:> sync 2024-09-12T22:10:04.649 DEBUG:teuthology.orchestra.run.smithi164:> sync 2024-09-12T22:10:04.704 DEBUG:tasks.thrashosds:checking console status of smithi019 2024-09-12T22:10:04.704 DEBUG:teuthology.orchestra.console.smithi019:Waiting for login prompt 2024-09-12T22:10:04.704 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi019 2024-09-12T22:10:04.850 DEBUG:teuthology.orchestra.console.smithi019:expect before: [Enter `^Ec?' for help] 2024-09-12T22:10:04.850 DEBUG:teuthology.orchestra.console.smithi019:expect after: smithi019 login: 2024-09-12T22:10:04.904 DEBUG:teuthology.orchestra.console.smithi019:console disconnect output: [Enter `^Ec?' for help] smithi019 login: [disconnect] 2024-09-12T22:10:05.005 DEBUG:tasks.thrashosds:checking console status of smithi107 2024-09-12T22:10:05.006 DEBUG:teuthology.orchestra.console.smithi107:Waiting for login prompt 2024-09-12T22:10:05.006 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi107 2024-09-12T22:10:05.115 DEBUG:teuthology.orchestra.console.smithi107:expect before: [Enter `^Ec?' for help] 2024-09-12T22:10:05.115 DEBUG:teuthology.orchestra.console.smithi107:expect after: smithi107 login: 2024-09-12T22:10:05.167 DEBUG:teuthology.orchestra.console.smithi107:console disconnect output: [Enter `^Ec?' for help] smithi107 login: [disconnect] 2024-09-12T22:10:05.268 DEBUG:tasks.thrashosds:checking console status of smithi148 2024-09-12T22:10:05.269 DEBUG:teuthology.orchestra.console.smithi148:Waiting for login prompt 2024-09-12T22:10:05.269 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi148 2024-09-12T22:10:05.376 DEBUG:teuthology.orchestra.console.smithi148:expect before: [Enter `^Ec?' for help] 2024-09-12T22:10:05.376 DEBUG:teuthology.orchestra.console.smithi148:expect after: smithi148 login: 2024-09-12T22:10:05.430 DEBUG:teuthology.orchestra.console.smithi148:console disconnect output: [Enter `^Ec?' for help] smithi148 login: [disconnect] 2024-09-12T22:10:05.531 DEBUG:tasks.thrashosds:checking console status of smithi164 2024-09-12T22:10:05.531 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-09-12T22:10:05.531 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-09-12T22:10:05.684 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] 2024-09-12T22:10:05.684 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-09-12T22:10:05.736 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] smithi164 login: [disconnect] 2024-09-12T22:10:05.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T22:10:06.161 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T22:10:06.161 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:10:06.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:10:06.456 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:06.458 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:10:06.467 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:10:05.070066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.322933"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750001+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:09:53.750001+0000","last_peered":"2024-09-12T22:09:53.750001+0000","last_clean":"2024-09-12T22:09:53.750001+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:09:53.750001+0000","last_undegraded":"2024-09-12T22:09:53.750001+0000","last_fullsized":"2024-09-12T22:09:53.750001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749767+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:09:53.749767+0000","last_peered":"2024-09-12T22:09:53.749767+0000","last_clean":"2024-09-12T22:09:53.749767+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:09:53.749767+0000","last_undegraded":"2024-09-12T22:09:53.749767+0000","last_fullsized":"2024-09-12T22:09:53.749767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750605+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:09:53.750605+0000","last_peered":"2024-09-12T22:09:53.750605+0000","last_clean":"2024-09-12T22:09:53.750605+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:09:53.750605+0000","last_undegraded":"2024-09-12T22:09:53.750605+0000","last_fullsized":"2024-09-12T22:09:53.750605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749637+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:09:53.749637+0000","last_peered":"2024-09-12T22:09:53.749637+0000","last_clean":"2024-09-12T22:09:53.749637+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:09:53.749637+0000","last_undegraded":"2024-09-12T22:09:53.749637+0000","last_fullsized":"2024-09-12T22:09:53.749637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749717+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:09:53.749717+0000","last_peered":"2024-09-12T22:09:53.749717+0000","last_clean":"2024-09-12T22:09:53.749717+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:09:53.749717+0000","last_undegraded":"2024-09-12T22:09:53.749717+0000","last_fullsized":"2024-09-12T22:09:53.749717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749658+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:09:53.749658+0000","last_peered":"2024-09-12T22:09:53.749658+0000","last_clean":"2024-09-12T22:09:53.749658+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:09:53.749658+0000","last_undegraded":"2024-09-12T22:09:53.749658+0000","last_fullsized":"2024-09-12T22:09:53.749658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749412+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:09:53.749412+0000","last_peered":"2024-09-12T22:09:53.749412+0000","last_clean":"2024-09-12T22:09:53.749412+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:09:53.749412+0000","last_undegraded":"2024-09-12T22:09:53.749412+0000","last_fullsized":"2024-09-12T22:09:53.749412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749670+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:09:53.749670+0000","last_peered":"2024-09-12T22:09:53.749670+0000","last_clean":"2024-09-12T22:09:53.749670+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:09:53.749670+0000","last_undegraded":"2024-09-12T22:09:53.749670+0000","last_fullsized":"2024-09-12T22:09:53.749670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749859+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:09:53.749859+0000","last_peered":"2024-09-12T22:09:53.749859+0000","last_clean":"2024-09-12T22:09:53.749859+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:09:53.749859+0000","last_undegraded":"2024-09-12T22:09:53.749859+0000","last_fullsized":"2024-09-12T22:09:53.749859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750477+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:09:53.750477+0000","last_peered":"2024-09-12T22:09:53.750477+0000","last_clean":"2024-09-12T22:09:53.750477+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:09:53.750477+0000","last_undegraded":"2024-09-12T22:09:53.750477+0000","last_fullsized":"2024-09-12T22:09:53.750477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749676+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:09:53.749676+0000","last_peered":"2024-09-12T22:09:53.749676+0000","last_clean":"2024-09-12T22:09:53.749676+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:09:53.749676+0000","last_undegraded":"2024-09-12T22:09:53.749676+0000","last_fullsized":"2024-09-12T22:09:53.749676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749472+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:09:53.749472+0000","last_peered":"2024-09-12T22:09:53.749472+0000","last_clean":"2024-09-12T22:09:53.749472+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:09:53.749472+0000","last_undegraded":"2024-09-12T22:09:53.749472+0000","last_fullsized":"2024-09-12T22:09:53.749472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749748+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:09:53.749748+0000","last_peered":"2024-09-12T22:09:53.749748+0000","last_clean":"2024-09-12T22:09:53.749748+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:09:53.749748+0000","last_undegraded":"2024-09-12T22:09:53.749748+0000","last_fullsized":"2024-09-12T22:09:53.749748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749709+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:09:53.749709+0000","last_peered":"2024-09-12T22:09:53.749709+0000","last_clean":"2024-09-12T22:09:53.749709+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:09:53.749709+0000","last_undegraded":"2024-09-12T22:09:53.749709+0000","last_fullsized":"2024-09-12T22:09:53.749709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749470+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:09:53.749470+0000","last_peered":"2024-09-12T22:09:53.749470+0000","last_clean":"2024-09-12T22:09:53.749470+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:09:53.749470+0000","last_undegraded":"2024-09-12T22:09:53.749470+0000","last_fullsized":"2024-09-12T22:09:53.749470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750125+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:09:53.750125+0000","last_peered":"2024-09-12T22:09:53.750125+0000","last_clean":"2024-09-12T22:09:53.750125+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:09:53.750125+0000","last_undegraded":"2024-09-12T22:09:53.750125+0000","last_fullsized":"2024-09-12T22:09:53.750125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750087+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:09:53.750087+0000","last_peered":"2024-09-12T22:09:53.750087+0000","last_clean":"2024-09-12T22:09:53.750087+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:09:53.750087+0000","last_undegraded":"2024-09-12T22:09:53.750087+0000","last_fullsized":"2024-09-12T22:09:53.750087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749423+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:09:53.749423+0000","last_peered":"2024-09-12T22:09:53.749423+0000","last_clean":"2024-09-12T22:09:53.749423+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:09:53.749423+0000","last_undegraded":"2024-09-12T22:09:53.749423+0000","last_fullsized":"2024-09-12T22:09:53.749423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750165+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:09:53.750165+0000","last_peered":"2024-09-12T22:09:53.750165+0000","last_clean":"2024-09-12T22:09:53.750165+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:09:53.750165+0000","last_undegraded":"2024-09-12T22:09:53.750165+0000","last_fullsized":"2024-09-12T22:09:53.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750012+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:09:53.750012+0000","last_peered":"2024-09-12T22:09:53.750012+0000","last_clean":"2024-09-12T22:09:53.750012+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:09:53.750012+0000","last_undegraded":"2024-09-12T22:09:53.750012+0000","last_fullsized":"2024-09-12T22:09:53.750012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749271+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:09:53.749271+0000","last_peered":"2024-09-12T22:09:53.749271+0000","last_clean":"2024-09-12T22:09:53.749271+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:09:53.749271+0000","last_undegraded":"2024-09-12T22:09:53.749271+0000","last_fullsized":"2024-09-12T22:09:53.749271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748773+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:09:53.748773+0000","last_peered":"2024-09-12T22:09:53.748773+0000","last_clean":"2024-09-12T22:09:53.748773+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:09:53.748773+0000","last_undegraded":"2024-09-12T22:09:53.748773+0000","last_fullsized":"2024-09-12T22:09:53.748773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748970+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:09:53.748970+0000","last_peered":"2024-09-12T22:09:53.748970+0000","last_clean":"2024-09-12T22:09:53.748970+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:09:53.748970+0000","last_undegraded":"2024-09-12T22:09:53.748970+0000","last_fullsized":"2024-09-12T22:09:53.748970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750109+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:09:53.750109+0000","last_peered":"2024-09-12T22:09:53.750109+0000","last_clean":"2024-09-12T22:09:53.750109+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:09:53.750109+0000","last_undegraded":"2024-09-12T22:09:53.750109+0000","last_fullsized":"2024-09-12T22:09:53.750109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749671+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:09:53.749671+0000","last_peered":"2024-09-12T22:09:53.749671+0000","last_clean":"2024-09-12T22:09:53.749671+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:09:53.749671+0000","last_undegraded":"2024-09-12T22:09:53.749671+0000","last_fullsized":"2024-09-12T22:09:53.749671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750625+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:09:53.750625+0000","last_peered":"2024-09-12T22:09:53.750625+0000","last_clean":"2024-09-12T22:09:53.750625+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:09:53.750625+0000","last_undegraded":"2024-09-12T22:09:53.750625+0000","last_fullsized":"2024-09-12T22:09:53.750625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749979+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:09:53.749979+0000","last_peered":"2024-09-12T22:09:53.749979+0000","last_clean":"2024-09-12T22:09:53.749979+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:09:53.749979+0000","last_undegraded":"2024-09-12T22:09:53.749979+0000","last_fullsized":"2024-09-12T22:09:53.749979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749252+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:09:53.749252+0000","last_peered":"2024-09-12T22:09:53.749252+0000","last_clean":"2024-09-12T22:09:53.749252+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:09:53.749252+0000","last_undegraded":"2024-09-12T22:09:53.749252+0000","last_fullsized":"2024-09-12T22:09:53.749252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749388+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:09:53.749388+0000","last_peered":"2024-09-12T22:09:53.749388+0000","last_clean":"2024-09-12T22:09:53.749388+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:09:53.749388+0000","last_undegraded":"2024-09-12T22:09:53.749388+0000","last_fullsized":"2024-09-12T22:09:53.749388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748833+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:09:53.748833+0000","last_peered":"2024-09-12T22:09:53.748833+0000","last_clean":"2024-09-12T22:09:53.748833+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:09:53.748833+0000","last_undegraded":"2024-09-12T22:09:53.748833+0000","last_fullsized":"2024-09-12T22:09:53.748833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749543+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:09:53.749543+0000","last_peered":"2024-09-12T22:09:53.749543+0000","last_clean":"2024-09-12T22:09:53.749543+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:09:53.749543+0000","last_undegraded":"2024-09-12T22:09:53.749543+0000","last_fullsized":"2024-09-12T22:09:53.749543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749826+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:09:53.749826+0000","last_peered":"2024-09-12T22:09:53.749826+0000","last_clean":"2024-09-12T22:09:53.749826+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:09:53.749826+0000","last_undegraded":"2024-09-12T22:09:53.749826+0000","last_fullsized":"2024-09-12T22:09:53.749826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750152+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:09:53.750152+0000","last_peered":"2024-09-12T22:09:53.750152+0000","last_clean":"2024-09-12T22:09:53.750152+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:09:53.750152+0000","last_undegraded":"2024-09-12T22:09:53.750152+0000","last_fullsized":"2024-09-12T22:09:53.750152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749939+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:09:53.749939+0000","last_peered":"2024-09-12T22:09:53.749939+0000","last_clean":"2024-09-12T22:09:53.749939+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:09:53.749939+0000","last_undegraded":"2024-09-12T22:09:53.749939+0000","last_fullsized":"2024-09-12T22:09:53.749939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749125+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:09:53.749125+0000","last_peered":"2024-09-12T22:09:53.749125+0000","last_clean":"2024-09-12T22:09:53.749125+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:09:53.749125+0000","last_undegraded":"2024-09-12T22:09:53.749125+0000","last_fullsized":"2024-09-12T22:09:53.749125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749973+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:09:53.749973+0000","last_peered":"2024-09-12T22:09:53.749973+0000","last_clean":"2024-09-12T22:09:53.749973+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:09:53.749973+0000","last_undegraded":"2024-09-12T22:09:53.749973+0000","last_fullsized":"2024-09-12T22:09:53.749973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749274+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:09:53.749274+0000","last_peered":"2024-09-12T22:09:53.749274+0000","last_clean":"2024-09-12T22:09:53.749274+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:09:53.749274+0000","last_undegraded":"2024-09-12T22:09:53.749274+0000","last_fullsized":"2024-09-12T22:09:53.749274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749707+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:09:53.749707+0000","last_peered":"2024-09-12T22:09:53.749707+0000","last_clean":"2024-09-12T22:09:53.749707+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:09:53.749707+0000","last_undegraded":"2024-09-12T22:09:53.749707+0000","last_fullsized":"2024-09-12T22:09:53.749707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749535+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:09:53.749535+0000","last_peered":"2024-09-12T22:09:53.749535+0000","last_clean":"2024-09-12T22:09:53.749535+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:09:53.749535+0000","last_undegraded":"2024-09-12T22:09:53.749535+0000","last_fullsized":"2024-09-12T22:09:53.749535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750865+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:09:53.750865+0000","last_peered":"2024-09-12T22:09:53.750865+0000","last_clean":"2024-09-12T22:09:53.750865+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:09:53.750865+0000","last_undegraded":"2024-09-12T22:09:53.750865+0000","last_fullsized":"2024-09-12T22:09:53.750865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749054+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:09:53.749054+0000","last_peered":"2024-09-12T22:09:53.749054+0000","last_clean":"2024-09-12T22:09:53.749054+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:09:53.749054+0000","last_undegraded":"2024-09-12T22:09:53.749054+0000","last_fullsized":"2024-09-12T22:09:53.749054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750059+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:09:53.750059+0000","last_peered":"2024-09-12T22:09:53.750059+0000","last_clean":"2024-09-12T22:09:53.750059+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:09:53.750059+0000","last_undegraded":"2024-09-12T22:09:53.750059+0000","last_fullsized":"2024-09-12T22:09:53.750059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749185+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:09:53.749185+0000","last_peered":"2024-09-12T22:09:53.749185+0000","last_clean":"2024-09-12T22:09:53.749185+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:09:53.749185+0000","last_undegraded":"2024-09-12T22:09:53.749185+0000","last_fullsized":"2024-09-12T22:09:53.749185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750809+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:09:53.750809+0000","last_peered":"2024-09-12T22:09:53.750809+0000","last_clean":"2024-09-12T22:09:53.750809+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:09:53.750809+0000","last_undegraded":"2024-09-12T22:09:53.750809+0000","last_fullsized":"2024-09-12T22:09:53.750809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749978+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:09:53.749978+0000","last_peered":"2024-09-12T22:09:53.749978+0000","last_clean":"2024-09-12T22:09:53.749978+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:09:53.749978+0000","last_undegraded":"2024-09-12T22:09:53.749978+0000","last_fullsized":"2024-09-12T22:09:53.749978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750423+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:09:53.750423+0000","last_peered":"2024-09-12T22:09:53.750423+0000","last_clean":"2024-09-12T22:09:53.750423+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:09:53.750423+0000","last_undegraded":"2024-09-12T22:09:53.750423+0000","last_fullsized":"2024-09-12T22:09:53.750423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749081+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:09:53.749081+0000","last_peered":"2024-09-12T22:09:53.749081+0000","last_clean":"2024-09-12T22:09:53.749081+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:09:53.749081+0000","last_undegraded":"2024-09-12T22:09:53.749081+0000","last_fullsized":"2024-09-12T22:09:53.749081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749634+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:09:53.749634+0000","last_peered":"2024-09-12T22:09:53.749634+0000","last_clean":"2024-09-12T22:09:53.749634+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:09:53.749634+0000","last_undegraded":"2024-09-12T22:09:53.749634+0000","last_fullsized":"2024-09-12T22:09:53.749634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750221+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:09:53.750221+0000","last_peered":"2024-09-12T22:09:53.750221+0000","last_clean":"2024-09-12T22:09:53.750221+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:09:53.750221+0000","last_undegraded":"2024-09-12T22:09:53.750221+0000","last_fullsized":"2024-09-12T22:09:53.750221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750007+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:09:53.750007+0000","last_peered":"2024-09-12T22:09:53.750007+0000","last_clean":"2024-09-12T22:09:53.750007+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:09:53.750007+0000","last_undegraded":"2024-09-12T22:09:53.750007+0000","last_fullsized":"2024-09-12T22:09:53.750007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750743+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:09:53.750743+0000","last_peered":"2024-09-12T22:09:53.750743+0000","last_clean":"2024-09-12T22:09:53.750743+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:09:53.750743+0000","last_undegraded":"2024-09-12T22:09:53.750743+0000","last_fullsized":"2024-09-12T22:09:53.750743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749327+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:09:53.749327+0000","last_peered":"2024-09-12T22:09:53.749327+0000","last_clean":"2024-09-12T22:09:53.749327+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:09:53.749327+0000","last_undegraded":"2024-09-12T22:09:53.749327+0000","last_fullsized":"2024-09-12T22:09:53.749327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750671+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:09:53.750671+0000","last_peered":"2024-09-12T22:09:53.750671+0000","last_clean":"2024-09-12T22:09:53.750671+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:09:53.750671+0000","last_undegraded":"2024-09-12T22:09:53.750671+0000","last_fullsized":"2024-09-12T22:09:53.750671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749007+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:09:53.749007+0000","last_peered":"2024-09-12T22:09:53.749007+0000","last_clean":"2024-09-12T22:09:53.749007+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:09:53.749007+0000","last_undegraded":"2024-09-12T22:09:53.749007+0000","last_fullsized":"2024-09-12T22:09:53.749007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749791+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:09:53.749791+0000","last_peered":"2024-09-12T22:09:53.749791+0000","last_clean":"2024-09-12T22:09:53.749791+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:09:53.749791+0000","last_undegraded":"2024-09-12T22:09:53.749791+0000","last_fullsized":"2024-09-12T22:09:53.749791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749768+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:53.749768+0000","last_peered":"2024-09-12T22:09:53.749768+0000","last_clean":"2024-09-12T22:09:53.749768+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:53.749768+0000","last_undegraded":"2024-09-12T22:09:53.749768+0000","last_fullsized":"2024-09-12T22:09:53.749768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750374+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:53.750374+0000","last_peered":"2024-09-12T22:09:53.750374+0000","last_clean":"2024-09-12T22:09:53.750374+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:53.750374+0000","last_undegraded":"2024-09-12T22:09:53.750374+0000","last_fullsized":"2024-09-12T22:09:53.750374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749291+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:09:53.749291+0000","last_peered":"2024-09-12T22:09:53.749291+0000","last_clean":"2024-09-12T22:09:53.749291+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:09:53.749291+0000","last_undegraded":"2024-09-12T22:09:53.749291+0000","last_fullsized":"2024-09-12T22:09:53.749291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750817+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:09:53.750817+0000","last_peered":"2024-09-12T22:09:53.750817+0000","last_clean":"2024-09-12T22:09:53.750817+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:09:53.750817+0000","last_undegraded":"2024-09-12T22:09:53.750817+0000","last_fullsized":"2024-09-12T22:09:53.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749794+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:53.749794+0000","last_peered":"2024-09-12T22:09:53.749794+0000","last_clean":"2024-09-12T22:09:53.749794+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:53.749794+0000","last_undegraded":"2024-09-12T22:09:53.749794+0000","last_fullsized":"2024-09-12T22:09:53.749794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749238+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:09:53.749238+0000","last_peered":"2024-09-12T22:09:53.749238+0000","last_clean":"2024-09-12T22:09:53.749238+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:09:53.749238+0000","last_undegraded":"2024-09-12T22:09:53.749238+0000","last_fullsized":"2024-09-12T22:09:53.749238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750000+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:09:53.750000+0000","last_peered":"2024-09-12T22:09:53.750000+0000","last_clean":"2024-09-12T22:09:53.750000+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:09:53.750000+0000","last_undegraded":"2024-09-12T22:09:53.750000+0000","last_fullsized":"2024-09-12T22:09:53.750000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749507+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:53.749507+0000","last_peered":"2024-09-12T22:09:53.749507+0000","last_clean":"2024-09-12T22:09:53.749507+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:53.749507+0000","last_undegraded":"2024-09-12T22:09:53.749507+0000","last_fullsized":"2024-09-12T22:09:53.749507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749111+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:09:53.749111+0000","last_peered":"2024-09-12T22:09:53.749111+0000","last_clean":"2024-09-12T22:09:53.749111+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:09:53.749111+0000","last_undegraded":"2024-09-12T22:09:53.749111+0000","last_fullsized":"2024-09-12T22:09:53.749111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749820+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:09:53.749820+0000","last_peered":"2024-09-12T22:09:53.749820+0000","last_clean":"2024-09-12T22:09:53.749820+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:09:53.749820+0000","last_undegraded":"2024-09-12T22:09:53.749820+0000","last_fullsized":"2024-09-12T22:09:53.749820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750106+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:53.750106+0000","last_peered":"2024-09-12T22:09:53.750106+0000","last_clean":"2024-09-12T22:09:53.750106+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:53.750106+0000","last_undegraded":"2024-09-12T22:09:53.750106+0000","last_fullsized":"2024-09-12T22:09:53.750106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750197+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:09:53.750197+0000","last_peered":"2024-09-12T22:09:53.750197+0000","last_clean":"2024-09-12T22:09:53.750197+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:09:53.750197+0000","last_undegraded":"2024-09-12T22:09:53.750197+0000","last_fullsized":"2024-09-12T22:09:53.750197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749361+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:09:53.749361+0000","last_peered":"2024-09-12T22:09:53.749361+0000","last_clean":"2024-09-12T22:09:53.749361+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:09:53.749361+0000","last_undegraded":"2024-09-12T22:09:53.749361+0000","last_fullsized":"2024-09-12T22:09:53.749361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750864+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:09:53.750864+0000","last_peered":"2024-09-12T22:09:53.750864+0000","last_clean":"2024-09-12T22:09:53.750864+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:09:53.750864+0000","last_undegraded":"2024-09-12T22:09:53.750864+0000","last_fullsized":"2024-09-12T22:09:53.750864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749640+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:53.749640+0000","last_peered":"2024-09-12T22:09:53.749640+0000","last_clean":"2024-09-12T22:09:53.749640+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:53.749640+0000","last_undegraded":"2024-09-12T22:09:53.749640+0000","last_fullsized":"2024-09-12T22:09:53.749640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749568+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:09:53.749568+0000","last_peered":"2024-09-12T22:09:53.749568+0000","last_clean":"2024-09-12T22:09:53.749568+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:09:53.749568+0000","last_undegraded":"2024-09-12T22:09:53.749568+0000","last_fullsized":"2024-09-12T22:09:53.749568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749527+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:09:53.749527+0000","last_peered":"2024-09-12T22:09:53.749527+0000","last_clean":"2024-09-12T22:09:53.749527+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:09:53.749527+0000","last_undegraded":"2024-09-12T22:09:53.749527+0000","last_fullsized":"2024-09-12T22:09:53.749527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750254+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:53.750254+0000","last_peered":"2024-09-12T22:09:53.750254+0000","last_clean":"2024-09-12T22:09:53.750254+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:53.750254+0000","last_undegraded":"2024-09-12T22:09:53.750254+0000","last_fullsized":"2024-09-12T22:09:53.750254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749473+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:09:53.749473+0000","last_peered":"2024-09-12T22:09:53.749473+0000","last_clean":"2024-09-12T22:09:53.749473+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:09:53.749473+0000","last_undegraded":"2024-09-12T22:09:53.749473+0000","last_fullsized":"2024-09-12T22:09:53.749473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750097+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:09:53.750097+0000","last_peered":"2024-09-12T22:09:53.750097+0000","last_clean":"2024-09-12T22:09:53.750097+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:09:53.750097+0000","last_undegraded":"2024-09-12T22:09:53.750097+0000","last_fullsized":"2024-09-12T22:09:53.750097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750040+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:53.750040+0000","last_peered":"2024-09-12T22:09:53.750040+0000","last_clean":"2024-09-12T22:09:53.750040+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:53.750040+0000","last_undegraded":"2024-09-12T22:09:53.750040+0000","last_fullsized":"2024-09-12T22:09:53.750040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749990+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:09:53.749990+0000","last_peered":"2024-09-12T22:09:53.749990+0000","last_clean":"2024-09-12T22:09:53.749990+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:09:53.749990+0000","last_undegraded":"2024-09-12T22:09:53.749990+0000","last_fullsized":"2024-09-12T22:09:53.749990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750937+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:53.750937+0000","last_peered":"2024-09-12T22:09:53.750937+0000","last_clean":"2024-09-12T22:09:53.750937+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:53.750937+0000","last_undegraded":"2024-09-12T22:09:53.750937+0000","last_fullsized":"2024-09-12T22:09:53.750937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749167+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:09:53.749167+0000","last_peered":"2024-09-12T22:09:53.749167+0000","last_clean":"2024-09-12T22:09:53.749167+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:09:53.749167+0000","last_undegraded":"2024-09-12T22:09:53.749167+0000","last_fullsized":"2024-09-12T22:09:53.749167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750122+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:09:53.750122+0000","last_peered":"2024-09-12T22:09:53.750122+0000","last_clean":"2024-09-12T22:09:53.750122+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:09:53.750122+0000","last_undegraded":"2024-09-12T22:09:53.750122+0000","last_fullsized":"2024-09-12T22:09:53.750122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750372+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:09:53.750372+0000","last_peered":"2024-09-12T22:09:53.750372+0000","last_clean":"2024-09-12T22:09:53.750372+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:09:53.750372+0000","last_undegraded":"2024-09-12T22:09:53.750372+0000","last_fullsized":"2024-09-12T22:09:53.750372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749023+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:09:53.749023+0000","last_peered":"2024-09-12T22:09:53.749023+0000","last_clean":"2024-09-12T22:09:53.749023+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:09:53.749023+0000","last_undegraded":"2024-09-12T22:09:53.749023+0000","last_fullsized":"2024-09-12T22:09:53.749023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750174+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:09:53.750174+0000","last_peered":"2024-09-12T22:09:53.750174+0000","last_clean":"2024-09-12T22:09:53.750174+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:09:53.750174+0000","last_undegraded":"2024-09-12T22:09:53.750174+0000","last_fullsized":"2024-09-12T22:09:53.750174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750667+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:09:53.750667+0000","last_peered":"2024-09-12T22:09:53.750667+0000","last_clean":"2024-09-12T22:09:53.750667+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:09:53.750667+0000","last_undegraded":"2024-09-12T22:09:53.750667+0000","last_fullsized":"2024-09-12T22:09:53.750667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748940+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:09:53.748940+0000","last_peered":"2024-09-12T22:09:53.748940+0000","last_clean":"2024-09-12T22:09:53.748940+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:09:53.748940+0000","last_undegraded":"2024-09-12T22:09:53.748940+0000","last_fullsized":"2024-09-12T22:09:53.748940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749960+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:09:53.749960+0000","last_peered":"2024-09-12T22:09:53.749960+0000","last_clean":"2024-09-12T22:09:53.749960+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:09:53.749960+0000","last_undegraded":"2024-09-12T22:09:53.749960+0000","last_fullsized":"2024-09-12T22:09:53.749960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750337+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:09:53.750337+0000","last_peered":"2024-09-12T22:09:53.750337+0000","last_clean":"2024-09-12T22:09:53.750337+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:09:53.750337+0000","last_undegraded":"2024-09-12T22:09:53.750337+0000","last_fullsized":"2024-09-12T22:09:53.750337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748927+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:09:53.748927+0000","last_peered":"2024-09-12T22:09:53.748927+0000","last_clean":"2024-09-12T22:09:53.748927+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:09:53.748927+0000","last_undegraded":"2024-09-12T22:09:53.748927+0000","last_fullsized":"2024-09-12T22:09:53.748927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749615+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:09:53.749615+0000","last_peered":"2024-09-12T22:09:53.749615+0000","last_clean":"2024-09-12T22:09:53.749615+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:09:53.749615+0000","last_undegraded":"2024-09-12T22:09:53.749615+0000","last_fullsized":"2024-09-12T22:09:53.749615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749070+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:09:53.749070+0000","last_peered":"2024-09-12T22:09:53.749070+0000","last_clean":"2024-09-12T22:09:53.749070+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:09:53.749070+0000","last_undegraded":"2024-09-12T22:09:53.749070+0000","last_fullsized":"2024-09-12T22:09:53.749070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749881+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:09:53.749881+0000","last_peered":"2024-09-12T22:09:53.749881+0000","last_clean":"2024-09-12T22:09:53.749881+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:09:53.749881+0000","last_undegraded":"2024-09-12T22:09:53.749881+0000","last_fullsized":"2024-09-12T22:09:53.749881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749463+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:09:53.749463+0000","last_peered":"2024-09-12T22:09:53.749463+0000","last_clean":"2024-09-12T22:09:53.749463+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:09:53.749463+0000","last_undegraded":"2024-09-12T22:09:53.749463+0000","last_fullsized":"2024-09-12T22:09:53.749463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749643+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:09:53.749643+0000","last_peered":"2024-09-12T22:09:53.749643+0000","last_clean":"2024-09-12T22:09:53.749643+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:09:53.749643+0000","last_undegraded":"2024-09-12T22:09:53.749643+0000","last_fullsized":"2024-09-12T22:09:53.749643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749562+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:09:53.749562+0000","last_peered":"2024-09-12T22:09:53.749562+0000","last_clean":"2024-09-12T22:09:53.749562+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:09:53.749562+0000","last_undegraded":"2024-09-12T22:09:53.749562+0000","last_fullsized":"2024-09-12T22:09:53.749562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750238+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:09:53.750238+0000","last_peered":"2024-09-12T22:09:53.750238+0000","last_clean":"2024-09-12T22:09:53.750238+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:09:53.750238+0000","last_undegraded":"2024-09-12T22:09:53.750238+0000","last_fullsized":"2024-09-12T22:09:53.750238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749930+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:09:53.749930+0000","last_peered":"2024-09-12T22:09:53.749930+0000","last_clean":"2024-09-12T22:09:53.749930+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:09:53.749930+0000","last_undegraded":"2024-09-12T22:09:53.749930+0000","last_fullsized":"2024-09-12T22:09:53.749930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750002+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:09:53.750002+0000","last_peered":"2024-09-12T22:09:53.750002+0000","last_clean":"2024-09-12T22:09:53.750002+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:09:53.750002+0000","last_undegraded":"2024-09-12T22:09:53.750002+0000","last_fullsized":"2024-09-12T22:09:53.750002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749490+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:09:53.749490+0000","last_peered":"2024-09-12T22:09:53.749490+0000","last_clean":"2024-09-12T22:09:53.749490+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:09:53.749490+0000","last_undegraded":"2024-09-12T22:09:53.749490+0000","last_fullsized":"2024-09-12T22:09:53.749490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749863+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:09:53.749863+0000","last_peered":"2024-09-12T22:09:53.749863+0000","last_clean":"2024-09-12T22:09:53.749863+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:09:53.749863+0000","last_undegraded":"2024-09-12T22:09:53.749863+0000","last_fullsized":"2024-09-12T22:09:53.749863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749656+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:09:53.749656+0000","last_peered":"2024-09-12T22:09:53.749656+0000","last_clean":"2024-09-12T22:09:53.749656+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:09:53.749656+0000","last_undegraded":"2024-09-12T22:09:53.749656+0000","last_fullsized":"2024-09-12T22:09:53.749656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749951+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:09:53.749951+0000","last_peered":"2024-09-12T22:09:53.749951+0000","last_clean":"2024-09-12T22:09:53.749951+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:09:53.749951+0000","last_undegraded":"2024-09-12T22:09:53.749951+0000","last_fullsized":"2024-09-12T22:09:53.749951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:10:06.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:10:06.802 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:06.804 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:10:06.813 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:10:05.070066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.322933"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750001+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:09:53.750001+0000","last_peered":"2024-09-12T22:09:53.750001+0000","last_clean":"2024-09-12T22:09:53.750001+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:09:53.750001+0000","last_undegraded":"2024-09-12T22:09:53.750001+0000","last_fullsized":"2024-09-12T22:09:53.750001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749767+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:09:53.749767+0000","last_peered":"2024-09-12T22:09:53.749767+0000","last_clean":"2024-09-12T22:09:53.749767+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:09:53.749767+0000","last_undegraded":"2024-09-12T22:09:53.749767+0000","last_fullsized":"2024-09-12T22:09:53.749767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750605+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:09:53.750605+0000","last_peered":"2024-09-12T22:09:53.750605+0000","last_clean":"2024-09-12T22:09:53.750605+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:09:53.750605+0000","last_undegraded":"2024-09-12T22:09:53.750605+0000","last_fullsized":"2024-09-12T22:09:53.750605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749637+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:09:53.749637+0000","last_peered":"2024-09-12T22:09:53.749637+0000","last_clean":"2024-09-12T22:09:53.749637+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:09:53.749637+0000","last_undegraded":"2024-09-12T22:09:53.749637+0000","last_fullsized":"2024-09-12T22:09:53.749637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749717+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:09:53.749717+0000","last_peered":"2024-09-12T22:09:53.749717+0000","last_clean":"2024-09-12T22:09:53.749717+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:09:53.749717+0000","last_undegraded":"2024-09-12T22:09:53.749717+0000","last_fullsized":"2024-09-12T22:09:53.749717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749658+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:09:53.749658+0000","last_peered":"2024-09-12T22:09:53.749658+0000","last_clean":"2024-09-12T22:09:53.749658+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:09:53.749658+0000","last_undegraded":"2024-09-12T22:09:53.749658+0000","last_fullsized":"2024-09-12T22:09:53.749658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749412+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:09:53.749412+0000","last_peered":"2024-09-12T22:09:53.749412+0000","last_clean":"2024-09-12T22:09:53.749412+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:09:53.749412+0000","last_undegraded":"2024-09-12T22:09:53.749412+0000","last_fullsized":"2024-09-12T22:09:53.749412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749670+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:09:53.749670+0000","last_peered":"2024-09-12T22:09:53.749670+0000","last_clean":"2024-09-12T22:09:53.749670+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:09:53.749670+0000","last_undegraded":"2024-09-12T22:09:53.749670+0000","last_fullsized":"2024-09-12T22:09:53.749670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749859+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:09:53.749859+0000","last_peered":"2024-09-12T22:09:53.749859+0000","last_clean":"2024-09-12T22:09:53.749859+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:09:53.749859+0000","last_undegraded":"2024-09-12T22:09:53.749859+0000","last_fullsized":"2024-09-12T22:09:53.749859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750477+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:09:53.750477+0000","last_peered":"2024-09-12T22:09:53.750477+0000","last_clean":"2024-09-12T22:09:53.750477+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:09:53.750477+0000","last_undegraded":"2024-09-12T22:09:53.750477+0000","last_fullsized":"2024-09-12T22:09:53.750477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749676+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:09:53.749676+0000","last_peered":"2024-09-12T22:09:53.749676+0000","last_clean":"2024-09-12T22:09:53.749676+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:09:53.749676+0000","last_undegraded":"2024-09-12T22:09:53.749676+0000","last_fullsized":"2024-09-12T22:09:53.749676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749472+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:09:53.749472+0000","last_peered":"2024-09-12T22:09:53.749472+0000","last_clean":"2024-09-12T22:09:53.749472+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:09:53.749472+0000","last_undegraded":"2024-09-12T22:09:53.749472+0000","last_fullsized":"2024-09-12T22:09:53.749472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749748+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:09:53.749748+0000","last_peered":"2024-09-12T22:09:53.749748+0000","last_clean":"2024-09-12T22:09:53.749748+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:09:53.749748+0000","last_undegraded":"2024-09-12T22:09:53.749748+0000","last_fullsized":"2024-09-12T22:09:53.749748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749709+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:09:53.749709+0000","last_peered":"2024-09-12T22:09:53.749709+0000","last_clean":"2024-09-12T22:09:53.749709+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:09:53.749709+0000","last_undegraded":"2024-09-12T22:09:53.749709+0000","last_fullsized":"2024-09-12T22:09:53.749709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749470+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:09:53.749470+0000","last_peered":"2024-09-12T22:09:53.749470+0000","last_clean":"2024-09-12T22:09:53.749470+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:09:53.749470+0000","last_undegraded":"2024-09-12T22:09:53.749470+0000","last_fullsized":"2024-09-12T22:09:53.749470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750125+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:09:53.750125+0000","last_peered":"2024-09-12T22:09:53.750125+0000","last_clean":"2024-09-12T22:09:53.750125+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:09:53.750125+0000","last_undegraded":"2024-09-12T22:09:53.750125+0000","last_fullsized":"2024-09-12T22:09:53.750125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750087+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:09:53.750087+0000","last_peered":"2024-09-12T22:09:53.750087+0000","last_clean":"2024-09-12T22:09:53.750087+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:09:53.750087+0000","last_undegraded":"2024-09-12T22:09:53.750087+0000","last_fullsized":"2024-09-12T22:09:53.750087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749423+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:09:53.749423+0000","last_peered":"2024-09-12T22:09:53.749423+0000","last_clean":"2024-09-12T22:09:53.749423+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:09:53.749423+0000","last_undegraded":"2024-09-12T22:09:53.749423+0000","last_fullsized":"2024-09-12T22:09:53.749423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750165+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:09:53.750165+0000","last_peered":"2024-09-12T22:09:53.750165+0000","last_clean":"2024-09-12T22:09:53.750165+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:09:53.750165+0000","last_undegraded":"2024-09-12T22:09:53.750165+0000","last_fullsized":"2024-09-12T22:09:53.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750012+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:09:53.750012+0000","last_peered":"2024-09-12T22:09:53.750012+0000","last_clean":"2024-09-12T22:09:53.750012+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:09:53.750012+0000","last_undegraded":"2024-09-12T22:09:53.750012+0000","last_fullsized":"2024-09-12T22:09:53.750012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749271+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:09:53.749271+0000","last_peered":"2024-09-12T22:09:53.749271+0000","last_clean":"2024-09-12T22:09:53.749271+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:09:53.749271+0000","last_undegraded":"2024-09-12T22:09:53.749271+0000","last_fullsized":"2024-09-12T22:09:53.749271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748773+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:09:53.748773+0000","last_peered":"2024-09-12T22:09:53.748773+0000","last_clean":"2024-09-12T22:09:53.748773+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:09:53.748773+0000","last_undegraded":"2024-09-12T22:09:53.748773+0000","last_fullsized":"2024-09-12T22:09:53.748773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748970+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:09:53.748970+0000","last_peered":"2024-09-12T22:09:53.748970+0000","last_clean":"2024-09-12T22:09:53.748970+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:09:53.748970+0000","last_undegraded":"2024-09-12T22:09:53.748970+0000","last_fullsized":"2024-09-12T22:09:53.748970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750109+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:09:53.750109+0000","last_peered":"2024-09-12T22:09:53.750109+0000","last_clean":"2024-09-12T22:09:53.750109+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:09:53.750109+0000","last_undegraded":"2024-09-12T22:09:53.750109+0000","last_fullsized":"2024-09-12T22:09:53.750109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749671+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:09:53.749671+0000","last_peered":"2024-09-12T22:09:53.749671+0000","last_clean":"2024-09-12T22:09:53.749671+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:09:53.749671+0000","last_undegraded":"2024-09-12T22:09:53.749671+0000","last_fullsized":"2024-09-12T22:09:53.749671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750625+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:09:53.750625+0000","last_peered":"2024-09-12T22:09:53.750625+0000","last_clean":"2024-09-12T22:09:53.750625+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:09:53.750625+0000","last_undegraded":"2024-09-12T22:09:53.750625+0000","last_fullsized":"2024-09-12T22:09:53.750625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749979+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:09:53.749979+0000","last_peered":"2024-09-12T22:09:53.749979+0000","last_clean":"2024-09-12T22:09:53.749979+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:09:53.749979+0000","last_undegraded":"2024-09-12T22:09:53.749979+0000","last_fullsized":"2024-09-12T22:09:53.749979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749252+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:09:53.749252+0000","last_peered":"2024-09-12T22:09:53.749252+0000","last_clean":"2024-09-12T22:09:53.749252+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:09:53.749252+0000","last_undegraded":"2024-09-12T22:09:53.749252+0000","last_fullsized":"2024-09-12T22:09:53.749252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749388+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:09:53.749388+0000","last_peered":"2024-09-12T22:09:53.749388+0000","last_clean":"2024-09-12T22:09:53.749388+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:09:53.749388+0000","last_undegraded":"2024-09-12T22:09:53.749388+0000","last_fullsized":"2024-09-12T22:09:53.749388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748833+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:09:53.748833+0000","last_peered":"2024-09-12T22:09:53.748833+0000","last_clean":"2024-09-12T22:09:53.748833+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:09:53.748833+0000","last_undegraded":"2024-09-12T22:09:53.748833+0000","last_fullsized":"2024-09-12T22:09:53.748833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749543+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:09:53.749543+0000","last_peered":"2024-09-12T22:09:53.749543+0000","last_clean":"2024-09-12T22:09:53.749543+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:09:53.749543+0000","last_undegraded":"2024-09-12T22:09:53.749543+0000","last_fullsized":"2024-09-12T22:09:53.749543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749826+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:09:53.749826+0000","last_peered":"2024-09-12T22:09:53.749826+0000","last_clean":"2024-09-12T22:09:53.749826+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:09:53.749826+0000","last_undegraded":"2024-09-12T22:09:53.749826+0000","last_fullsized":"2024-09-12T22:09:53.749826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750152+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:09:53.750152+0000","last_peered":"2024-09-12T22:09:53.750152+0000","last_clean":"2024-09-12T22:09:53.750152+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:09:53.750152+0000","last_undegraded":"2024-09-12T22:09:53.750152+0000","last_fullsized":"2024-09-12T22:09:53.750152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749939+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:09:53.749939+0000","last_peered":"2024-09-12T22:09:53.749939+0000","last_clean":"2024-09-12T22:09:53.749939+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:09:53.749939+0000","last_undegraded":"2024-09-12T22:09:53.749939+0000","last_fullsized":"2024-09-12T22:09:53.749939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749125+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:09:53.749125+0000","last_peered":"2024-09-12T22:09:53.749125+0000","last_clean":"2024-09-12T22:09:53.749125+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:09:53.749125+0000","last_undegraded":"2024-09-12T22:09:53.749125+0000","last_fullsized":"2024-09-12T22:09:53.749125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749973+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:09:53.749973+0000","last_peered":"2024-09-12T22:09:53.749973+0000","last_clean":"2024-09-12T22:09:53.749973+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:09:53.749973+0000","last_undegraded":"2024-09-12T22:09:53.749973+0000","last_fullsized":"2024-09-12T22:09:53.749973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749274+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:09:53.749274+0000","last_peered":"2024-09-12T22:09:53.749274+0000","last_clean":"2024-09-12T22:09:53.749274+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:09:53.749274+0000","last_undegraded":"2024-09-12T22:09:53.749274+0000","last_fullsized":"2024-09-12T22:09:53.749274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749707+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:09:53.749707+0000","last_peered":"2024-09-12T22:09:53.749707+0000","last_clean":"2024-09-12T22:09:53.749707+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:09:53.749707+0000","last_undegraded":"2024-09-12T22:09:53.749707+0000","last_fullsized":"2024-09-12T22:09:53.749707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749535+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:09:53.749535+0000","last_peered":"2024-09-12T22:09:53.749535+0000","last_clean":"2024-09-12T22:09:53.749535+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:09:53.749535+0000","last_undegraded":"2024-09-12T22:09:53.749535+0000","last_fullsized":"2024-09-12T22:09:53.749535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750865+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:09:53.750865+0000","last_peered":"2024-09-12T22:09:53.750865+0000","last_clean":"2024-09-12T22:09:53.750865+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:09:53.750865+0000","last_undegraded":"2024-09-12T22:09:53.750865+0000","last_fullsized":"2024-09-12T22:09:53.750865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749054+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:09:53.749054+0000","last_peered":"2024-09-12T22:09:53.749054+0000","last_clean":"2024-09-12T22:09:53.749054+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:09:53.749054+0000","last_undegraded":"2024-09-12T22:09:53.749054+0000","last_fullsized":"2024-09-12T22:09:53.749054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750059+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:09:53.750059+0000","last_peered":"2024-09-12T22:09:53.750059+0000","last_clean":"2024-09-12T22:09:53.750059+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:09:53.750059+0000","last_undegraded":"2024-09-12T22:09:53.750059+0000","last_fullsized":"2024-09-12T22:09:53.750059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749185+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:09:53.749185+0000","last_peered":"2024-09-12T22:09:53.749185+0000","last_clean":"2024-09-12T22:09:53.749185+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:09:53.749185+0000","last_undegraded":"2024-09-12T22:09:53.749185+0000","last_fullsized":"2024-09-12T22:09:53.749185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750809+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:09:53.750809+0000","last_peered":"2024-09-12T22:09:53.750809+0000","last_clean":"2024-09-12T22:09:53.750809+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:09:53.750809+0000","last_undegraded":"2024-09-12T22:09:53.750809+0000","last_fullsized":"2024-09-12T22:09:53.750809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749978+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:09:53.749978+0000","last_peered":"2024-09-12T22:09:53.749978+0000","last_clean":"2024-09-12T22:09:53.749978+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:09:53.749978+0000","last_undegraded":"2024-09-12T22:09:53.749978+0000","last_fullsized":"2024-09-12T22:09:53.749978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750423+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:09:53.750423+0000","last_peered":"2024-09-12T22:09:53.750423+0000","last_clean":"2024-09-12T22:09:53.750423+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:09:53.750423+0000","last_undegraded":"2024-09-12T22:09:53.750423+0000","last_fullsized":"2024-09-12T22:09:53.750423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749081+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:09:53.749081+0000","last_peered":"2024-09-12T22:09:53.749081+0000","last_clean":"2024-09-12T22:09:53.749081+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:09:53.749081+0000","last_undegraded":"2024-09-12T22:09:53.749081+0000","last_fullsized":"2024-09-12T22:09:53.749081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749634+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:09:53.749634+0000","last_peered":"2024-09-12T22:09:53.749634+0000","last_clean":"2024-09-12T22:09:53.749634+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:09:53.749634+0000","last_undegraded":"2024-09-12T22:09:53.749634+0000","last_fullsized":"2024-09-12T22:09:53.749634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750221+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:09:53.750221+0000","last_peered":"2024-09-12T22:09:53.750221+0000","last_clean":"2024-09-12T22:09:53.750221+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:09:53.750221+0000","last_undegraded":"2024-09-12T22:09:53.750221+0000","last_fullsized":"2024-09-12T22:09:53.750221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750007+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:09:53.750007+0000","last_peered":"2024-09-12T22:09:53.750007+0000","last_clean":"2024-09-12T22:09:53.750007+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:09:53.750007+0000","last_undegraded":"2024-09-12T22:09:53.750007+0000","last_fullsized":"2024-09-12T22:09:53.750007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750743+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:09:53.750743+0000","last_peered":"2024-09-12T22:09:53.750743+0000","last_clean":"2024-09-12T22:09:53.750743+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:09:53.750743+0000","last_undegraded":"2024-09-12T22:09:53.750743+0000","last_fullsized":"2024-09-12T22:09:53.750743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749327+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:09:53.749327+0000","last_peered":"2024-09-12T22:09:53.749327+0000","last_clean":"2024-09-12T22:09:53.749327+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:09:53.749327+0000","last_undegraded":"2024-09-12T22:09:53.749327+0000","last_fullsized":"2024-09-12T22:09:53.749327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750671+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:09:53.750671+0000","last_peered":"2024-09-12T22:09:53.750671+0000","last_clean":"2024-09-12T22:09:53.750671+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:09:53.750671+0000","last_undegraded":"2024-09-12T22:09:53.750671+0000","last_fullsized":"2024-09-12T22:09:53.750671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749007+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:09:53.749007+0000","last_peered":"2024-09-12T22:09:53.749007+0000","last_clean":"2024-09-12T22:09:53.749007+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:09:53.749007+0000","last_undegraded":"2024-09-12T22:09:53.749007+0000","last_fullsized":"2024-09-12T22:09:53.749007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749791+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:09:53.749791+0000","last_peered":"2024-09-12T22:09:53.749791+0000","last_clean":"2024-09-12T22:09:53.749791+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:09:53.749791+0000","last_undegraded":"2024-09-12T22:09:53.749791+0000","last_fullsized":"2024-09-12T22:09:53.749791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749768+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:09:53.749768+0000","last_peered":"2024-09-12T22:09:53.749768+0000","last_clean":"2024-09-12T22:09:53.749768+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:09:53.749768+0000","last_undegraded":"2024-09-12T22:09:53.749768+0000","last_fullsized":"2024-09-12T22:09:53.749768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750374+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:09:53.750374+0000","last_peered":"2024-09-12T22:09:53.750374+0000","last_clean":"2024-09-12T22:09:53.750374+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:09:53.750374+0000","last_undegraded":"2024-09-12T22:09:53.750374+0000","last_fullsized":"2024-09-12T22:09:53.750374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749291+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:09:53.749291+0000","last_peered":"2024-09-12T22:09:53.749291+0000","last_clean":"2024-09-12T22:09:53.749291+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:09:53.749291+0000","last_undegraded":"2024-09-12T22:09:53.749291+0000","last_fullsized":"2024-09-12T22:09:53.749291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750817+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:09:53.750817+0000","last_peered":"2024-09-12T22:09:53.750817+0000","last_clean":"2024-09-12T22:09:53.750817+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:09:53.750817+0000","last_undegraded":"2024-09-12T22:09:53.750817+0000","last_fullsized":"2024-09-12T22:09:53.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749794+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:09:53.749794+0000","last_peered":"2024-09-12T22:09:53.749794+0000","last_clean":"2024-09-12T22:09:53.749794+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:09:53.749794+0000","last_undegraded":"2024-09-12T22:09:53.749794+0000","last_fullsized":"2024-09-12T22:09:53.749794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749238+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:09:53.749238+0000","last_peered":"2024-09-12T22:09:53.749238+0000","last_clean":"2024-09-12T22:09:53.749238+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:09:53.749238+0000","last_undegraded":"2024-09-12T22:09:53.749238+0000","last_fullsized":"2024-09-12T22:09:53.749238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750000+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:09:53.750000+0000","last_peered":"2024-09-12T22:09:53.750000+0000","last_clean":"2024-09-12T22:09:53.750000+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:09:53.750000+0000","last_undegraded":"2024-09-12T22:09:53.750000+0000","last_fullsized":"2024-09-12T22:09:53.750000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749507+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:09:53.749507+0000","last_peered":"2024-09-12T22:09:53.749507+0000","last_clean":"2024-09-12T22:09:53.749507+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:09:53.749507+0000","last_undegraded":"2024-09-12T22:09:53.749507+0000","last_fullsized":"2024-09-12T22:09:53.749507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749111+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:09:53.749111+0000","last_peered":"2024-09-12T22:09:53.749111+0000","last_clean":"2024-09-12T22:09:53.749111+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:09:53.749111+0000","last_undegraded":"2024-09-12T22:09:53.749111+0000","last_fullsized":"2024-09-12T22:09:53.749111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749820+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:09:53.749820+0000","last_peered":"2024-09-12T22:09:53.749820+0000","last_clean":"2024-09-12T22:09:53.749820+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:09:53.749820+0000","last_undegraded":"2024-09-12T22:09:53.749820+0000","last_fullsized":"2024-09-12T22:09:53.749820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750106+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:09:53.750106+0000","last_peered":"2024-09-12T22:09:53.750106+0000","last_clean":"2024-09-12T22:09:53.750106+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:09:53.750106+0000","last_undegraded":"2024-09-12T22:09:53.750106+0000","last_fullsized":"2024-09-12T22:09:53.750106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750197+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:09:53.750197+0000","last_peered":"2024-09-12T22:09:53.750197+0000","last_clean":"2024-09-12T22:09:53.750197+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:09:53.750197+0000","last_undegraded":"2024-09-12T22:09:53.750197+0000","last_fullsized":"2024-09-12T22:09:53.750197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749361+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:09:53.749361+0000","last_peered":"2024-09-12T22:09:53.749361+0000","last_clean":"2024-09-12T22:09:53.749361+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:09:53.749361+0000","last_undegraded":"2024-09-12T22:09:53.749361+0000","last_fullsized":"2024-09-12T22:09:53.749361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750864+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:09:53.750864+0000","last_peered":"2024-09-12T22:09:53.750864+0000","last_clean":"2024-09-12T22:09:53.750864+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:09:53.750864+0000","last_undegraded":"2024-09-12T22:09:53.750864+0000","last_fullsized":"2024-09-12T22:09:53.750864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749640+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:09:53.749640+0000","last_peered":"2024-09-12T22:09:53.749640+0000","last_clean":"2024-09-12T22:09:53.749640+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:09:53.749640+0000","last_undegraded":"2024-09-12T22:09:53.749640+0000","last_fullsized":"2024-09-12T22:09:53.749640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749568+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:09:53.749568+0000","last_peered":"2024-09-12T22:09:53.749568+0000","last_clean":"2024-09-12T22:09:53.749568+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:09:53.749568+0000","last_undegraded":"2024-09-12T22:09:53.749568+0000","last_fullsized":"2024-09-12T22:09:53.749568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749527+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:09:53.749527+0000","last_peered":"2024-09-12T22:09:53.749527+0000","last_clean":"2024-09-12T22:09:53.749527+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:09:53.749527+0000","last_undegraded":"2024-09-12T22:09:53.749527+0000","last_fullsized":"2024-09-12T22:09:53.749527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750254+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:09:53.750254+0000","last_peered":"2024-09-12T22:09:53.750254+0000","last_clean":"2024-09-12T22:09:53.750254+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:09:53.750254+0000","last_undegraded":"2024-09-12T22:09:53.750254+0000","last_fullsized":"2024-09-12T22:09:53.750254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749473+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:09:53.749473+0000","last_peered":"2024-09-12T22:09:53.749473+0000","last_clean":"2024-09-12T22:09:53.749473+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:09:53.749473+0000","last_undegraded":"2024-09-12T22:09:53.749473+0000","last_fullsized":"2024-09-12T22:09:53.749473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750097+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:09:53.750097+0000","last_peered":"2024-09-12T22:09:53.750097+0000","last_clean":"2024-09-12T22:09:53.750097+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:09:53.750097+0000","last_undegraded":"2024-09-12T22:09:53.750097+0000","last_fullsized":"2024-09-12T22:09:53.750097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750040+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:09:53.750040+0000","last_peered":"2024-09-12T22:09:53.750040+0000","last_clean":"2024-09-12T22:09:53.750040+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:09:53.750040+0000","last_undegraded":"2024-09-12T22:09:53.750040+0000","last_fullsized":"2024-09-12T22:09:53.750040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749990+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:09:53.749990+0000","last_peered":"2024-09-12T22:09:53.749990+0000","last_clean":"2024-09-12T22:09:53.749990+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:09:53.749990+0000","last_undegraded":"2024-09-12T22:09:53.749990+0000","last_fullsized":"2024-09-12T22:09:53.749990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750937+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:09:53.750937+0000","last_peered":"2024-09-12T22:09:53.750937+0000","last_clean":"2024-09-12T22:09:53.750937+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:09:53.750937+0000","last_undegraded":"2024-09-12T22:09:53.750937+0000","last_fullsized":"2024-09-12T22:09:53.750937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749167+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:09:53.749167+0000","last_peered":"2024-09-12T22:09:53.749167+0000","last_clean":"2024-09-12T22:09:53.749167+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:09:53.749167+0000","last_undegraded":"2024-09-12T22:09:53.749167+0000","last_fullsized":"2024-09-12T22:09:53.749167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750122+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:09:53.750122+0000","last_peered":"2024-09-12T22:09:53.750122+0000","last_clean":"2024-09-12T22:09:53.750122+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:09:53.750122+0000","last_undegraded":"2024-09-12T22:09:53.750122+0000","last_fullsized":"2024-09-12T22:09:53.750122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750372+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:09:53.750372+0000","last_peered":"2024-09-12T22:09:53.750372+0000","last_clean":"2024-09-12T22:09:53.750372+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:09:53.750372+0000","last_undegraded":"2024-09-12T22:09:53.750372+0000","last_fullsized":"2024-09-12T22:09:53.750372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749023+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:09:53.749023+0000","last_peered":"2024-09-12T22:09:53.749023+0000","last_clean":"2024-09-12T22:09:53.749023+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:09:53.749023+0000","last_undegraded":"2024-09-12T22:09:53.749023+0000","last_fullsized":"2024-09-12T22:09:53.749023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750174+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:09:53.750174+0000","last_peered":"2024-09-12T22:09:53.750174+0000","last_clean":"2024-09-12T22:09:53.750174+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:09:53.750174+0000","last_undegraded":"2024-09-12T22:09:53.750174+0000","last_fullsized":"2024-09-12T22:09:53.750174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750667+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:09:53.750667+0000","last_peered":"2024-09-12T22:09:53.750667+0000","last_clean":"2024-09-12T22:09:53.750667+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:09:53.750667+0000","last_undegraded":"2024-09-12T22:09:53.750667+0000","last_fullsized":"2024-09-12T22:09:53.750667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748940+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:09:53.748940+0000","last_peered":"2024-09-12T22:09:53.748940+0000","last_clean":"2024-09-12T22:09:53.748940+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:09:53.748940+0000","last_undegraded":"2024-09-12T22:09:53.748940+0000","last_fullsized":"2024-09-12T22:09:53.748940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749960+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:09:53.749960+0000","last_peered":"2024-09-12T22:09:53.749960+0000","last_clean":"2024-09-12T22:09:53.749960+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:09:53.749960+0000","last_undegraded":"2024-09-12T22:09:53.749960+0000","last_fullsized":"2024-09-12T22:09:53.749960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748860+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:09:53.748860+0000","last_peered":"2024-09-12T22:09:53.748860+0000","last_clean":"2024-09-12T22:09:53.748860+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:09:53.748860+0000","last_undegraded":"2024-09-12T22:09:53.748860+0000","last_fullsized":"2024-09-12T22:09:53.748860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750337+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:09:53.750337+0000","last_peered":"2024-09-12T22:09:53.750337+0000","last_clean":"2024-09-12T22:09:53.750337+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:09:53.750337+0000","last_undegraded":"2024-09-12T22:09:53.750337+0000","last_fullsized":"2024-09-12T22:09:53.750337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.748927+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:09:53.748927+0000","last_peered":"2024-09-12T22:09:53.748927+0000","last_clean":"2024-09-12T22:09:53.748927+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:09:53.748927+0000","last_undegraded":"2024-09-12T22:09:53.748927+0000","last_fullsized":"2024-09-12T22:09:53.748927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749615+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:09:53.749615+0000","last_peered":"2024-09-12T22:09:53.749615+0000","last_clean":"2024-09-12T22:09:53.749615+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:09:53.749615+0000","last_undegraded":"2024-09-12T22:09:53.749615+0000","last_fullsized":"2024-09-12T22:09:53.749615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749070+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:09:53.749070+0000","last_peered":"2024-09-12T22:09:53.749070+0000","last_clean":"2024-09-12T22:09:53.749070+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:09:53.749070+0000","last_undegraded":"2024-09-12T22:09:53.749070+0000","last_fullsized":"2024-09-12T22:09:53.749070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749881+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:09:53.749881+0000","last_peered":"2024-09-12T22:09:53.749881+0000","last_clean":"2024-09-12T22:09:53.749881+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:09:53.749881+0000","last_undegraded":"2024-09-12T22:09:53.749881+0000","last_fullsized":"2024-09-12T22:09:53.749881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749463+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:09:53.749463+0000","last_peered":"2024-09-12T22:09:53.749463+0000","last_clean":"2024-09-12T22:09:53.749463+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:09:53.749463+0000","last_undegraded":"2024-09-12T22:09:53.749463+0000","last_fullsized":"2024-09-12T22:09:53.749463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749643+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:09:53.749643+0000","last_peered":"2024-09-12T22:09:53.749643+0000","last_clean":"2024-09-12T22:09:53.749643+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:09:53.749643+0000","last_undegraded":"2024-09-12T22:09:53.749643+0000","last_fullsized":"2024-09-12T22:09:53.749643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749562+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:09:53.749562+0000","last_peered":"2024-09-12T22:09:53.749562+0000","last_clean":"2024-09-12T22:09:53.749562+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:09:53.749562+0000","last_undegraded":"2024-09-12T22:09:53.749562+0000","last_fullsized":"2024-09-12T22:09:53.749562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750091+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:09:53.750091+0000","last_peered":"2024-09-12T22:09:53.750091+0000","last_clean":"2024-09-12T22:09:53.750091+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:09:53.750091+0000","last_undegraded":"2024-09-12T22:09:53.750091+0000","last_fullsized":"2024-09-12T22:09:53.750091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750238+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:09:53.750238+0000","last_peered":"2024-09-12T22:09:53.750238+0000","last_clean":"2024-09-12T22:09:53.750238+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:09:53.750238+0000","last_undegraded":"2024-09-12T22:09:53.750238+0000","last_fullsized":"2024-09-12T22:09:53.750238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749930+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:09:53.749930+0000","last_peered":"2024-09-12T22:09:53.749930+0000","last_clean":"2024-09-12T22:09:53.749930+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:09:53.749930+0000","last_undegraded":"2024-09-12T22:09:53.749930+0000","last_fullsized":"2024-09-12T22:09:53.749930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.750002+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:09:53.750002+0000","last_peered":"2024-09-12T22:09:53.750002+0000","last_clean":"2024-09-12T22:09:53.750002+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:09:53.750002+0000","last_undegraded":"2024-09-12T22:09:53.750002+0000","last_fullsized":"2024-09-12T22:09:53.750002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749490+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:09:53.749490+0000","last_peered":"2024-09-12T22:09:53.749490+0000","last_clean":"2024-09-12T22:09:53.749490+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:09:53.749490+0000","last_undegraded":"2024-09-12T22:09:53.749490+0000","last_fullsized":"2024-09-12T22:09:53.749490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749863+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:09:53.749863+0000","last_peered":"2024-09-12T22:09:53.749863+0000","last_clean":"2024-09-12T22:09:53.749863+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:09:53.749863+0000","last_undegraded":"2024-09-12T22:09:53.749863+0000","last_fullsized":"2024-09-12T22:09:53.749863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749656+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:09:53.749656+0000","last_peered":"2024-09-12T22:09:53.749656+0000","last_clean":"2024-09-12T22:09:53.749656+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:09:53.749656+0000","last_undegraded":"2024-09-12T22:09:53.749656+0000","last_fullsized":"2024-09-12T22:09:53.749656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:09:53.749951+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:09:53.749951+0000","last_peered":"2024-09-12T22:09:53.749951+0000","last_clean":"2024-09-12T22:09:53.749951+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:09:53.749951+0000","last_undegraded":"2024-09-12T22:09:53.749951+0000","last_fullsized":"2024-09-12T22:09:53.749951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:10:06.818 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:10:06.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T22:10:07.142 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 20 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 2fe6789e-9afe-4094-9a02-5d2cb3971ecc 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T22:09:28.783000+0000 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-12T22:09:53.744997+0000 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:crush_version 4 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:full_ratio 0.95 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:backfillfull_ratio 0.9 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:nearfull_ratio 0.85 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:require_min_compat_client luminous 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:min_compat_client jewel 2024-09-12T22:10:07.143 INFO:teuthology.orchestra.run.smithi019.stdout:require_osd_release squid 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:stretch_mode_enabled false 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:max_osd 3 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/3734941882,v1:172.21.15.107:6801/3734941882] [v2:172.21.15.107:6802/3734941882,v1:172.21.15.107:6803/3734941882] exists,up 65e58e9b-56bf-491e-aaa7-2c19805f71f8 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/2199871564,v1:172.21.15.148:6801/2199871564] [v2:172.21.15.148:6802/2199871564,v1:172.21.15.148:6803/2199871564] exists,up 12c1612a-797e-4568-b2ad-a072c212de6a 2024-09-12T22:10:07.144 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/2383753808,v1:172.21.15.164:6801/2383753808] [v2:172.21.15.164:6802/2383753808,v1:172.21.15.164:6803/2383753808] exists,up 975ed872-557f-49b3-a957-216e3ae8dbb6 2024-09-12T22:10:07.157 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/3734941882,v1:172.21.15.107:6801/3734941882] [v2:172.21.15.107:6802/3734941882,v1:172.21.15.107:6803/3734941882] exists,up 65e58e9b-56bf-491e-aaa7-2c19805f71f8', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/2199871564,v1:172.21.15.148:6801/2199871564] [v2:172.21.15.148:6802/2199871564,v1:172.21.15.148:6803/2199871564] exists,up 12c1612a-797e-4568-b2ad-a072c212de6a', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/2383753808,v1:172.21.15.164:6801/2383753808] [v2:172.21.15.164:6802/2383753808,v1:172.21.15.164:6803/2383753808] exists,up 975ed872-557f-49b3-a957-216e3ae8dbb6'] 2024-09-12T22:10:07.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mon.a", 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster": "ceph", 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket_mode": "", 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_client_required": "cephx, none", 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_cluster_required": "cephx", 2024-09-12T22:10:07.260 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_debug": "true", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_required": "cephx", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_supported": "cephx", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio": "true", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_reap_max": "16", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_async_discard": "false", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_block_size": "4096", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio": "false", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T22:10:07.261 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_enable_discard": "false", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry": "3", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash": "0", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring": "false", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_hipri": "false", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T22:10:07.262 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_type": "", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_allocator": "hybrid", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_buffered_io": "true", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T22:10:07.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery": "false", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_sync_write": "false", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocator": "hybrid", 2024-09-12T22:10:07.264 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_create": "true", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_create": "false", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_path": "", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_size": "0", 2024-09-12T22:10:07.265 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_path": "", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_size": "107374182400", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_create": "false", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_path": "", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs": "true", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:10:07.266 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune": "true", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size": "0", 2024-09-12T22:10:07.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_type": "2q", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_clone_cow": "true", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T22:10:07.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_mode": "none", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_freelist": "false", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T22:10:07.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T22:10:07.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fail_eio": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T22:10:07.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T22:10:07.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size": "0", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T22:10:07.273 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_mem": "512", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T22:10:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_tracing": "false", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T22:10:07.275 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T22:10:07.276 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_version": "2", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_signatures": "false", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_version": "2", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_signatures": "false", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_version": "2", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_sign_messages": "true", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "chdir": "", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "client_acl_type": "", 2024-09-12T22:10:07.277 INFO:teuthology.orchestra.run.smithi019.stdout: "client_asio_thread_count": "2", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_mid": "0.750000", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_size": "16384", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_caps_release_delay": "5", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_check_pool_perm": "true", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_force_sync_read": "false", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_getattr_caps": "false", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_inject_features": "", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_remount": "false", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_dirsize_rbytes": "true", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_force_lazyio": "false", 2024-09-12T22:10:07.278 INFO:teuthology.orchestra.run.smithi019.stdout: "client_fs": "", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_release_failure": "false", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_max_inline_size": "4096", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mds_namespace": "", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_metadata": "", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_gid": "-1", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_timeout": "300", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_uid": "-1", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mountpoint": "/", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_notify_timeout": "10", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc": "true", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T22:10:07.279 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_objects": "1000", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_size": "209715200", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_permissions": "true", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota": "true", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota_df": "true", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_bytes": "0", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_periods": "4", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_min": "131072", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_reconnect_stale": "false", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_shutdown_timeout": "30", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_snapdir": ".snap", 2024-09-12T22:10:07.280 INFO:teuthology.orchestra.run.smithi019.stdout: "client_tick_interval": "1", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "client_trace": "", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_faked_inos": "false", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_random_mds": "false", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog": "false", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_port": "12201", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_monitors": "default=true", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog": "false", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_level": "info", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "-", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network": "", 2024-09-12T22:10:07.281 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network_interface": "", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_isal": "false", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_level": "5", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zstd_level": "1", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T22:10:07.282 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location": "", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook": "", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook_timeout": "10", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "daemonize": "false", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "daos_pool": "tank", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_alienstore": "0/5", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok": "1/5", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok_assert_abort": "false", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T22:10:07.283 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_auth": "20/20", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bdev": "1/3", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluefs": "1/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluestore": "1/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_buffer": "0/1", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephsqlite": "0/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_client": "0/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_compressor": "1/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_context": "0/1", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crush": "1/1", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crypto": "1/5", 2024-09-12T22:10:07.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cyanstore": "0/5", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_dpdk": "1/5", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_eventtrace": "1/5", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filer": "0/1", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filestore": "1/3", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_finisher": "1/1", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_fuse": "1/5", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_javaclient": "1/5", 2024-09-12T22:10:07.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journal": "1/3", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journaler": "0/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_kstore": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_lockdep": "0/1", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mclock": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_balancer": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_locker": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_migrator": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_memstore": "1/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgr": "2/5", 2024-09-12T22:10:07.286 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgrc": "1/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mon": "20/20", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_monc": "0/10", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ms": "1/1", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_none": "0/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objclass": "0/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objectcacher": "0/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objecter": "0/1", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_optracker": "0/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_osd": "1/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_paxos": "20/20", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_perfcounter": "1/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_prioritycache": "1/5", 2024-09-12T22:10:07.287 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rados": "0/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd": "0/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_replay": "0/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_refs": "0/0", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_reserver": "1/1", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw": "1/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_access": "1/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_flight": "1/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_sync": "1/5", 2024-09-12T22:10:07.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rocksdb": "4/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_backref": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cache": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_device": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_epm": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_journal": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_lba": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_odata": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_omap": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_onode": "0/5", 2024-09-12T22:10:07.289 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_t": "0/5", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_tm": "0/5", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_striper": "0/1", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_test": "0/5", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_throttle": "1/1", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_timer": "0/1", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_tp": "0/5", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_trace": "1/5", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "device_failure_prediction_mode": "none", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_graylog": "false", 2024-09-12T22:10:07.290 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_journald": "false", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_stderr": "true", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_syslog": "false", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "event_tracing": "false", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_http_port": "9926", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_prio_limit": "5", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sort_metrics": "true", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_stats_period": "5", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "fake_statfs_for_testing": "0", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "fatal_signal_handlers": "true", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_purge_ops": "10", 2024-09-12T22:10:07.291 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_truncate_ops": "128", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_blackhole": "false", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_snap": "true", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_caller_concurrency": "10", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_omap_check": "false", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_verify_split": "false", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_dump_file": "", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T22:10:07.292 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fadvise": "true", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fail_eio": "true", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_size": "128", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap": "false", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_inject_stall": "0", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_parallel": "false", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_trailing": "false", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_writeahead": "false", 2024-09-12T22:10:07.293 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_kill_at": "0", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T22:10:07.294 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_merge_threshold": "-10", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_odsync_write": "false", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend_path": "", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_threads": "2", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_punch_hole": "false", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T22:10:07.295 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_ops": "50", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_seek_data_hole": "false", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc": "false", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T22:10:07.296 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_splice": "false", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_multiple": "2", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_rand_factor": "20", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_update_to": "1000", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T22:10:07.297 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_xfs_extsize": "false", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_zfs_snap": "false", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fio_dir": "/tmp/fio", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "2fe6789e-9afe-4094-9a02-5d2cb3971ecc", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_allow_other": "true", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_big_writes": "true", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_debug": "false", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_default_permissions": "false", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_disable_pagecache": "false", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_max_write": "0", 2024-09-12T22:10:07.298 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_multithreaded": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_require_active_mds": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_set_user_groups": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_move": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_read": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_write": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_target_name": "ceph", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_file": "", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_inject_failure": "0", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_interval": "5", 2024-09-12T22:10:07.299 INFO:teuthology.orchestra.run.smithi019.stdout: "host": "smithi019", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T22:10:07.300 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "inject_early_sigterm": "false", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "jaeger_agent_port": "6799", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "jaeger_tracing_enable": "false", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_aio": "true", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_align_min_size": "65536", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_align": "true", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_size": "4096", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_dio": "true", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_discard": "false", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_force_aio": "false", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_ignore_corruption": "false", 2024-09-12T22:10:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_entries": "100", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_replay_from": "0", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_write_header_frequency": "0", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_zero_on_create": "false", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prefetch_periods": "10", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prezero_periods": "5", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_write_head_interval": "15", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "", 2024-09-12T22:10:07.302 INFO:teuthology.orchestra.run.smithi019.stdout: "keyfile": "", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_backend": "rocksdb", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_bytes": "67108864", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_ops": "512", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_onode_map_size": "1024", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_transaction": "false", 2024-09-12T22:10:07.303 INFO:teuthology.orchestra.run.smithi019.stdout: "librados_thread_count": "2", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep": "false", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep_force_backtrace": "false", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_coarse_timestamps": "true", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_flush_on_exit": "false", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_port": "12201", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_new": "1000", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_recent": "10000", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stderr_prefix": "", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": "true", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_graylog": "false", 2024-09-12T22:10:07.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_journald": "false", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_stderr": "false", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_syslog": "false", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_action_on_write_error": "1", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_alternate_name_max": "8192", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_asio_thread_count": "2", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_export_pin": "true", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T22:10:07.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_interval": "10", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max": "-1", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max_until": "-1", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_merge_size": "50", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_mode": "0", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T22:10:07.306 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_bits": "3", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_size": "10000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_mid": "0.700000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T22:10:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_interval": "1", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T22:10:07.308 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_auth_pins": "false", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_frag": "false", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_scatterstat": "false", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_subtrees": "false", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_default_dir_hash": "2", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_defer_session_stale": "true", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T22:10:07.309 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_entries": "0", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_prefetch": "true", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_early_reply": "true", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enable_op_tracker": "true", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enforce_unique_name": "true", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T22:10:07.310 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_health_dummy": "false", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T22:10:07.311 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T22:10:07.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T22:10:07.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T22:10:07.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_join_fs": "", 2024-09-12T22:10:07.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_journal_format": "1", 2024-09-12T22:10:07.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T22:10:07.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_create_at": "0", 2024-09-12T22:10:07.312 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_export_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_import_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_link_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_openc_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_rename_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T22:10:07.313 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_events": "-1", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_segments": "128", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_pause": "false", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_segment_size": "0", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_threshold": "128", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_requests": "100000", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_export_size": "20971520", 2024-09-12T22:10:07.314 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_file_recover": "32", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_files": "64", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops": "8192", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_metrics_update_interval": "2", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_per_client": "100", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_numa_node": "-1", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_duration": "600", 2024-09-12T22:10:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_size": "20", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_log_threshold": "5", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_grace": "15", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_interval": "5", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_caps": "30000", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T22:10:07.316 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_interval": "1.000000", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_gid": "0", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_uid": "0", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T22:10:07.317 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_shutdown_check": "0", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_skip_ino": "0", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_min_uid": "0", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_rstat": "false", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_symlink_recovery": "true", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_exports": "0", 2024-09-12T22:10:07.318 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_fragments": "0", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_tick_interval": "5.000000", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_valgrind_exit": "false", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_backtrace": "1", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_scatter": "false", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_sessions": "false", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool_debug": "false", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_set": "false", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_size": "65536", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_bytes": "134217728", 2024-09-12T22:10:07.319 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_messages": "512", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_disabled_modules": "", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_messages": "128", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T22:10:07.320 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_messages": "128", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_duration": "600", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_size": "20", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_log_threshold": "5", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_messages": "8192", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_pool": "true", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_standby_modules": "true", 2024-09-12T22:10:07.321 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_period": "5", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_threshold": "5", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_tick_period": "2", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_delete": "true", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_bytes": "104857600", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T22:10:07.322 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_target_rank": "-1", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_file_level": "debug", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T22:10:07.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_start": "false", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_trim": "true", 2024-09-12T22:10:07.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cpu_threads": "4", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_crit": "5", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_warn": "5", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T22:10:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_json": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_extra_checks": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_down_uptime_grace": "60", 2024-09-12T22:10:07.326 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_default_strategy": "1", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_timeout": "5.000000", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_enable_op_tracker": "true", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_fake_pool_delete": "false", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_force_quorum_join": "false", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_log_update_period": "5", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_max_detail": "50", 2024-09-12T22:10:07.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog": "true", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host": "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host_override": "", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_initial_members": "", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease": "5.000000", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T22:10:07.328 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_full_interval": "50", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max": "10000", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max_summary": "50", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_epochs": "500", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_osd": "10000", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T22:10:07.329 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_autotune": "true", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_target": "2147483648", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_digest_period": "5", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_complaint_time": "30", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_duration": "600", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_size": "20", 2024-09-12T22:10:07.330 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_log_threshold": "5", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size": "500", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T22:10:07.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T22:10:07.332 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_report_timeout": "900", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T22:10:07.333 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_osds": "4", 2024-09-12T22:10:07.334 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_interval": "86400", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_max_keys": "100", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_timeout": "300", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_session_timeout": "300", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_smart_report_timeout": "5", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_size": "4", 2024-09-12T22:10:07.335 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T22:10:07.336 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T22:10:07.336 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_debug": "false", 2024-09-12T22:10:07.336 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T22:10:07.336 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T22:10:07.336 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T22:10:07.336 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T22:10:07.336 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_tick_interval": "5", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T22:10:07.337 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_older_version": "true", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "monmap": "", 2024-09-12T22:10:07.338 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_tracing_enabled": "false", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_op_threads": "3", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_cm": "false", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_device_name": "", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T22:10:07.339 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_sl": "3", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_type": "ib", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_reap_threshold": "5", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_before_connect": "false", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv4": "true", 2024-09-12T22:10:07.340 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv6": "false", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr1": "true", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr2": "true", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_max": "7568", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_min": "6800", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_count": "3", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_delay": "5", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_client": "false", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mds": "false", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mgr": "false", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mon": "false", 2024-09-12T22:10:07.341 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_osd": "false", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_client_mode": "crc secure", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_type": "", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_compress_secure": "false", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_data": "true", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_header": "true", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T22:10:07.342 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bug": "true", 2024-09-12T22:10:07.343 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_old_message": "true", 2024-09-12T22:10:07.343 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T22:10:07.343 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T22:10:07.343 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T22:10:07.343 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T22:10:07.343 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hugepages": "", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_lro": "true", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_pmd": "", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_port_id": "0", 2024-09-12T22:10:07.344 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_on_send": "false", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_type": "", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_network_congestion": "0", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_socket_failures": "0", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_accept_failures": "4", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_backoff": "15.000000", 2024-09-12T22:10:07.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_mode": "none", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_min_cost": "65536", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_public_type": "", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_service_mode": "crc secure", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_nodelay": "true", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T22:10:07.346 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_type": "async+posix", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "no_config_file": "false", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_ops": "1024", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_timeout": "10.000000", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objectstore_blackhole": "false", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "openssl_engine_opts": "", 2024-09-12T22:10:07.347 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_ops": "4", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_slop": "0.020000", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_asio_thread_count": "2", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T22:10:07.348 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_max": "512", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_min": "64", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_peering": "false", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_beacon_report_interval": "300", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_duration": "30", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blkin_trace_all": "false", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T22:10:07.349 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_update_on_start": "true", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_cap": "256", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_op_priority": "63", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_watch_timeout": "30", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_command_max_records": "256", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_compact_on_start": "false", 2024-09-12T22:10:07.350 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_on_start": "true", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T22:10:07.351 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_op_order": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_shutdown": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T22:10:07.352 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_trim_objects": "false", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T22:10:07.353 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_notify_timeout": "30", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_enable_op_tracker": "true", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_info": "true", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown": "true", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T22:10:07.354 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_function_tracing": "false", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_grace": "20", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_interval": "6", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_stale": "600", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T22:10:07.355 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_size": "5120", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_kill_backfill_at": "0", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_cache_size": "50", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_dedup": "true", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max": "40", 2024-09-12T22:10:07.356 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_name_len": "100", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_size": "0", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_backfills": "1", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_count": "5", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_period": "600", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_name_len": "2048", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_size": "134217728", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T22:10:07.357 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pgls": "1024", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_cost": "8388608", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_objects": "10", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_scrubs": "3", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_size": "90", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T22:10:07.358 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_profile": "balanced", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T22:10:07.359 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_base": "805306368", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target": "4294967296", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_autotune": "false", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_recovery_priority": "0", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T22:10:07.360 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_interval": "5", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_cache_shards": "32", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_node": "-1", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objecter_finishers": "1", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore": "bluestore", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_fuse": "false", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_tracing": "false", 2024-09-12T22:10:07.361 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_duration": "600", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_size": "20", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_log_threshold": "5", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards": "0", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T22:10:07.362 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_timeout": "15", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_open_classes_on_start": "true", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_os_flags": "0", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_peering_op_priority": "255", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_priority": "5", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T22:10:07.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_crimson": "false", 2024-09-12T22:10:07.364 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flags": "0", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_min_size": "0", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T22:10:07.365 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_size": "2", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_type": "replicated", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_cost": "20971520", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active": "0", 2024-09-12T22:10:07.366 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_op_priority": "3", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_priority": "5", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T22:10:07.367 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_repair_during_recovery": "false", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_cost": "52428800", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T22:10:07.368 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_end_hour": "0", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_priority": "5", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T22:10:07.369 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_skip_data_digest": "false", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_smart_report_timeout": "5", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_priority": "5", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T22:10:07.370 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_target_transaction_size": "30", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tracing": "false", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_use_stale_snap": "false", 2024-09-12T22:10:07.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_kill_at": "0", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_max_join_drift": "10", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_min": "500", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_min_wait": "0.050000", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_max": "500", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_min": "250", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_stash_full_interval": "25", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_trim_max": "500", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_trim_min": "250", 2024-09-12T22:10:07.372 INFO:teuthology.orchestra.run.smithi019.stdout: "perf": "true", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "-", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrv": "", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "public_bind_addr": "-", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "public_network": "", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "public_network_interface": "", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_enabled": "false", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_mon_op_timeout": "0", 2024-09-12T22:10:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_osd_op_timeout": "0", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_tracing": "false", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_atime_update_interval": "60", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache": "true", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T22:10:07.374 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_policy": "writearound", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_size": "33554432", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_compression_hint": "none", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_clone_format": "auto", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_data_pool": "", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_features": "61", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_format": "2", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_map_options": "", 2024-09-12T22:10:07.375 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_order": "22", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_pool": "rbd", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_stripe_count": "0", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_io_scheduler": "simple", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T22:10:07.376 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_order": "24", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_pool": "", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_splay_width": "4", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T22:10:07.377 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T22:10:07.378 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T22:10:07.379 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_op_threads": "1", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_plugins": "", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T22:10:07.380 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T22:10:07.381 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T22:10:07.382 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_tracing": "false", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_validate_names": "true", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_validate_pool": "true", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "restapi_base_url": "", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "restapi_log_level": "", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_admin_entry": "admin", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_backend_store": "rados", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_barbican_url": "", 2024-09-12T22:10:07.383 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_beast_enable_async": "true", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_enabled": "true", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T22:10:07.384 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_config_store": "rados", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_content_length_compat": "false", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cross_domain_policy": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T22:10:07.385 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T22:10:07.386 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T22:10:07.387 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T22:10:07.388 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_port": "6379", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_window": "30", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T22:10:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T22:10:07.390 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dns_name": "", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dns_s3website_name": "", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_ops_log": "false", 2024-09-12T22:10:07.391 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_static_website": "false", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_usage_log": "false", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_expose_bucket": "false", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_extended_http_attrs": "", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_filter": "none", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T22:10:07.392 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_objs": "32", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_init_timeout": "300", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T22:10:07.393 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_password": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_project": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_token": "", 2024-09-12T22:10:07.394 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_user": "", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_api_version": "2", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T22:10:07.395 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_url": "", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_objs": "32", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_worker": "3", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T22:10:07.396 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_uri": "", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_http_headers": "", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T22:10:07.397 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attr_size": "0", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_listing_results": "1000", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_notify_retries": "10", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T22:10:07.398 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T22:10:07.399 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_num_control_oids": "8", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_numa_node": "-1", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T22:10:07.400 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_tracing": "false", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_token": "", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_url": "", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T22:10:07.401 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_rados": "false", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T22:10:07.402 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_print_continue": "true", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_tracing": "false", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm": "", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm_id": "", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_region": "", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T22:10:07.403 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_request_uri": "", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_resolve_cname": "false", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_run_sync_thread": "true", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T22:10:07.404 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_script_uri": "", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_service_provider_name": "", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_client_id": "", 2024-09-12T22:10:07.405 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_client_secret": "", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_entry": "sts", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_key": "sts", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_auth_url": "", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_custom_header": "", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_need_stats": "true", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_tenant_name": "", 2024-09-12T22:10:07.406 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_url": "", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_lease_period": "120", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T22:10:07.407 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_thread_pool_size": "512", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_comment": "", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_createby": "", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_encoding": "", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_flag": "false", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_origin": "", 2024-09-12T22:10:07.408 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_tracker": "", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_max_shards": "32", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_use_opa_authz": "false", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_counters_cache": "false", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T22:10:07.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_unique_email": "true", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_verify_ssl": "true", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone": "", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone_id": "", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup": "", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup_id": "", 2024-09-12T22:10:07.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_block_size": "4096", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T22:10:07.411 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_partition_filters": "false", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_perf": "false", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T22:10:07.412 INFO:teuthology.orchestra.run.smithi019.stdout: "run_dir": "/var/run/ceph", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_block_create": "true", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_device_size": "53687091200", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_full_integrity_check": "false", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T22:10:07.413 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_main_device_type": "SSD", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_segment_size": "67108864", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "set_keepcaps": "false", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "setgroup": "", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "setuser": "", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "setuser_match_path": "", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T22:10:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: "thp": "false", 2024-09-12T22:10:07.415 INFO:teuthology.orchestra.run.smithi019.stdout: "threadpool_default_timeout": "60", 2024-09-12T22:10:07.415 INFO:teuthology.orchestra.run.smithi019.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T22:10:07.415 INFO:teuthology.orchestra.run.smithi019.stdout: "throttler_perf_counter": "true" 2024-09-12T22:10:07.415 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:10:07.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T22:10:07.533 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a: {} 2024-09-12T22:10:07.533 INFO:teuthology.orchestra.run.smithi019.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:10:07.541 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b: {} 2024-09-12T22:10:07.542 INFO:teuthology.orchestra.run.smithi019.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:10:07.550 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c: {} 2024-09-12T22:10:07.550 INFO:teuthology.orchestra.run.smithi019.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:10:07.561 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T22:10:07.561 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T22:10:07.589 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T22:10:07.589 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-12T22:10:07.589 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-12T22:10:07.589 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T22:10:07.590 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:07.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:07.590 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T22:10:07.590 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T22:10:07.591 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:10:07.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T22:10:07.591 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T22:10:07.591 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T22:10:07.592 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:07.592 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T22:10:07.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:07.593 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T22:10:07.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:10:07.595 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:07.591+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:07.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:07.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T22:10:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-09-12T22:10:07.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:10:07.680 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T22:10:07.680 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T22:10:07.680 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T22:10:07.695 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:07.692+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:07.715 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:07.715 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:07.715 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:07.715 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:07.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:07.731 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:07.766 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:07.794 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:07.793+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:07.800 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:07.800 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:07.831 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:07.832 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:07.840 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:07.895 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:07.894+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:07.943 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:07.944 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:07.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:07.998 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:07.997+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:08.049 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T22:10:08.062 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T22:10:08.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:08.063 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T22:10:08.075 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.075 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T22:10:08.079 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42769sec preferred_lft 42769sec 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T22:10:08.080 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T22:10:08.081 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T22:10:08.081 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:10:08.081 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:10:08.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-09-12T22:10:08.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-09-12T22:10:08.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-09-12T22:10:08.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T22:10:08.081 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:10:08.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:08.127 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:08.126+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:08.159 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:10:08.159 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T22:10:08.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:10:08.177 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T22:10:08.198 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:08.197+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:08.229 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.230 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.238 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:08.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:10:08.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:08.290 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T22:10:08.299 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:08.298+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:08.317 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T22:10:08.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:08.319 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T22:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.341 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.350 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:08.389 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T22:10:08.389 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T22:10:08.389 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T22:10:08.389 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T22:10:08.389 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T22:10:08.389 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:10:08.390 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:10:08.390 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T22:10:08.390 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T22:10:08.390 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T22:10:08.390 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:10:08.400 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:08.399+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:08.471 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.471 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:10:08.482 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:08.500 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:08.499+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:08.602 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:08.601+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:08.625 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.625 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.634 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:08.703 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:08.702+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:08.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:10:08.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:08.709 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T22:10:08.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:08.726 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-12T22:10:08.738 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.738 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.747 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:08.782 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:10:08.782 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:10:08.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:10:08.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T22:10:08.782 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:10:08.803 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:08.802+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:08.863 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.863 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:10:08.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:08.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:10:08.902 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T22:10:08.902 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:10:08.904 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:08.903+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:08.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:10:08.975 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:08.975 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:08.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:09.005 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:09.004+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:10:09.032 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:10:09.032 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:10:09.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T22:10:09.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T22:10:09.032 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:10:09.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:10:09.086 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.086 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:09.106 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:09.105+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:09.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:10:09.112 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T22:10:09.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T22:10:09.112 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.141 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T22:10:09.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T22:10:09.142 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.166 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T22:10:09.180 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T22:10:09.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-09-12T22:10:09.206 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:09.206+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:09.211 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.211 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.221 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:09.251 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T22:10:09.305 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-09-12T22:10:09.306 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-09-12T22:10:09.307 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-09-12T22:10:09.308 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:10:09.308 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:10:09.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:09.308 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-09-12T22:10:09.309 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:09.308+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:09.325 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.325 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.334 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:09.361 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T22:10:09.362 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T22:10:09.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-09-12T22:10:09.410 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:09.409+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:09.431 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T22:10:09.437 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.437 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.447 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:09.487 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-09-12T22:10:09.487 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-09-12T22:10:09.487 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-09-12T22:10:09.487 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-09-12T22:10:09.487 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-09-12T22:10:09.487 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-09-12T22:10:09.487 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-09-12T22:10:09.488 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-09-12T22:10:09.488 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-09-12T22:10:09.488 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-09-12T22:10:09.488 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-09-12T22:10:09.488 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-09-12T22:10:09.488 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T22:10:09.488 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-09-12T22:10:09.489 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-09-12T22:10:09.489 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-09-12T22:10:09.489 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-09-12T22:10:09.489 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-09-12T22:10:09.489 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-09-12T22:10:09.490 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T22:10:09.490 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T22:10:09.490 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T22:10:09.490 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T22:10:09.490 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-09-12T22:10:09.490 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-09-12T22:10:09.491 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-09-12T22:10:09.491 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:10:09.491 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:10:09.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:09.491 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-09-12T22:10:09.511 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:09.510+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:09.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-09-12T22:10:09.524+0000 7f9d71012480 -1 init, newargv = 0x561ff23ee150 newargc=15 2024-09-12T22:10:09.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[33048]: starting ceph client 2024-09-12T22:10:09.530 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[33048]: starting fuse 2024-09-12T22:10:09.542 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-09-12T22:10:09.542 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T22:10:09.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-09-12T22:10:09.543 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-09-12T22:10:09.543 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-09-12T22:10:09.543 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T22:10:09.543 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-09-12T22:10:09.543 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:10:09.543 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-09-12T22:10:09.544 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T22:10:09.544 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-09-12T22:10:09.544 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T22:10:09.544 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:10:09.544 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T22:10:09.545 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-09-12T22:10:09.546 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-09-12T22:10:09.546 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-09-12T22:10:09.546 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T22:10:09.546 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:10:09.546 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-09-12T22:10:09.546 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T22:10:09.560 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.560 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:09.612 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:09.611+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:09.662 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.33048.asok 2024-09-12T22:10:09.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:10:09.672 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33048.asok 2024-09-12T22:10:09.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:09.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33048.asok status 2024-09-12T22:10:09.673 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.673 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.682 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:09.713 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:09.713+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:09.784 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.784 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.793 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "086c737fa75c22d521a3932c59b31c5e1d1c9ef4", 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.1.1-314-g086c737f (086c737fa75c22d521a3932c59b31c5e1d1c9ef4) squid (stable)", 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T22:10:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "33048", 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4487, 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4487 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-09-12T22:10:09.811 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3064988165 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3064988165 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4487 192.168.0.1:0/3064988165", 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/3064988165", 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 5, 2024-09-12T22:10:09.812 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 22, 2024-09-12T22:10:09.813 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-09-12T22:10:09.813 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-09-12T22:10:09.813 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-09-12T22:10:09.813 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:10:09.814 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:09.813+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:09.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:09.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:09.818 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-09-12T22:10:09.819 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.875 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-09-12T22:10:09.875 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:10:09.875 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.905 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:09.905 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:09.914 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:09.915 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:09.914+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:09.941 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T22:10:09.957 INFO:tasks.workunit:Pulling workunits from ref 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-12T22:10:09.957 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T22:10:09.957 INFO:tasks.workunit:timeout=3h 2024-09-12T22:10:09.958 INFO:tasks.workunit:cleanup=True 2024-09-12T22:10:09.958 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.982 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:09.998 INFO:teuthology.orchestra.run.smithi019.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 22:09:50.949968106 +0000 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 22:10:09.939695171 +0000 2024-09-12T22:10:09.999 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T22:10:09.999 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T22:10:09.999 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T22:10:10.000 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:10.000 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:10.016 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:10.015+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:10.017 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:10.017 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:10.018 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:10.026 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:10.031 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-12T22:10:10.087 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T22:10:10.117 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:10.116+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:10.168 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T22:10:10.171 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.352492420000001, 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.345509963000001, 2024-09-12T22:10:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211620023999998, 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211560712000001, 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.2115288, 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:10.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211496671999999, 2024-09-12T22:10:10.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:10.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:10.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211451278999998, 2024-09-12T22:10:10.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:10.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:10.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:10.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211406312000001, 2024-09-12T22:10:10.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:10.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:10.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.219 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211370115000001, 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:10.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:10.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211338945000001, 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:10.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.211313217000001, 2024-09-12T22:10:10.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:10.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.206022378, 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:10.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/16 ondisk, result = 0)", 2024-09-12T22:10:10.236 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.963580+0000", 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.205335363, 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00079489700000000003, 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963580+0000", 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963580+0000", 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963580+0000", 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8500000000000002e-07 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963585+0000", 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0520000000000001e-06 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963592+0000", 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9e-06 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963621+0000", 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9059000000000001e-05 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964139+0000", 2024-09-12T22:10:10.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051760599999999999 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964209+0000", 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0748999999999996e-05 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964374+0000", 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016514599999999999 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.204672203000001, 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:10.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:10.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.203957076999998, 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.249 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.203785587999999, 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:10:10.255 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.203366558999999, 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084722400000000005, 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965549+0000", 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.22e-07 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965552+0000", 2024-09-12T22:10:10.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3979999999999999e-06 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965559+0000", 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6460000000000004e-06 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965564+0000", 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7980000000000002e-06 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966264+0000", 2024-09-12T22:10:10.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069969900000000002 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966272+0000", 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8620000000000003e-06 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966396+0000", 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012359900000000001 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.198190266000001, 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:10.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:10.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:10.264 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.198101169000001, 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:10.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:10.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.21637793, 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:10.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:10.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:10.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:10.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:10.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:10.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:10.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:10.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:10.276 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:10.276 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:10:10.279 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T22:10:10.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:10:10.280 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:10.280 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:10.277+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:10.379 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:10.378+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:10.386 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:10.386 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:10.395 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:10.479 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:10.479+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:10.537 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:10.538 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:10.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:10.590 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:10.589+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:10.625 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:10:10.637 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T22:10:10.168299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90132,"kb_used_data":728,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025388,"statfs":{"total":289910292480,"available":289817997312,"internally_reserved":0,"allocated":745472,"data_stored":1388076,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.098490"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156996+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:10:08.156996+0000","last_peered":"2024-09-12T22:10:08.156996+0000","last_clean":"2024-09-12T22:10:08.156996+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:10:08.156996+0000","last_undegraded":"2024-09-12T22:10:08.156996+0000","last_fullsized":"2024-09-12T22:10:08.156996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156703+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:10:08.156703+0000","last_peered":"2024-09-12T22:10:08.156703+0000","last_clean":"2024-09-12T22:10:08.156703+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:10:08.156703+0000","last_undegraded":"2024-09-12T22:10:08.156703+0000","last_fullsized":"2024-09-12T22:10:08.156703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159546+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:10:08.159546+0000","last_peered":"2024-09-12T22:10:08.159546+0000","last_clean":"2024-09-12T22:10:08.159546+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:10:08.159546+0000","last_undegraded":"2024-09-12T22:10:08.159546+0000","last_fullsized":"2024-09-12T22:10:08.159546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159583+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:10:08.159583+0000","last_peered":"2024-09-12T22:10:08.159583+0000","last_clean":"2024-09-12T22:10:08.159583+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:10:08.159583+0000","last_undegraded":"2024-09-12T22:10:08.159583+0000","last_fullsized":"2024-09-12T22:10:08.159583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156462+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:10:08.156462+0000","last_peered":"2024-09-12T22:10:08.156462+0000","last_clean":"2024-09-12T22:10:08.156462+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:10:08.156462+0000","last_undegraded":"2024-09-12T22:10:08.156462+0000","last_fullsized":"2024-09-12T22:10:08.156462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159080+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:10:08.159080+0000","last_peered":"2024-09-12T22:10:08.159080+0000","last_clean":"2024-09-12T22:10:08.159080+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:10:08.159080+0000","last_undegraded":"2024-09-12T22:10:08.159080+0000","last_fullsized":"2024-09-12T22:10:08.159080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158921+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:10:08.158921+0000","last_peered":"2024-09-12T22:10:08.158921+0000","last_clean":"2024-09-12T22:10:08.158921+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:10:08.158921+0000","last_undegraded":"2024-09-12T22:10:08.158921+0000","last_fullsized":"2024-09-12T22:10:08.158921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158670+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:10:08.158670+0000","last_peered":"2024-09-12T22:10:08.158670+0000","last_clean":"2024-09-12T22:10:08.158670+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:10:08.158670+0000","last_undegraded":"2024-09-12T22:10:08.158670+0000","last_fullsized":"2024-09-12T22:10:08.158670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158963+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:10:08.158963+0000","last_peered":"2024-09-12T22:10:08.158963+0000","last_clean":"2024-09-12T22:10:08.158963+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:10:08.158963+0000","last_undegraded":"2024-09-12T22:10:08.158963+0000","last_fullsized":"2024-09-12T22:10:08.158963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156757+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:10:08.156757+0000","last_peered":"2024-09-12T22:10:08.156757+0000","last_clean":"2024-09-12T22:10:08.156757+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:10:08.156757+0000","last_undegraded":"2024-09-12T22:10:08.156757+0000","last_fullsized":"2024-09-12T22:10:08.156757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159651+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:10:08.159651+0000","last_peered":"2024-09-12T22:10:08.159651+0000","last_clean":"2024-09-12T22:10:08.159651+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:10:08.159651+0000","last_undegraded":"2024-09-12T22:10:08.159651+0000","last_fullsized":"2024-09-12T22:10:08.159651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156421+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:10:08.156421+0000","last_peered":"2024-09-12T22:10:08.156421+0000","last_clean":"2024-09-12T22:10:08.156421+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:10:08.156421+0000","last_undegraded":"2024-09-12T22:10:08.156421+0000","last_fullsized":"2024-09-12T22:10:08.156421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156246+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:10:08.156246+0000","last_peered":"2024-09-12T22:10:08.156246+0000","last_clean":"2024-09-12T22:10:08.156246+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:10:08.156246+0000","last_undegraded":"2024-09-12T22:10:08.156246+0000","last_fullsized":"2024-09-12T22:10:08.156246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159355+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:10:08.159355+0000","last_peered":"2024-09-12T22:10:08.159355+0000","last_clean":"2024-09-12T22:10:08.159355+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:10:08.159355+0000","last_undegraded":"2024-09-12T22:10:08.159355+0000","last_fullsized":"2024-09-12T22:10:08.159355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158928+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:10:08.158928+0000","last_peered":"2024-09-12T22:10:08.158928+0000","last_clean":"2024-09-12T22:10:08.158928+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:10:08.158928+0000","last_undegraded":"2024-09-12T22:10:08.158928+0000","last_fullsized":"2024-09-12T22:10:08.158928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158714+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:10:08.158714+0000","last_peered":"2024-09-12T22:10:08.158714+0000","last_clean":"2024-09-12T22:10:08.158714+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:10:08.158714+0000","last_undegraded":"2024-09-12T22:10:08.158714+0000","last_fullsized":"2024-09-12T22:10:08.158714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159282+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:10:08.159282+0000","last_peered":"2024-09-12T22:10:08.159282+0000","last_clean":"2024-09-12T22:10:08.159282+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:10:08.159282+0000","last_undegraded":"2024-09-12T22:10:08.159282+0000","last_fullsized":"2024-09-12T22:10:08.159282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156940+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:10:08.156940+0000","last_peered":"2024-09-12T22:10:08.156940+0000","last_clean":"2024-09-12T22:10:08.156940+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:10:08.156940+0000","last_undegraded":"2024-09-12T22:10:08.156940+0000","last_fullsized":"2024-09-12T22:10:08.156940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158886+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:10:08.158886+0000","last_peered":"2024-09-12T22:10:08.158886+0000","last_clean":"2024-09-12T22:10:08.158886+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:10:08.158886+0000","last_undegraded":"2024-09-12T22:10:08.158886+0000","last_fullsized":"2024-09-12T22:10:08.158886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159223+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:10:08.159223+0000","last_peered":"2024-09-12T22:10:08.159223+0000","last_clean":"2024-09-12T22:10:08.159223+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:10:08.159223+0000","last_undegraded":"2024-09-12T22:10:08.159223+0000","last_fullsized":"2024-09-12T22:10:08.159223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159120+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:10:08.159120+0000","last_peered":"2024-09-12T22:10:08.159120+0000","last_clean":"2024-09-12T22:10:08.159120+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:10:08.159120+0000","last_undegraded":"2024-09-12T22:10:08.159120+0000","last_fullsized":"2024-09-12T22:10:08.159120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156168+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:10:08.156168+0000","last_peered":"2024-09-12T22:10:08.156168+0000","last_clean":"2024-09-12T22:10:08.156168+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:10:08.156168+0000","last_undegraded":"2024-09-12T22:10:08.156168+0000","last_fullsized":"2024-09-12T22:10:08.156168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158498+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:10:08.158498+0000","last_peered":"2024-09-12T22:10:08.158498+0000","last_clean":"2024-09-12T22:10:08.158498+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:10:08.158498+0000","last_undegraded":"2024-09-12T22:10:08.158498+0000","last_fullsized":"2024-09-12T22:10:08.158498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.155929+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:10:08.155929+0000","last_peered":"2024-09-12T22:10:08.155929+0000","last_clean":"2024-09-12T22:10:08.155929+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:10:08.155929+0000","last_undegraded":"2024-09-12T22:10:08.155929+0000","last_fullsized":"2024-09-12T22:10:08.155929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157092+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:10:08.157092+0000","last_peered":"2024-09-12T22:10:08.157092+0000","last_clean":"2024-09-12T22:10:08.157092+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:10:08.157092+0000","last_undegraded":"2024-09-12T22:10:08.157092+0000","last_fullsized":"2024-09-12T22:10:08.157092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159167+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:10:08.159167+0000","last_peered":"2024-09-12T22:10:08.159167+0000","last_clean":"2024-09-12T22:10:08.159167+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:10:08.159167+0000","last_undegraded":"2024-09-12T22:10:08.159167+0000","last_fullsized":"2024-09-12T22:10:08.159167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159685+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:10:08.159685+0000","last_peered":"2024-09-12T22:10:08.159685+0000","last_clean":"2024-09-12T22:10:08.159685+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:10:08.159685+0000","last_undegraded":"2024-09-12T22:10:08.159685+0000","last_fullsized":"2024-09-12T22:10:08.159685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156648+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:10:08.156648+0000","last_peered":"2024-09-12T22:10:08.156648+0000","last_clean":"2024-09-12T22:10:08.156648+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:10:08.156648+0000","last_undegraded":"2024-09-12T22:10:08.156648+0000","last_fullsized":"2024-09-12T22:10:08.156648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159099+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:10:08.159099+0000","last_peered":"2024-09-12T22:10:08.159099+0000","last_clean":"2024-09-12T22:10:08.159099+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:10:08.159099+0000","last_undegraded":"2024-09-12T22:10:08.159099+0000","last_fullsized":"2024-09-12T22:10:08.159099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156292+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:10:08.156292+0000","last_peered":"2024-09-12T22:10:08.156292+0000","last_clean":"2024-09-12T22:10:08.156292+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:10:08.156292+0000","last_undegraded":"2024-09-12T22:10:08.156292+0000","last_fullsized":"2024-09-12T22:10:08.156292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158539+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:10:08.158539+0000","last_peered":"2024-09-12T22:10:08.158539+0000","last_clean":"2024-09-12T22:10:08.158539+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:10:08.158539+0000","last_undegraded":"2024-09-12T22:10:08.158539+0000","last_fullsized":"2024-09-12T22:10:08.158539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158776+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:10:08.158776+0000","last_peered":"2024-09-12T22:10:08.158776+0000","last_clean":"2024-09-12T22:10:08.158776+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:10:08.158776+0000","last_undegraded":"2024-09-12T22:10:08.158776+0000","last_fullsized":"2024-09-12T22:10:08.158776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156567+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:10:08.156567+0000","last_peered":"2024-09-12T22:10:08.156567+0000","last_clean":"2024-09-12T22:10:08.156567+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:10:08.156567+0000","last_undegraded":"2024-09-12T22:10:08.156567+0000","last_fullsized":"2024-09-12T22:10:08.156567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159300+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:10:08.159300+0000","last_peered":"2024-09-12T22:10:08.159300+0000","last_clean":"2024-09-12T22:10:08.159300+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:10:08.159300+0000","last_undegraded":"2024-09-12T22:10:08.159300+0000","last_fullsized":"2024-09-12T22:10:08.159300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156776+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:10:08.156776+0000","last_peered":"2024-09-12T22:10:08.156776+0000","last_clean":"2024-09-12T22:10:08.156776+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:10:08.156776+0000","last_undegraded":"2024-09-12T22:10:08.156776+0000","last_fullsized":"2024-09-12T22:10:08.156776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158709+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:10:08.158709+0000","last_peered":"2024-09-12T22:10:08.158709+0000","last_clean":"2024-09-12T22:10:08.158709+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:10:08.158709+0000","last_undegraded":"2024-09-12T22:10:08.158709+0000","last_fullsized":"2024-09-12T22:10:08.158709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159306+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:10:08.159306+0000","last_peered":"2024-09-12T22:10:08.159306+0000","last_clean":"2024-09-12T22:10:08.159306+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:10:08.159306+0000","last_undegraded":"2024-09-12T22:10:08.159306+0000","last_fullsized":"2024-09-12T22:10:08.159306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156139+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:10:08.156139+0000","last_peered":"2024-09-12T22:10:08.156139+0000","last_clean":"2024-09-12T22:10:08.156139+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:10:08.156139+0000","last_undegraded":"2024-09-12T22:10:08.156139+0000","last_fullsized":"2024-09-12T22:10:08.156139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158963+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:10:08.158963+0000","last_peered":"2024-09-12T22:10:08.158963+0000","last_clean":"2024-09-12T22:10:08.158963+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:10:08.158963+0000","last_undegraded":"2024-09-12T22:10:08.158963+0000","last_fullsized":"2024-09-12T22:10:08.158963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158815+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:10:08.158815+0000","last_peered":"2024-09-12T22:10:08.158815+0000","last_clean":"2024-09-12T22:10:08.158815+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:10:08.158815+0000","last_undegraded":"2024-09-12T22:10:08.158815+0000","last_fullsized":"2024-09-12T22:10:08.158815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159451+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:10:08.159451+0000","last_peered":"2024-09-12T22:10:08.159451+0000","last_clean":"2024-09-12T22:10:08.159451+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:10:08.159451+0000","last_undegraded":"2024-09-12T22:10:08.159451+0000","last_fullsized":"2024-09-12T22:10:08.159451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.155963+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:10:08.155963+0000","last_peered":"2024-09-12T22:10:08.155963+0000","last_clean":"2024-09-12T22:10:08.155963+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:10:08.155963+0000","last_undegraded":"2024-09-12T22:10:08.155963+0000","last_fullsized":"2024-09-12T22:10:08.155963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156994+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:10:08.156994+0000","last_peered":"2024-09-12T22:10:08.156994+0000","last_clean":"2024-09-12T22:10:08.156994+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:10:08.156994+0000","last_undegraded":"2024-09-12T22:10:08.156994+0000","last_fullsized":"2024-09-12T22:10:08.156994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.155983+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:10:08.155983+0000","last_peered":"2024-09-12T22:10:08.155983+0000","last_clean":"2024-09-12T22:10:08.155983+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:10:08.155983+0000","last_undegraded":"2024-09-12T22:10:08.155983+0000","last_fullsized":"2024-09-12T22:10:08.155983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159857+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:10:08.159857+0000","last_peered":"2024-09-12T22:10:08.159857+0000","last_clean":"2024-09-12T22:10:08.159857+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:10:08.159857+0000","last_undegraded":"2024-09-12T22:10:08.159857+0000","last_fullsized":"2024-09-12T22:10:08.159857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159590+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:10:08.159590+0000","last_peered":"2024-09-12T22:10:08.159590+0000","last_clean":"2024-09-12T22:10:08.159590+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:10:08.159590+0000","last_undegraded":"2024-09-12T22:10:08.159590+0000","last_fullsized":"2024-09-12T22:10:08.159590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159632+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:10:08.159632+0000","last_peered":"2024-09-12T22:10:08.159632+0000","last_clean":"2024-09-12T22:10:08.159632+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:10:08.159632+0000","last_undegraded":"2024-09-12T22:10:08.159632+0000","last_fullsized":"2024-09-12T22:10:08.159632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158901+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:10:08.158901+0000","last_peered":"2024-09-12T22:10:08.158901+0000","last_clean":"2024-09-12T22:10:08.158901+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:10:08.158901+0000","last_undegraded":"2024-09-12T22:10:08.158901+0000","last_fullsized":"2024-09-12T22:10:08.158901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159297+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:10:08.159297+0000","last_peered":"2024-09-12T22:10:08.159297+0000","last_clean":"2024-09-12T22:10:08.159297+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:10:08.159297+0000","last_undegraded":"2024-09-12T22:10:08.159297+0000","last_fullsized":"2024-09-12T22:10:08.159297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159327+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:10:08.159327+0000","last_peered":"2024-09-12T22:10:08.159327+0000","last_clean":"2024-09-12T22:10:08.159327+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:10:08.159327+0000","last_undegraded":"2024-09-12T22:10:08.159327+0000","last_fullsized":"2024-09-12T22:10:08.159327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159633+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:10:08.159633+0000","last_peered":"2024-09-12T22:10:08.159633+0000","last_clean":"2024-09-12T22:10:08.159633+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:10:08.159633+0000","last_undegraded":"2024-09-12T22:10:08.159633+0000","last_fullsized":"2024-09-12T22:10:08.159633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159763+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:10:08.159763+0000","last_peered":"2024-09-12T22:10:08.159763+0000","last_clean":"2024-09-12T22:10:08.159763+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:10:08.159763+0000","last_undegraded":"2024-09-12T22:10:08.159763+0000","last_fullsized":"2024-09-12T22:10:08.159763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156380+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:10:08.156380+0000","last_peered":"2024-09-12T22:10:08.156380+0000","last_clean":"2024-09-12T22:10:08.156380+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:10:08.156380+0000","last_undegraded":"2024-09-12T22:10:08.156380+0000","last_fullsized":"2024-09-12T22:10:08.156380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159255+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:10:08.159255+0000","last_peered":"2024-09-12T22:10:08.159255+0000","last_clean":"2024-09-12T22:10:08.159255+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:10:08.159255+0000","last_undegraded":"2024-09-12T22:10:08.159255+0000","last_fullsized":"2024-09-12T22:10:08.159255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156078+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:10:08.156078+0000","last_peered":"2024-09-12T22:10:08.156078+0000","last_clean":"2024-09-12T22:10:08.156078+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:10:08.156078+0000","last_undegraded":"2024-09-12T22:10:08.156078+0000","last_fullsized":"2024-09-12T22:10:08.156078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159060+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:10:08.159060+0000","last_peered":"2024-09-12T22:10:08.159060+0000","last_clean":"2024-09-12T22:10:08.159060+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:10:08.159060+0000","last_undegraded":"2024-09-12T22:10:08.159060+0000","last_fullsized":"2024-09-12T22:10:08.159060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":228,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158979+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:10:08.158979+0000","last_peered":"2024-09-12T22:10:08.158979+0000","last_clean":"2024-09-12T22:10:08.158979+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:10:08.158979+0000","last_undegraded":"2024-09-12T22:10:08.158979+0000","last_fullsized":"2024-09-12T22:10:08.158979+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":32,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159526+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:10:08.159526+0000","last_peered":"2024-09-12T22:10:08.159526+0000","last_clean":"2024-09-12T22:10:08.159526+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:10:08.159526+0000","last_undegraded":"2024-09-12T22:10:08.159526+0000","last_fullsized":"2024-09-12T22:10:08.159526+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158840+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:10:08.158840+0000","last_peered":"2024-09-12T22:10:08.158840+0000","last_clean":"2024-09-12T22:10:08.158840+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:10:08.158840+0000","last_undegraded":"2024-09-12T22:10:08.158840+0000","last_fullsized":"2024-09-12T22:10:08.158840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159829+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:10:08.159829+0000","last_peered":"2024-09-12T22:10:08.159829+0000","last_clean":"2024-09-12T22:10:08.159829+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:10:08.159829+0000","last_undegraded":"2024-09-12T22:10:08.159829+0000","last_fullsized":"2024-09-12T22:10:08.159829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158913+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:10:08.158913+0000","last_peered":"2024-09-12T22:10:08.158913+0000","last_clean":"2024-09-12T22:10:08.158913+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:10:08.158913+0000","last_undegraded":"2024-09-12T22:10:08.158913+0000","last_fullsized":"2024-09-12T22:10:08.158913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158710+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:10:08.158710+0000","last_peered":"2024-09-12T22:10:08.158710+0000","last_clean":"2024-09-12T22:10:08.158710+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:10:08.158710+0000","last_undegraded":"2024-09-12T22:10:08.158710+0000","last_fullsized":"2024-09-12T22:10:08.158710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156806+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:10:08.156806+0000","last_peered":"2024-09-12T22:10:08.156806+0000","last_clean":"2024-09-12T22:10:08.156806+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:10:08.156806+0000","last_undegraded":"2024-09-12T22:10:08.156806+0000","last_fullsized":"2024-09-12T22:10:08.156806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158846+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:10:08.158846+0000","last_peered":"2024-09-12T22:10:08.158846+0000","last_clean":"2024-09-12T22:10:08.158846+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:10:08.158846+0000","last_undegraded":"2024-09-12T22:10:08.158846+0000","last_fullsized":"2024-09-12T22:10:08.158846+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156096+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:10:08.156096+0000","last_peered":"2024-09-12T22:10:08.156096+0000","last_clean":"2024-09-12T22:10:08.156096+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:10:08.156096+0000","last_undegraded":"2024-09-12T22:10:08.156096+0000","last_fullsized":"2024-09-12T22:10:08.156096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159055+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:10:08.159055+0000","last_peered":"2024-09-12T22:10:08.159055+0000","last_clean":"2024-09-12T22:10:08.159055+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:10:08.159055+0000","last_undegraded":"2024-09-12T22:10:08.159055+0000","last_fullsized":"2024-09-12T22:10:08.159055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159649+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:10:08.159649+0000","last_peered":"2024-09-12T22:10:08.159649+0000","last_clean":"2024-09-12T22:10:08.159649+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:10:08.159649+0000","last_undegraded":"2024-09-12T22:10:08.159649+0000","last_fullsized":"2024-09-12T22:10:08.159649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159444+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:10:08.159444+0000","last_peered":"2024-09-12T22:10:08.159444+0000","last_clean":"2024-09-12T22:10:08.159444+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:10:08.159444+0000","last_undegraded":"2024-09-12T22:10:08.159444+0000","last_fullsized":"2024-09-12T22:10:08.159444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159329+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:10:08.159329+0000","last_peered":"2024-09-12T22:10:08.159329+0000","last_clean":"2024-09-12T22:10:08.159329+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:10:08.159329+0000","last_undegraded":"2024-09-12T22:10:08.159329+0000","last_fullsized":"2024-09-12T22:10:08.159329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159919+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:10:08.159919+0000","last_peered":"2024-09-12T22:10:08.159919+0000","last_clean":"2024-09-12T22:10:08.159919+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:10:08.159919+0000","last_undegraded":"2024-09-12T22:10:08.159919+0000","last_fullsized":"2024-09-12T22:10:08.159919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159457+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:10:08.159457+0000","last_peered":"2024-09-12T22:10:08.159457+0000","last_clean":"2024-09-12T22:10:08.159457+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:10:08.159457+0000","last_undegraded":"2024-09-12T22:10:08.159457+0000","last_fullsized":"2024-09-12T22:10:08.159457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156198+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:10:08.156198+0000","last_peered":"2024-09-12T22:10:08.156198+0000","last_clean":"2024-09-12T22:10:08.156198+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:10:08.156198+0000","last_undegraded":"2024-09-12T22:10:08.156198+0000","last_fullsized":"2024-09-12T22:10:08.156198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159434+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:10:08.159434+0000","last_peered":"2024-09-12T22:10:08.159434+0000","last_clean":"2024-09-12T22:10:08.159434+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:10:08.159434+0000","last_undegraded":"2024-09-12T22:10:08.159434+0000","last_fullsized":"2024-09-12T22:10:08.159434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157120+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:10:08.157120+0000","last_peered":"2024-09-12T22:10:08.157120+0000","last_clean":"2024-09-12T22:10:08.157120+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:10:08.157120+0000","last_undegraded":"2024-09-12T22:10:08.157120+0000","last_fullsized":"2024-09-12T22:10:08.157120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156437+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:10:08.156437+0000","last_peered":"2024-09-12T22:10:08.156437+0000","last_clean":"2024-09-12T22:10:08.156437+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:10:08.156437+0000","last_undegraded":"2024-09-12T22:10:08.156437+0000","last_fullsized":"2024-09-12T22:10:08.156437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159316+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:10:08.159316+0000","last_peered":"2024-09-12T22:10:08.159316+0000","last_clean":"2024-09-12T22:10:08.159316+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:10:08.159316+0000","last_undegraded":"2024-09-12T22:10:08.159316+0000","last_fullsized":"2024-09-12T22:10:08.159316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159390+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:10:08.159390+0000","last_peered":"2024-09-12T22:10:08.159390+0000","last_clean":"2024-09-12T22:10:08.159390+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:10:08.159390+0000","last_undegraded":"2024-09-12T22:10:08.159390+0000","last_fullsized":"2024-09-12T22:10:08.159390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158612+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:10:08.158612+0000","last_peered":"2024-09-12T22:10:08.158612+0000","last_clean":"2024-09-12T22:10:08.158612+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:10:08.158612+0000","last_undegraded":"2024-09-12T22:10:08.158612+0000","last_fullsized":"2024-09-12T22:10:08.158612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159388+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:10:08.159388+0000","last_peered":"2024-09-12T22:10:08.159388+0000","last_clean":"2024-09-12T22:10:08.159388+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:10:08.159388+0000","last_undegraded":"2024-09-12T22:10:08.159388+0000","last_fullsized":"2024-09-12T22:10:08.159388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159451+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:10:08.159451+0000","last_peered":"2024-09-12T22:10:08.159451+0000","last_clean":"2024-09-12T22:10:08.159451+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:10:08.159451+0000","last_undegraded":"2024-09-12T22:10:08.159451+0000","last_fullsized":"2024-09-12T22:10:08.159451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156021+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:10:08.156021+0000","last_peered":"2024-09-12T22:10:08.156021+0000","last_clean":"2024-09-12T22:10:08.156021+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:10:08.156021+0000","last_undegraded":"2024-09-12T22:10:08.156021+0000","last_fullsized":"2024-09-12T22:10:08.156021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159281+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:10:08.159281+0000","last_peered":"2024-09-12T22:10:08.159281+0000","last_clean":"2024-09-12T22:10:08.159281+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:10:08.159281+0000","last_undegraded":"2024-09-12T22:10:08.159281+0000","last_fullsized":"2024-09-12T22:10:08.159281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159524+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:10:08.159524+0000","last_peered":"2024-09-12T22:10:08.159524+0000","last_clean":"2024-09-12T22:10:08.159524+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:10:08.159524+0000","last_undegraded":"2024-09-12T22:10:08.159524+0000","last_fullsized":"2024-09-12T22:10:08.159524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158598+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:10:08.158598+0000","last_peered":"2024-09-12T22:10:08.158598+0000","last_clean":"2024-09-12T22:10:08.158598+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:10:08.158598+0000","last_undegraded":"2024-09-12T22:10:08.158598+0000","last_fullsized":"2024-09-12T22:10:08.158598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157041+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:10:08.157041+0000","last_peered":"2024-09-12T22:10:08.157041+0000","last_clean":"2024-09-12T22:10:08.157041+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:10:08.157041+0000","last_undegraded":"2024-09-12T22:10:08.157041+0000","last_fullsized":"2024-09-12T22:10:08.157041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159371+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:10:08.159371+0000","last_peered":"2024-09-12T22:10:08.159371+0000","last_clean":"2024-09-12T22:10:08.159371+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:10:08.159371+0000","last_undegraded":"2024-09-12T22:10:08.159371+0000","last_fullsized":"2024-09-12T22:10:08.159371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158616+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:10:08.158616+0000","last_peered":"2024-09-12T22:10:08.158616+0000","last_clean":"2024-09-12T22:10:08.158616+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:10:08.158616+0000","last_undegraded":"2024-09-12T22:10:08.158616+0000","last_fullsized":"2024-09-12T22:10:08.158616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159217+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:10:08.159217+0000","last_peered":"2024-09-12T22:10:08.159217+0000","last_clean":"2024-09-12T22:10:08.159217+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:10:08.159217+0000","last_undegraded":"2024-09-12T22:10:08.159217+0000","last_fullsized":"2024-09-12T22:10:08.159217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158589+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:10:08.158589+0000","last_peered":"2024-09-12T22:10:08.158589+0000","last_clean":"2024-09-12T22:10:08.158589+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:10:08.158589+0000","last_undegraded":"2024-09-12T22:10:08.158589+0000","last_fullsized":"2024-09-12T22:10:08.158589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157109+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:10:08.157109+0000","last_peered":"2024-09-12T22:10:08.157109+0000","last_clean":"2024-09-12T22:10:08.157109+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:10:08.157109+0000","last_undegraded":"2024-09-12T22:10:08.157109+0000","last_fullsized":"2024-09-12T22:10:08.157109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158693+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:10:08.158693+0000","last_peered":"2024-09-12T22:10:08.158693+0000","last_clean":"2024-09-12T22:10:08.158693+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:10:08.158693+0000","last_undegraded":"2024-09-12T22:10:08.158693+0000","last_fullsized":"2024-09-12T22:10:08.158693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159074+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:10:08.159074+0000","last_peered":"2024-09-12T22:10:08.159074+0000","last_clean":"2024-09-12T22:10:08.159074+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:10:08.159074+0000","last_undegraded":"2024-09-12T22:10:08.159074+0000","last_fullsized":"2024-09-12T22:10:08.159074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158691+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:10:08.158691+0000","last_peered":"2024-09-12T22:10:08.158691+0000","last_clean":"2024-09-12T22:10:08.158691+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:10:08.158691+0000","last_undegraded":"2024-09-12T22:10:08.158691+0000","last_fullsized":"2024-09-12T22:10:08.158691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156669+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:10:08.156669+0000","last_peered":"2024-09-12T22:10:08.156669+0000","last_clean":"2024-09-12T22:10:08.156669+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:10:08.156669+0000","last_undegraded":"2024-09-12T22:10:08.156669+0000","last_fullsized":"2024-09-12T22:10:08.156669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156348+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:10:08.156348+0000","last_peered":"2024-09-12T22:10:08.156348+0000","last_clean":"2024-09-12T22:10:08.156348+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:10:08.156348+0000","last_undegraded":"2024-09-12T22:10:08.156348+0000","last_fullsized":"2024-09-12T22:10:08.156348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156505+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:10:08.156505+0000","last_peered":"2024-09-12T22:10:08.156505+0000","last_clean":"2024-09-12T22:10:08.156505+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:10:08.156505+0000","last_undegraded":"2024-09-12T22:10:08.156505+0000","last_fullsized":"2024-09-12T22:10:08.156505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156591+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:10:08.156591+0000","last_peered":"2024-09-12T22:10:08.156591+0000","last_clean":"2024-09-12T22:10:08.156591+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:10:08.156591+0000","last_undegraded":"2024-09-12T22:10:08.156591+0000","last_fullsized":"2024-09-12T22:10:08.156591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159213+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:10:08.159213+0000","last_peered":"2024-09-12T22:10:08.159213+0000","last_clean":"2024-09-12T22:10:08.159213+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:10:08.159213+0000","last_undegraded":"2024-09-12T22:10:08.159213+0000","last_fullsized":"2024-09-12T22:10:08.159213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159428+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:10:08.159428+0000","last_peered":"2024-09-12T22:10:08.159428+0000","last_clean":"2024-09-12T22:10:08.159428+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:10:08.159428+0000","last_undegraded":"2024-09-12T22:10:08.159428+0000","last_fullsized":"2024-09-12T22:10:08.159428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159500+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:10:08.159500+0000","last_peered":"2024-09-12T22:10:08.159500+0000","last_clean":"2024-09-12T22:10:08.159500+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:10:08.159500+0000","last_undegraded":"2024-09-12T22:10:08.159500+0000","last_fullsized":"2024-09-12T22:10:08.159500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156885+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:10:08.156885+0000","last_peered":"2024-09-12T22:10:08.156885+0000","last_clean":"2024-09-12T22:10:08.156885+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:10:08.156885+0000","last_undegraded":"2024-09-12T22:10:08.156885+0000","last_fullsized":"2024-09-12T22:10:08.156885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156461+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:10:08.156461+0000","last_peered":"2024-09-12T22:10:08.156461+0000","last_clean":"2024-09-12T22:10:08.156461+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:10:08.156461+0000","last_undegraded":"2024-09-12T22:10:08.156461+0000","last_fullsized":"2024-09-12T22:10:08.156461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159289+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:10:08.159289+0000","last_peered":"2024-09-12T22:10:08.159289+0000","last_clean":"2024-09-12T22:10:08.159289+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:10:08.159289+0000","last_undegraded":"2024-09-12T22:10:08.159289+0000","last_fullsized":"2024-09-12T22:10:08.159289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158887+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:10:08.158887+0000","last_peered":"2024-09-12T22:10:08.158887+0000","last_clean":"2024-09-12T22:10:08.158887+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:10:08.158887+0000","last_undegraded":"2024-09-12T22:10:08.158887+0000","last_fullsized":"2024-09-12T22:10:08.158887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159166+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:10:08.159166+0000","last_peered":"2024-09-12T22:10:08.159166+0000","last_clean":"2024-09-12T22:10:08.159166+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:10:08.159166+0000","last_undegraded":"2024-09-12T22:10:08.159166+0000","last_fullsized":"2024-09-12T22:10:08.159166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":659656,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":660291,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":68129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:10:10.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:10:10.652 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.366069119999999, 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.981048055999999, 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691882211999999, 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691826210999999, 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691793594, 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691766926, 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691697713, 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691651184000001, 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691622106000001, 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691596147999999, 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691552466000001, 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691524894000001, 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691487711000001, 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691441085000001, 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691399512, 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691339192000001, 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691296817000001, 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691262903999998, 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691230533999999, 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.691188361000002, 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:10.782 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:10.784 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:10.783+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:10.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:10.885 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:10.884+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:10.899 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:10.899 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-12T22:10:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:10.908 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:10.993 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:10.992+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:11.053 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:11.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:11.053 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-12T22:10:11.053 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-12T22:10:11.053 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:11.062 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:11.078 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:11.080 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:10:11.086 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:11.086+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:11.089 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T22:10:10.168299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90132,"kb_used_data":728,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025388,"statfs":{"total":289910292480,"available":289817997312,"internally_reserved":0,"allocated":745472,"data_stored":1388076,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.098490"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156996+0000","last_change":"2024-09-12T22:09:50.969403+0000","last_active":"2024-09-12T22:10:08.156996+0000","last_peered":"2024-09-12T22:10:08.156996+0000","last_clean":"2024-09-12T22:10:08.156996+0000","last_became_active":"2024-09-12T22:09:50.968889+0000","last_became_peered":"2024-09-12T22:09:50.968889+0000","last_unstale":"2024-09-12T22:10:08.156996+0000","last_undegraded":"2024-09-12T22:10:08.156996+0000","last_fullsized":"2024-09-12T22:10:08.156996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156703+0000","last_change":"2024-09-12T22:09:50.968223+0000","last_active":"2024-09-12T22:10:08.156703+0000","last_peered":"2024-09-12T22:10:08.156703+0000","last_clean":"2024-09-12T22:10:08.156703+0000","last_became_active":"2024-09-12T22:09:50.967933+0000","last_became_peered":"2024-09-12T22:09:50.967933+0000","last_unstale":"2024-09-12T22:10:08.156703+0000","last_undegraded":"2024-09-12T22:10:08.156703+0000","last_fullsized":"2024-09-12T22:10:08.156703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159546+0000","last_change":"2024-09-12T22:09:50.969712+0000","last_active":"2024-09-12T22:10:08.159546+0000","last_peered":"2024-09-12T22:10:08.159546+0000","last_clean":"2024-09-12T22:10:08.159546+0000","last_became_active":"2024-09-12T22:09:50.968121+0000","last_became_peered":"2024-09-12T22:09:50.968121+0000","last_unstale":"2024-09-12T22:10:08.159546+0000","last_undegraded":"2024-09-12T22:10:08.159546+0000","last_fullsized":"2024-09-12T22:10:08.159546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159583+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:10:08.159583+0000","last_peered":"2024-09-12T22:10:08.159583+0000","last_clean":"2024-09-12T22:10:08.159583+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:10:08.159583+0000","last_undegraded":"2024-09-12T22:10:08.159583+0000","last_fullsized":"2024-09-12T22:10:08.159583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156462+0000","last_change":"2024-09-12T22:09:50.968296+0000","last_active":"2024-09-12T22:10:08.156462+0000","last_peered":"2024-09-12T22:10:08.156462+0000","last_clean":"2024-09-12T22:10:08.156462+0000","last_became_active":"2024-09-12T22:09:50.967808+0000","last_became_peered":"2024-09-12T22:09:50.967808+0000","last_unstale":"2024-09-12T22:10:08.156462+0000","last_undegraded":"2024-09-12T22:10:08.156462+0000","last_fullsized":"2024-09-12T22:10:08.156462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159080+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:10:08.159080+0000","last_peered":"2024-09-12T22:10:08.159080+0000","last_clean":"2024-09-12T22:10:08.159080+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:10:08.159080+0000","last_undegraded":"2024-09-12T22:10:08.159080+0000","last_fullsized":"2024-09-12T22:10:08.159080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158921+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:10:08.158921+0000","last_peered":"2024-09-12T22:10:08.158921+0000","last_clean":"2024-09-12T22:10:08.158921+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:10:08.158921+0000","last_undegraded":"2024-09-12T22:10:08.158921+0000","last_fullsized":"2024-09-12T22:10:08.158921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158670+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:10:08.158670+0000","last_peered":"2024-09-12T22:10:08.158670+0000","last_clean":"2024-09-12T22:10:08.158670+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:10:08.158670+0000","last_undegraded":"2024-09-12T22:10:08.158670+0000","last_fullsized":"2024-09-12T22:10:08.158670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158963+0000","last_change":"2024-09-12T22:09:50.962245+0000","last_active":"2024-09-12T22:10:08.158963+0000","last_peered":"2024-09-12T22:10:08.158963+0000","last_clean":"2024-09-12T22:10:08.158963+0000","last_became_active":"2024-09-12T22:09:50.961333+0000","last_became_peered":"2024-09-12T22:09:50.961333+0000","last_unstale":"2024-09-12T22:10:08.158963+0000","last_undegraded":"2024-09-12T22:10:08.158963+0000","last_fullsized":"2024-09-12T22:10:08.158963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156757+0000","last_change":"2024-09-12T22:09:50.968473+0000","last_active":"2024-09-12T22:10:08.156757+0000","last_peered":"2024-09-12T22:10:08.156757+0000","last_clean":"2024-09-12T22:10:08.156757+0000","last_became_active":"2024-09-12T22:09:50.968127+0000","last_became_peered":"2024-09-12T22:09:50.968127+0000","last_unstale":"2024-09-12T22:10:08.156757+0000","last_undegraded":"2024-09-12T22:10:08.156757+0000","last_fullsized":"2024-09-12T22:10:08.156757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159651+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:10:08.159651+0000","last_peered":"2024-09-12T22:10:08.159651+0000","last_clean":"2024-09-12T22:10:08.159651+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:10:08.159651+0000","last_undegraded":"2024-09-12T22:10:08.159651+0000","last_fullsized":"2024-09-12T22:10:08.159651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156421+0000","last_change":"2024-09-12T22:09:50.972555+0000","last_active":"2024-09-12T22:10:08.156421+0000","last_peered":"2024-09-12T22:10:08.156421+0000","last_clean":"2024-09-12T22:10:08.156421+0000","last_became_active":"2024-09-12T22:09:50.971605+0000","last_became_peered":"2024-09-12T22:09:50.971605+0000","last_unstale":"2024-09-12T22:10:08.156421+0000","last_undegraded":"2024-09-12T22:10:08.156421+0000","last_fullsized":"2024-09-12T22:10:08.156421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156246+0000","last_change":"2024-09-12T22:09:50.967227+0000","last_active":"2024-09-12T22:10:08.156246+0000","last_peered":"2024-09-12T22:10:08.156246+0000","last_clean":"2024-09-12T22:10:08.156246+0000","last_became_active":"2024-09-12T22:09:50.966845+0000","last_became_peered":"2024-09-12T22:09:50.966845+0000","last_unstale":"2024-09-12T22:10:08.156246+0000","last_undegraded":"2024-09-12T22:10:08.156246+0000","last_fullsized":"2024-09-12T22:10:08.156246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:10.505270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159355+0000","last_change":"2024-09-12T22:09:50.967896+0000","last_active":"2024-09-12T22:10:08.159355+0000","last_peered":"2024-09-12T22:10:08.159355+0000","last_clean":"2024-09-12T22:10:08.159355+0000","last_became_active":"2024-09-12T22:09:50.966706+0000","last_became_peered":"2024-09-12T22:09:50.966706+0000","last_unstale":"2024-09-12T22:10:08.159355+0000","last_undegraded":"2024-09-12T22:10:08.159355+0000","last_fullsized":"2024-09-12T22:10:08.159355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158928+0000","last_change":"2024-09-12T22:09:50.966960+0000","last_active":"2024-09-12T22:10:08.158928+0000","last_peered":"2024-09-12T22:10:08.158928+0000","last_clean":"2024-09-12T22:10:08.158928+0000","last_became_active":"2024-09-12T22:09:50.965932+0000","last_became_peered":"2024-09-12T22:09:50.965932+0000","last_unstale":"2024-09-12T22:10:08.158928+0000","last_undegraded":"2024-09-12T22:10:08.158928+0000","last_fullsized":"2024-09-12T22:10:08.158928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158714+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:10:08.158714+0000","last_peered":"2024-09-12T22:10:08.158714+0000","last_clean":"2024-09-12T22:10:08.158714+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:10:08.158714+0000","last_undegraded":"2024-09-12T22:10:08.158714+0000","last_fullsized":"2024-09-12T22:10:08.158714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159282+0000","last_change":"2024-09-12T22:09:50.966607+0000","last_active":"2024-09-12T22:10:08.159282+0000","last_peered":"2024-09-12T22:10:08.159282+0000","last_clean":"2024-09-12T22:10:08.159282+0000","last_became_active":"2024-09-12T22:09:50.965472+0000","last_became_peered":"2024-09-12T22:09:50.965472+0000","last_unstale":"2024-09-12T22:10:08.159282+0000","last_undegraded":"2024-09-12T22:10:08.159282+0000","last_fullsized":"2024-09-12T22:10:08.159282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156940+0000","last_change":"2024-09-12T22:09:50.970339+0000","last_active":"2024-09-12T22:10:08.156940+0000","last_peered":"2024-09-12T22:10:08.156940+0000","last_clean":"2024-09-12T22:10:08.156940+0000","last_became_active":"2024-09-12T22:09:50.969584+0000","last_became_peered":"2024-09-12T22:09:50.969584+0000","last_unstale":"2024-09-12T22:10:08.156940+0000","last_undegraded":"2024-09-12T22:10:08.156940+0000","last_fullsized":"2024-09-12T22:10:08.156940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158886+0000","last_change":"2024-09-12T22:09:50.964400+0000","last_active":"2024-09-12T22:10:08.158886+0000","last_peered":"2024-09-12T22:10:08.158886+0000","last_clean":"2024-09-12T22:10:08.158886+0000","last_became_active":"2024-09-12T22:09:50.963981+0000","last_became_peered":"2024-09-12T22:09:50.963981+0000","last_unstale":"2024-09-12T22:10:08.158886+0000","last_undegraded":"2024-09-12T22:10:08.158886+0000","last_fullsized":"2024-09-12T22:10:08.158886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159223+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:10:08.159223+0000","last_peered":"2024-09-12T22:10:08.159223+0000","last_clean":"2024-09-12T22:10:08.159223+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:10:08.159223+0000","last_undegraded":"2024-09-12T22:10:08.159223+0000","last_fullsized":"2024-09-12T22:10:08.159223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159120+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:10:08.159120+0000","last_peered":"2024-09-12T22:10:08.159120+0000","last_clean":"2024-09-12T22:10:08.159120+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:10:08.159120+0000","last_undegraded":"2024-09-12T22:10:08.159120+0000","last_fullsized":"2024-09-12T22:10:08.159120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156168+0000","last_change":"2024-09-12T22:09:50.971813+0000","last_active":"2024-09-12T22:10:08.156168+0000","last_peered":"2024-09-12T22:10:08.156168+0000","last_clean":"2024-09-12T22:10:08.156168+0000","last_became_active":"2024-09-12T22:09:50.970791+0000","last_became_peered":"2024-09-12T22:09:50.970791+0000","last_unstale":"2024-09-12T22:10:08.156168+0000","last_undegraded":"2024-09-12T22:10:08.156168+0000","last_fullsized":"2024-09-12T22:10:08.156168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158498+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:10:08.158498+0000","last_peered":"2024-09-12T22:10:08.158498+0000","last_clean":"2024-09-12T22:10:08.158498+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:10:08.158498+0000","last_undegraded":"2024-09-12T22:10:08.158498+0000","last_fullsized":"2024-09-12T22:10:08.158498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.155929+0000","last_change":"2024-09-12T22:09:50.967970+0000","last_active":"2024-09-12T22:10:08.155929+0000","last_peered":"2024-09-12T22:10:08.155929+0000","last_clean":"2024-09-12T22:10:08.155929+0000","last_became_active":"2024-09-12T22:09:50.967629+0000","last_became_peered":"2024-09-12T22:09:50.967629+0000","last_unstale":"2024-09-12T22:10:08.155929+0000","last_undegraded":"2024-09-12T22:10:08.155929+0000","last_fullsized":"2024-09-12T22:10:08.155929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:45.186641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157092+0000","last_change":"2024-09-12T22:09:50.968808+0000","last_active":"2024-09-12T22:10:08.157092+0000","last_peered":"2024-09-12T22:10:08.157092+0000","last_clean":"2024-09-12T22:10:08.157092+0000","last_became_active":"2024-09-12T22:09:50.968442+0000","last_became_peered":"2024-09-12T22:09:50.968442+0000","last_unstale":"2024-09-12T22:10:08.157092+0000","last_undegraded":"2024-09-12T22:10:08.157092+0000","last_fullsized":"2024-09-12T22:10:08.157092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159167+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:10:08.159167+0000","last_peered":"2024-09-12T22:10:08.159167+0000","last_clean":"2024-09-12T22:10:08.159167+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:10:08.159167+0000","last_undegraded":"2024-09-12T22:10:08.159167+0000","last_fullsized":"2024-09-12T22:10:08.159167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159685+0000","last_change":"2024-09-12T22:09:50.970149+0000","last_active":"2024-09-12T22:10:08.159685+0000","last_peered":"2024-09-12T22:10:08.159685+0000","last_clean":"2024-09-12T22:10:08.159685+0000","last_became_active":"2024-09-12T22:09:50.968991+0000","last_became_peered":"2024-09-12T22:09:50.968991+0000","last_unstale":"2024-09-12T22:10:08.159685+0000","last_undegraded":"2024-09-12T22:10:08.159685+0000","last_fullsized":"2024-09-12T22:10:08.159685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:54.613374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156648+0000","last_change":"2024-09-12T22:09:50.972978+0000","last_active":"2024-09-12T22:10:08.156648+0000","last_peered":"2024-09-12T22:10:08.156648+0000","last_clean":"2024-09-12T22:10:08.156648+0000","last_became_active":"2024-09-12T22:09:50.972643+0000","last_became_peered":"2024-09-12T22:09:50.972643+0000","last_unstale":"2024-09-12T22:10:08.156648+0000","last_undegraded":"2024-09-12T22:10:08.156648+0000","last_fullsized":"2024-09-12T22:10:08.156648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159099+0000","last_change":"2024-09-12T22:09:50.959651+0000","last_active":"2024-09-12T22:10:08.159099+0000","last_peered":"2024-09-12T22:10:08.159099+0000","last_clean":"2024-09-12T22:10:08.159099+0000","last_became_active":"2024-09-12T22:09:50.957831+0000","last_became_peered":"2024-09-12T22:09:50.957831+0000","last_unstale":"2024-09-12T22:10:08.159099+0000","last_undegraded":"2024-09-12T22:10:08.159099+0000","last_fullsized":"2024-09-12T22:10:08.159099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156292+0000","last_change":"2024-09-12T22:09:50.972297+0000","last_active":"2024-09-12T22:10:08.156292+0000","last_peered":"2024-09-12T22:10:08.156292+0000","last_clean":"2024-09-12T22:10:08.156292+0000","last_became_active":"2024-09-12T22:09:50.971680+0000","last_became_peered":"2024-09-12T22:09:50.971680+0000","last_unstale":"2024-09-12T22:10:08.156292+0000","last_undegraded":"2024-09-12T22:10:08.156292+0000","last_fullsized":"2024-09-12T22:10:08.156292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158539+0000","last_change":"2024-09-12T22:09:50.959432+0000","last_active":"2024-09-12T22:10:08.158539+0000","last_peered":"2024-09-12T22:10:08.158539+0000","last_clean":"2024-09-12T22:10:08.158539+0000","last_became_active":"2024-09-12T22:09:50.958458+0000","last_became_peered":"2024-09-12T22:09:50.958458+0000","last_unstale":"2024-09-12T22:10:08.158539+0000","last_undegraded":"2024-09-12T22:10:08.158539+0000","last_fullsized":"2024-09-12T22:10:08.158539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158776+0000","last_change":"2024-09-12T22:09:50.965467+0000","last_active":"2024-09-12T22:10:08.158776+0000","last_peered":"2024-09-12T22:10:08.158776+0000","last_clean":"2024-09-12T22:10:08.158776+0000","last_became_active":"2024-09-12T22:09:50.964123+0000","last_became_peered":"2024-09-12T22:09:50.964123+0000","last_unstale":"2024-09-12T22:10:08.158776+0000","last_undegraded":"2024-09-12T22:10:08.158776+0000","last_fullsized":"2024-09-12T22:10:08.158776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156567+0000","last_change":"2024-09-12T22:09:50.969411+0000","last_active":"2024-09-12T22:10:08.156567+0000","last_peered":"2024-09-12T22:10:08.156567+0000","last_clean":"2024-09-12T22:10:08.156567+0000","last_became_active":"2024-09-12T22:09:50.968790+0000","last_became_peered":"2024-09-12T22:09:50.968790+0000","last_unstale":"2024-09-12T22:10:08.156567+0000","last_undegraded":"2024-09-12T22:10:08.156567+0000","last_fullsized":"2024-09-12T22:10:08.156567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159300+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:10:08.159300+0000","last_peered":"2024-09-12T22:10:08.159300+0000","last_clean":"2024-09-12T22:10:08.159300+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:10:08.159300+0000","last_undegraded":"2024-09-12T22:10:08.159300+0000","last_fullsized":"2024-09-12T22:10:08.159300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156776+0000","last_change":"2024-09-12T22:09:50.970501+0000","last_active":"2024-09-12T22:10:08.156776+0000","last_peered":"2024-09-12T22:10:08.156776+0000","last_clean":"2024-09-12T22:10:08.156776+0000","last_became_active":"2024-09-12T22:09:50.969764+0000","last_became_peered":"2024-09-12T22:09:50.969764+0000","last_unstale":"2024-09-12T22:10:08.156776+0000","last_undegraded":"2024-09-12T22:10:08.156776+0000","last_fullsized":"2024-09-12T22:10:08.156776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158709+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:10:08.158709+0000","last_peered":"2024-09-12T22:10:08.158709+0000","last_clean":"2024-09-12T22:10:08.158709+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:10:08.158709+0000","last_undegraded":"2024-09-12T22:10:08.158709+0000","last_fullsized":"2024-09-12T22:10:08.158709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159306+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:10:08.159306+0000","last_peered":"2024-09-12T22:10:08.159306+0000","last_clean":"2024-09-12T22:10:08.159306+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:10:08.159306+0000","last_undegraded":"2024-09-12T22:10:08.159306+0000","last_fullsized":"2024-09-12T22:10:08.159306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156139+0000","last_change":"2024-09-12T22:09:49.955154+0000","last_active":"2024-09-12T22:10:08.156139+0000","last_peered":"2024-09-12T22:10:08.156139+0000","last_clean":"2024-09-12T22:10:08.156139+0000","last_became_active":"2024-09-12T22:09:49.954873+0000","last_became_peered":"2024-09-12T22:09:49.954873+0000","last_unstale":"2024-09-12T22:10:08.156139+0000","last_undegraded":"2024-09-12T22:10:08.156139+0000","last_fullsized":"2024-09-12T22:10:08.156139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:39.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158963+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:10:08.158963+0000","last_peered":"2024-09-12T22:10:08.158963+0000","last_clean":"2024-09-12T22:10:08.158963+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:10:08.158963+0000","last_undegraded":"2024-09-12T22:10:08.158963+0000","last_fullsized":"2024-09-12T22:10:08.158963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158815+0000","last_change":"2024-09-12T22:09:49.952667+0000","last_active":"2024-09-12T22:10:08.158815+0000","last_peered":"2024-09-12T22:10:08.158815+0000","last_clean":"2024-09-12T22:10:08.158815+0000","last_became_active":"2024-09-12T22:09:49.951675+0000","last_became_peered":"2024-09-12T22:09:49.951675+0000","last_unstale":"2024-09-12T22:10:08.158815+0000","last_undegraded":"2024-09-12T22:10:08.158815+0000","last_fullsized":"2024-09-12T22:10:08.158815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159451+0000","last_change":"2024-09-12T22:09:49.951992+0000","last_active":"2024-09-12T22:10:08.159451+0000","last_peered":"2024-09-12T22:10:08.159451+0000","last_clean":"2024-09-12T22:10:08.159451+0000","last_became_active":"2024-09-12T22:09:49.951578+0000","last_became_peered":"2024-09-12T22:09:49.951578+0000","last_unstale":"2024-09-12T22:10:08.159451+0000","last_undegraded":"2024-09-12T22:10:08.159451+0000","last_fullsized":"2024-09-12T22:10:08.159451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.155963+0000","last_change":"2024-09-12T22:09:50.973134+0000","last_active":"2024-09-12T22:10:08.155963+0000","last_peered":"2024-09-12T22:10:08.155963+0000","last_clean":"2024-09-12T22:10:08.155963+0000","last_became_active":"2024-09-12T22:09:50.972495+0000","last_became_peered":"2024-09-12T22:09:50.972495+0000","last_unstale":"2024-09-12T22:10:08.155963+0000","last_undegraded":"2024-09-12T22:10:08.155963+0000","last_fullsized":"2024-09-12T22:10:08.155963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:47.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156994+0000","last_change":"2024-09-12T22:09:49.955304+0000","last_active":"2024-09-12T22:10:08.156994+0000","last_peered":"2024-09-12T22:10:08.156994+0000","last_clean":"2024-09-12T22:10:08.156994+0000","last_became_active":"2024-09-12T22:09:49.954990+0000","last_became_peered":"2024-09-12T22:09:49.954990+0000","last_unstale":"2024-09-12T22:10:08.156994+0000","last_undegraded":"2024-09-12T22:10:08.156994+0000","last_fullsized":"2024-09-12T22:10:08.156994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:01.647067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.155983+0000","last_change":"2024-09-12T22:09:50.966382+0000","last_active":"2024-09-12T22:10:08.155983+0000","last_peered":"2024-09-12T22:10:08.155983+0000","last_clean":"2024-09-12T22:10:08.155983+0000","last_became_active":"2024-09-12T22:09:50.966136+0000","last_became_peered":"2024-09-12T22:09:50.966136+0000","last_unstale":"2024-09-12T22:10:08.155983+0000","last_undegraded":"2024-09-12T22:10:08.155983+0000","last_fullsized":"2024-09-12T22:10:08.155983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.249772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159857+0000","last_change":"2024-09-12T22:09:49.952379+0000","last_active":"2024-09-12T22:10:08.159857+0000","last_peered":"2024-09-12T22:10:08.159857+0000","last_clean":"2024-09-12T22:10:08.159857+0000","last_became_active":"2024-09-12T22:09:49.951988+0000","last_became_peered":"2024-09-12T22:09:49.951988+0000","last_unstale":"2024-09-12T22:10:08.159857+0000","last_undegraded":"2024-09-12T22:10:08.159857+0000","last_fullsized":"2024-09-12T22:10:08.159857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:42.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159590+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:10:08.159590+0000","last_peered":"2024-09-12T22:10:08.159590+0000","last_clean":"2024-09-12T22:10:08.159590+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:10:08.159590+0000","last_undegraded":"2024-09-12T22:10:08.159590+0000","last_fullsized":"2024-09-12T22:10:08.159590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159632+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:10:08.159632+0000","last_peered":"2024-09-12T22:10:08.159632+0000","last_clean":"2024-09-12T22:10:08.159632+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:10:08.159632+0000","last_undegraded":"2024-09-12T22:10:08.159632+0000","last_fullsized":"2024-09-12T22:10:08.159632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158901+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:10:08.158901+0000","last_peered":"2024-09-12T22:10:08.158901+0000","last_clean":"2024-09-12T22:10:08.158901+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:10:08.158901+0000","last_undegraded":"2024-09-12T22:10:08.158901+0000","last_fullsized":"2024-09-12T22:10:08.158901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159297+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:10:08.159297+0000","last_peered":"2024-09-12T22:10:08.159297+0000","last_clean":"2024-09-12T22:10:08.159297+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:10:08.159297+0000","last_undegraded":"2024-09-12T22:10:08.159297+0000","last_fullsized":"2024-09-12T22:10:08.159297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159327+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:10:08.159327+0000","last_peered":"2024-09-12T22:10:08.159327+0000","last_clean":"2024-09-12T22:10:08.159327+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:10:08.159327+0000","last_undegraded":"2024-09-12T22:10:08.159327+0000","last_fullsized":"2024-09-12T22:10:08.159327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159633+0000","last_change":"2024-09-12T22:09:49.949264+0000","last_active":"2024-09-12T22:10:08.159633+0000","last_peered":"2024-09-12T22:10:08.159633+0000","last_clean":"2024-09-12T22:10:08.159633+0000","last_became_active":"2024-09-12T22:09:49.948278+0000","last_became_peered":"2024-09-12T22:09:49.948278+0000","last_unstale":"2024-09-12T22:10:08.159633+0000","last_undegraded":"2024-09-12T22:10:08.159633+0000","last_fullsized":"2024-09-12T22:10:08.159633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159763+0000","last_change":"2024-09-12T22:09:50.969708+0000","last_active":"2024-09-12T22:10:08.159763+0000","last_peered":"2024-09-12T22:10:08.159763+0000","last_clean":"2024-09-12T22:10:08.159763+0000","last_became_active":"2024-09-12T22:09:50.967504+0000","last_became_peered":"2024-09-12T22:09:50.967504+0000","last_unstale":"2024-09-12T22:10:08.159763+0000","last_undegraded":"2024-09-12T22:10:08.159763+0000","last_fullsized":"2024-09-12T22:10:08.159763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:28.247256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156380+0000","last_change":"2024-09-12T22:09:49.954042+0000","last_active":"2024-09-12T22:10:08.156380+0000","last_peered":"2024-09-12T22:10:08.156380+0000","last_clean":"2024-09-12T22:10:08.156380+0000","last_became_active":"2024-09-12T22:09:49.953678+0000","last_became_peered":"2024-09-12T22:09:49.953678+0000","last_unstale":"2024-09-12T22:10:08.156380+0000","last_undegraded":"2024-09-12T22:10:08.156380+0000","last_fullsized":"2024-09-12T22:10:08.156380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:16.454936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159255+0000","last_change":"2024-09-12T22:09:50.967600+0000","last_active":"2024-09-12T22:10:08.159255+0000","last_peered":"2024-09-12T22:10:08.159255+0000","last_clean":"2024-09-12T22:10:08.159255+0000","last_became_active":"2024-09-12T22:09:50.967001+0000","last_became_peered":"2024-09-12T22:09:50.967001+0000","last_unstale":"2024-09-12T22:10:08.159255+0000","last_undegraded":"2024-09-12T22:10:08.159255+0000","last_fullsized":"2024-09-12T22:10:08.159255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:42.209490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156078+0000","last_change":"2024-09-12T22:09:49.951150+0000","last_active":"2024-09-12T22:10:08.156078+0000","last_peered":"2024-09-12T22:10:08.156078+0000","last_clean":"2024-09-12T22:10:08.156078+0000","last_became_active":"2024-09-12T22:09:49.950837+0000","last_became_peered":"2024-09-12T22:09:49.950837+0000","last_unstale":"2024-09-12T22:10:08.156078+0000","last_undegraded":"2024-09-12T22:10:08.156078+0000","last_fullsized":"2024-09-12T22:10:08.156078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:03.703914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159060+0000","last_change":"2024-09-12T22:09:50.963087+0000","last_active":"2024-09-12T22:10:08.159060+0000","last_peered":"2024-09-12T22:10:08.159060+0000","last_clean":"2024-09-12T22:10:08.159060+0000","last_became_active":"2024-09-12T22:09:50.962022+0000","last_became_peered":"2024-09-12T22:09:50.962022+0000","last_unstale":"2024-09-12T22:10:08.159060+0000","last_undegraded":"2024-09-12T22:10:08.159060+0000","last_fullsized":"2024-09-12T22:10:08.159060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:02.460341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":228,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158979+0000","last_change":"2024-09-12T22:09:40.794926+0000","last_active":"2024-09-12T22:10:08.158979+0000","last_peered":"2024-09-12T22:10:08.158979+0000","last_clean":"2024-09-12T22:10:08.158979+0000","last_became_active":"2024-09-12T22:09:40.793711+0000","last_became_peered":"2024-09-12T22:09:40.793711+0000","last_unstale":"2024-09-12T22:10:08.158979+0000","last_undegraded":"2024-09-12T22:10:08.158979+0000","last_fullsized":"2024-09-12T22:10:08.158979+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:47.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":32,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159526+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:10:08.159526+0000","last_peered":"2024-09-12T22:10:08.159526+0000","last_clean":"2024-09-12T22:10:08.159526+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:10:08.159526+0000","last_undegraded":"2024-09-12T22:10:08.159526+0000","last_fullsized":"2024-09-12T22:10:08.159526+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158840+0000","last_change":"2024-09-12T22:09:49.948995+0000","last_active":"2024-09-12T22:10:08.158840+0000","last_peered":"2024-09-12T22:10:08.158840+0000","last_clean":"2024-09-12T22:10:08.158840+0000","last_became_active":"2024-09-12T22:09:49.948606+0000","last_became_peered":"2024-09-12T22:09:49.948606+0000","last_unstale":"2024-09-12T22:10:08.158840+0000","last_undegraded":"2024-09-12T22:10:08.158840+0000","last_fullsized":"2024-09-12T22:10:08.158840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159829+0000","last_change":"2024-09-12T22:09:50.967900+0000","last_active":"2024-09-12T22:10:08.159829+0000","last_peered":"2024-09-12T22:10:08.159829+0000","last_clean":"2024-09-12T22:10:08.159829+0000","last_became_active":"2024-09-12T22:09:50.966764+0000","last_became_peered":"2024-09-12T22:09:50.966764+0000","last_unstale":"2024-09-12T22:10:08.159829+0000","last_undegraded":"2024-09-12T22:10:08.159829+0000","last_fullsized":"2024-09-12T22:10:08.159829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:20.930359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158913+0000","last_change":"2024-09-12T22:09:47.821661+0000","last_active":"2024-09-12T22:10:08.158913+0000","last_peered":"2024-09-12T22:10:08.158913+0000","last_clean":"2024-09-12T22:10:08.158913+0000","last_became_active":"2024-09-12T22:09:45.815837+0000","last_became_peered":"2024-09-12T22:09:45.815837+0000","last_unstale":"2024-09-12T22:10:08.158913+0000","last_undegraded":"2024-09-12T22:10:08.158913+0000","last_fullsized":"2024-09-12T22:10:08.158913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:29.251025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158710+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:10:08.158710+0000","last_peered":"2024-09-12T22:10:08.158710+0000","last_clean":"2024-09-12T22:10:08.158710+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:10:08.158710+0000","last_undegraded":"2024-09-12T22:10:08.158710+0000","last_fullsized":"2024-09-12T22:10:08.158710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156806+0000","last_change":"2024-09-12T22:09:50.969490+0000","last_active":"2024-09-12T22:10:08.156806+0000","last_peered":"2024-09-12T22:10:08.156806+0000","last_clean":"2024-09-12T22:10:08.156806+0000","last_became_active":"2024-09-12T22:09:50.968883+0000","last_became_peered":"2024-09-12T22:09:50.968883+0000","last_unstale":"2024-09-12T22:10:08.156806+0000","last_undegraded":"2024-09-12T22:10:08.156806+0000","last_fullsized":"2024-09-12T22:10:08.156806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158846+0000","last_change":"2024-09-12T22:09:47.821293+0000","last_active":"2024-09-12T22:10:08.158846+0000","last_peered":"2024-09-12T22:10:08.158846+0000","last_clean":"2024-09-12T22:10:08.158846+0000","last_became_active":"2024-09-12T22:09:45.814731+0000","last_became_peered":"2024-09-12T22:09:45.814731+0000","last_unstale":"2024-09-12T22:10:08.158846+0000","last_undegraded":"2024-09-12T22:10:08.158846+0000","last_fullsized":"2024-09-12T22:10:08.158846+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:14.620787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156096+0000","last_change":"2024-09-12T22:09:49.953941+0000","last_active":"2024-09-12T22:10:08.156096+0000","last_peered":"2024-09-12T22:10:08.156096+0000","last_clean":"2024-09-12T22:10:08.156096+0000","last_became_active":"2024-09-12T22:09:49.953622+0000","last_became_peered":"2024-09-12T22:09:49.953622+0000","last_unstale":"2024-09-12T22:10:08.156096+0000","last_undegraded":"2024-09-12T22:10:08.156096+0000","last_fullsized":"2024-09-12T22:10:08.156096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:00.774308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159055+0000","last_change":"2024-09-12T22:09:50.966333+0000","last_active":"2024-09-12T22:10:08.159055+0000","last_peered":"2024-09-12T22:10:08.159055+0000","last_clean":"2024-09-12T22:10:08.159055+0000","last_became_active":"2024-09-12T22:09:50.965381+0000","last_became_peered":"2024-09-12T22:09:50.965381+0000","last_unstale":"2024-09-12T22:10:08.159055+0000","last_undegraded":"2024-09-12T22:10:08.159055+0000","last_fullsized":"2024-09-12T22:10:08.159055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159649+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:10:08.159649+0000","last_peered":"2024-09-12T22:10:08.159649+0000","last_clean":"2024-09-12T22:10:08.159649+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:10:08.159649+0000","last_undegraded":"2024-09-12T22:10:08.159649+0000","last_fullsized":"2024-09-12T22:10:08.159649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159444+0000","last_change":"2024-09-12T22:09:49.948989+0000","last_active":"2024-09-12T22:10:08.159444+0000","last_peered":"2024-09-12T22:10:08.159444+0000","last_clean":"2024-09-12T22:10:08.159444+0000","last_became_active":"2024-09-12T22:09:49.948311+0000","last_became_peered":"2024-09-12T22:09:49.948311+0000","last_unstale":"2024-09-12T22:10:08.159444+0000","last_undegraded":"2024-09-12T22:10:08.159444+0000","last_fullsized":"2024-09-12T22:10:08.159444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159329+0000","last_change":"2024-09-12T22:09:50.961389+0000","last_active":"2024-09-12T22:10:08.159329+0000","last_peered":"2024-09-12T22:10:08.159329+0000","last_clean":"2024-09-12T22:10:08.159329+0000","last_became_active":"2024-09-12T22:09:50.960380+0000","last_became_peered":"2024-09-12T22:09:50.960380+0000","last_unstale":"2024-09-12T22:10:08.159329+0000","last_undegraded":"2024-09-12T22:10:08.159329+0000","last_fullsized":"2024-09-12T22:10:08.159329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:03.769700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159919+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:10:08.159919+0000","last_peered":"2024-09-12T22:10:08.159919+0000","last_clean":"2024-09-12T22:10:08.159919+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:10:08.159919+0000","last_undegraded":"2024-09-12T22:10:08.159919+0000","last_fullsized":"2024-09-12T22:10:08.159919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159457+0000","last_change":"2024-09-12T22:09:47.821258+0000","last_active":"2024-09-12T22:10:08.159457+0000","last_peered":"2024-09-12T22:10:08.159457+0000","last_clean":"2024-09-12T22:10:08.159457+0000","last_became_active":"2024-09-12T22:09:45.814283+0000","last_became_peered":"2024-09-12T22:09:45.814283+0000","last_unstale":"2024-09-12T22:10:08.159457+0000","last_undegraded":"2024-09-12T22:10:08.159457+0000","last_fullsized":"2024-09-12T22:10:08.159457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:16.328296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156198+0000","last_change":"2024-09-12T22:09:50.972171+0000","last_active":"2024-09-12T22:10:08.156198+0000","last_peered":"2024-09-12T22:10:08.156198+0000","last_clean":"2024-09-12T22:10:08.156198+0000","last_became_active":"2024-09-12T22:09:50.971440+0000","last_became_peered":"2024-09-12T22:09:50.971440+0000","last_unstale":"2024-09-12T22:10:08.156198+0000","last_undegraded":"2024-09-12T22:10:08.156198+0000","last_fullsized":"2024-09-12T22:10:08.156198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:25.929361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159434+0000","last_change":"2024-09-12T22:09:49.949113+0000","last_active":"2024-09-12T22:10:08.159434+0000","last_peered":"2024-09-12T22:10:08.159434+0000","last_clean":"2024-09-12T22:10:08.159434+0000","last_became_active":"2024-09-12T22:09:49.948750+0000","last_became_peered":"2024-09-12T22:09:49.948750+0000","last_unstale":"2024-09-12T22:10:08.159434+0000","last_undegraded":"2024-09-12T22:10:08.159434+0000","last_fullsized":"2024-09-12T22:10:08.159434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:45.224113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157120+0000","last_change":"2024-09-12T22:09:47.821701+0000","last_active":"2024-09-12T22:10:08.157120+0000","last_peered":"2024-09-12T22:10:08.157120+0000","last_clean":"2024-09-12T22:10:08.157120+0000","last_became_active":"2024-09-12T22:09:45.815092+0000","last_became_peered":"2024-09-12T22:09:45.815092+0000","last_unstale":"2024-09-12T22:10:08.157120+0000","last_undegraded":"2024-09-12T22:10:08.157120+0000","last_fullsized":"2024-09-12T22:10:08.157120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:03.535773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042594300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156437+0000","last_change":"2024-09-12T22:09:50.969396+0000","last_active":"2024-09-12T22:10:08.156437+0000","last_peered":"2024-09-12T22:10:08.156437+0000","last_clean":"2024-09-12T22:10:08.156437+0000","last_became_active":"2024-09-12T22:09:50.968678+0000","last_became_peered":"2024-09-12T22:09:50.968678+0000","last_unstale":"2024-09-12T22:10:08.156437+0000","last_undegraded":"2024-09-12T22:10:08.156437+0000","last_fullsized":"2024-09-12T22:10:08.156437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159316+0000","last_change":"2024-09-12T22:09:49.949994+0000","last_active":"2024-09-12T22:10:08.159316+0000","last_peered":"2024-09-12T22:10:08.159316+0000","last_clean":"2024-09-12T22:10:08.159316+0000","last_became_active":"2024-09-12T22:09:49.949659+0000","last_became_peered":"2024-09-12T22:09:49.949659+0000","last_unstale":"2024-09-12T22:10:08.159316+0000","last_undegraded":"2024-09-12T22:10:08.159316+0000","last_fullsized":"2024-09-12T22:10:08.159316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:35.848402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159390+0000","last_change":"2024-09-12T22:09:47.821489+0000","last_active":"2024-09-12T22:10:08.159390+0000","last_peered":"2024-09-12T22:10:08.159390+0000","last_clean":"2024-09-12T22:10:08.159390+0000","last_became_active":"2024-09-12T22:09:45.814114+0000","last_became_peered":"2024-09-12T22:09:45.814114+0000","last_unstale":"2024-09-12T22:10:08.159390+0000","last_undegraded":"2024-09-12T22:10:08.159390+0000","last_fullsized":"2024-09-12T22:10:08.159390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:54.261225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158612+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:10:08.158612+0000","last_peered":"2024-09-12T22:10:08.158612+0000","last_clean":"2024-09-12T22:10:08.158612+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:10:08.158612+0000","last_undegraded":"2024-09-12T22:10:08.158612+0000","last_fullsized":"2024-09-12T22:10:08.158612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159388+0000","last_change":"2024-09-12T22:09:49.952422+0000","last_active":"2024-09-12T22:10:08.159388+0000","last_peered":"2024-09-12T22:10:08.159388+0000","last_clean":"2024-09-12T22:10:08.159388+0000","last_became_active":"2024-09-12T22:09:49.952029+0000","last_became_peered":"2024-09-12T22:09:49.952029+0000","last_unstale":"2024-09-12T22:10:08.159388+0000","last_undegraded":"2024-09-12T22:10:08.159388+0000","last_fullsized":"2024-09-12T22:10:08.159388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159451+0000","last_change":"2024-09-12T22:09:47.821716+0000","last_active":"2024-09-12T22:10:08.159451+0000","last_peered":"2024-09-12T22:10:08.159451+0000","last_clean":"2024-09-12T22:10:08.159451+0000","last_became_active":"2024-09-12T22:09:45.814642+0000","last_became_peered":"2024-09-12T22:09:45.814642+0000","last_unstale":"2024-09-12T22:10:08.159451+0000","last_undegraded":"2024-09-12T22:10:08.159451+0000","last_fullsized":"2024-09-12T22:10:08.159451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:42.070167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156021+0000","last_change":"2024-09-12T22:09:50.968953+0000","last_active":"2024-09-12T22:10:08.156021+0000","last_peered":"2024-09-12T22:10:08.156021+0000","last_clean":"2024-09-12T22:10:08.156021+0000","last_became_active":"2024-09-12T22:09:50.968482+0000","last_became_peered":"2024-09-12T22:09:50.968482+0000","last_unstale":"2024-09-12T22:10:08.156021+0000","last_undegraded":"2024-09-12T22:10:08.156021+0000","last_fullsized":"2024-09-12T22:10:08.156021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:45.189252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159281+0000","last_change":"2024-09-12T22:09:50.967707+0000","last_active":"2024-09-12T22:10:08.159281+0000","last_peered":"2024-09-12T22:10:08.159281+0000","last_clean":"2024-09-12T22:10:08.159281+0000","last_became_active":"2024-09-12T22:09:50.965375+0000","last_became_peered":"2024-09-12T22:09:50.965375+0000","last_unstale":"2024-09-12T22:10:08.159281+0000","last_undegraded":"2024-09-12T22:10:08.159281+0000","last_fullsized":"2024-09-12T22:10:08.159281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:26.130238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159524+0000","last_change":"2024-09-12T22:09:49.952339+0000","last_active":"2024-09-12T22:10:08.159524+0000","last_peered":"2024-09-12T22:10:08.159524+0000","last_clean":"2024-09-12T22:10:08.159524+0000","last_became_active":"2024-09-12T22:09:49.951668+0000","last_became_peered":"2024-09-12T22:09:49.951668+0000","last_unstale":"2024-09-12T22:10:08.159524+0000","last_undegraded":"2024-09-12T22:10:08.159524+0000","last_fullsized":"2024-09-12T22:10:08.159524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158598+0000","last_change":"2024-09-12T22:09:50.958705+0000","last_active":"2024-09-12T22:10:08.158598+0000","last_peered":"2024-09-12T22:10:08.158598+0000","last_clean":"2024-09-12T22:10:08.158598+0000","last_became_active":"2024-09-12T22:09:50.958116+0000","last_became_peered":"2024-09-12T22:09:50.958116+0000","last_unstale":"2024-09-12T22:10:08.158598+0000","last_undegraded":"2024-09-12T22:10:08.158598+0000","last_fullsized":"2024-09-12T22:10:08.158598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.590794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157041+0000","last_change":"2024-09-12T22:09:49.955200+0000","last_active":"2024-09-12T22:10:08.157041+0000","last_peered":"2024-09-12T22:10:08.157041+0000","last_clean":"2024-09-12T22:10:08.157041+0000","last_became_active":"2024-09-12T22:09:49.954993+0000","last_became_peered":"2024-09-12T22:09:49.954993+0000","last_unstale":"2024-09-12T22:10:08.157041+0000","last_undegraded":"2024-09-12T22:10:08.157041+0000","last_fullsized":"2024-09-12T22:10:08.157041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:11.618634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159371+0000","last_change":"2024-09-12T22:09:49.948640+0000","last_active":"2024-09-12T22:10:08.159371+0000","last_peered":"2024-09-12T22:10:08.159371+0000","last_clean":"2024-09-12T22:10:08.159371+0000","last_became_active":"2024-09-12T22:09:49.948168+0000","last_became_peered":"2024-09-12T22:09:49.948168+0000","last_unstale":"2024-09-12T22:10:08.159371+0000","last_undegraded":"2024-09-12T22:10:08.159371+0000","last_fullsized":"2024-09-12T22:10:08.159371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:20.694755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158616+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:10:08.158616+0000","last_peered":"2024-09-12T22:10:08.158616+0000","last_clean":"2024-09-12T22:10:08.158616+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:10:08.158616+0000","last_undegraded":"2024-09-12T22:10:08.158616+0000","last_fullsized":"2024-09-12T22:10:08.158616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159217+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:10:08.159217+0000","last_peered":"2024-09-12T22:10:08.159217+0000","last_clean":"2024-09-12T22:10:08.159217+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:10:08.159217+0000","last_undegraded":"2024-09-12T22:10:08.159217+0000","last_fullsized":"2024-09-12T22:10:08.159217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158589+0000","last_change":"2024-09-12T22:09:50.962380+0000","last_active":"2024-09-12T22:10:08.158589+0000","last_peered":"2024-09-12T22:10:08.158589+0000","last_clean":"2024-09-12T22:10:08.158589+0000","last_became_active":"2024-09-12T22:09:50.960355+0000","last_became_peered":"2024-09-12T22:09:50.960355+0000","last_unstale":"2024-09-12T22:10:08.158589+0000","last_undegraded":"2024-09-12T22:10:08.158589+0000","last_fullsized":"2024-09-12T22:10:08.158589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:15.261208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.157109+0000","last_change":"2024-09-12T22:09:50.971849+0000","last_active":"2024-09-12T22:10:08.157109+0000","last_peered":"2024-09-12T22:10:08.157109+0000","last_clean":"2024-09-12T22:10:08.157109+0000","last_became_active":"2024-09-12T22:09:50.971218+0000","last_became_peered":"2024-09-12T22:09:50.971218+0000","last_unstale":"2024-09-12T22:10:08.157109+0000","last_undegraded":"2024-09-12T22:10:08.157109+0000","last_fullsized":"2024-09-12T22:10:08.157109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158693+0000","last_change":"2024-09-12T22:09:49.949520+0000","last_active":"2024-09-12T22:10:08.158693+0000","last_peered":"2024-09-12T22:10:08.158693+0000","last_clean":"2024-09-12T22:10:08.158693+0000","last_became_active":"2024-09-12T22:09:49.948738+0000","last_became_peered":"2024-09-12T22:09:49.948738+0000","last_unstale":"2024-09-12T22:10:08.158693+0000","last_undegraded":"2024-09-12T22:10:08.158693+0000","last_fullsized":"2024-09-12T22:10:08.158693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:35.222594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159074+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:10:08.159074+0000","last_peered":"2024-09-12T22:10:08.159074+0000","last_clean":"2024-09-12T22:10:08.159074+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:10:08.159074+0000","last_undegraded":"2024-09-12T22:10:08.159074+0000","last_fullsized":"2024-09-12T22:10:08.159074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158691+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:10:08.158691+0000","last_peered":"2024-09-12T22:10:08.158691+0000","last_clean":"2024-09-12T22:10:08.158691+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:10:08.158691+0000","last_undegraded":"2024-09-12T22:10:08.158691+0000","last_fullsized":"2024-09-12T22:10:08.158691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156669+0000","last_change":"2024-09-12T22:09:50.971740+0000","last_active":"2024-09-12T22:10:08.156669+0000","last_peered":"2024-09-12T22:10:08.156669+0000","last_clean":"2024-09-12T22:10:08.156669+0000","last_became_active":"2024-09-12T22:09:50.970684+0000","last_became_peered":"2024-09-12T22:09:50.970684+0000","last_unstale":"2024-09-12T22:10:08.156669+0000","last_undegraded":"2024-09-12T22:10:08.156669+0000","last_fullsized":"2024-09-12T22:10:08.156669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156348+0000","last_change":"2024-09-12T22:09:49.952264+0000","last_active":"2024-09-12T22:10:08.156348+0000","last_peered":"2024-09-12T22:10:08.156348+0000","last_clean":"2024-09-12T22:10:08.156348+0000","last_became_active":"2024-09-12T22:09:49.951902+0000","last_became_peered":"2024-09-12T22:09:49.951902+0000","last_unstale":"2024-09-12T22:10:08.156348+0000","last_undegraded":"2024-09-12T22:10:08.156348+0000","last_fullsized":"2024-09-12T22:10:08.156348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:34.202994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156505+0000","last_change":"2024-09-12T22:09:50.968141+0000","last_active":"2024-09-12T22:10:08.156505+0000","last_peered":"2024-09-12T22:10:08.156505+0000","last_clean":"2024-09-12T22:10:08.156505+0000","last_became_active":"2024-09-12T22:09:50.967590+0000","last_became_peered":"2024-09-12T22:09:50.967590+0000","last_unstale":"2024-09-12T22:10:08.156505+0000","last_undegraded":"2024-09-12T22:10:08.156505+0000","last_fullsized":"2024-09-12T22:10:08.156505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156591+0000","last_change":"2024-09-12T22:09:49.954134+0000","last_active":"2024-09-12T22:10:08.156591+0000","last_peered":"2024-09-12T22:10:08.156591+0000","last_clean":"2024-09-12T22:10:08.156591+0000","last_became_active":"2024-09-12T22:09:49.953803+0000","last_became_peered":"2024-09-12T22:09:49.953803+0000","last_unstale":"2024-09-12T22:10:08.156591+0000","last_undegraded":"2024-09-12T22:10:08.156591+0000","last_fullsized":"2024-09-12T22:10:08.156591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.207890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159213+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:10:08.159213+0000","last_peered":"2024-09-12T22:10:08.159213+0000","last_clean":"2024-09-12T22:10:08.159213+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:10:08.159213+0000","last_undegraded":"2024-09-12T22:10:08.159213+0000","last_fullsized":"2024-09-12T22:10:08.159213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159428+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:10:08.159428+0000","last_peered":"2024-09-12T22:10:08.159428+0000","last_clean":"2024-09-12T22:10:08.159428+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:10:08.159428+0000","last_undegraded":"2024-09-12T22:10:08.159428+0000","last_fullsized":"2024-09-12T22:10:08.159428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159500+0000","last_change":"2024-09-12T22:09:50.961345+0000","last_active":"2024-09-12T22:10:08.159500+0000","last_peered":"2024-09-12T22:10:08.159500+0000","last_clean":"2024-09-12T22:10:08.159500+0000","last_became_active":"2024-09-12T22:09:50.959856+0000","last_became_peered":"2024-09-12T22:09:50.959856+0000","last_unstale":"2024-09-12T22:10:08.159500+0000","last_undegraded":"2024-09-12T22:10:08.159500+0000","last_fullsized":"2024-09-12T22:10:08.159500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:19.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156885+0000","last_change":"2024-09-12T22:09:49.954081+0000","last_active":"2024-09-12T22:10:08.156885+0000","last_peered":"2024-09-12T22:10:08.156885+0000","last_clean":"2024-09-12T22:10:08.156885+0000","last_became_active":"2024-09-12T22:09:49.953828+0000","last_became_peered":"2024-09-12T22:09:49.953828+0000","last_unstale":"2024-09-12T22:10:08.156885+0000","last_undegraded":"2024-09-12T22:10:08.156885+0000","last_fullsized":"2024-09-12T22:10:08.156885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:48.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.156461+0000","last_change":"2024-09-12T22:09:50.968147+0000","last_active":"2024-09-12T22:10:08.156461+0000","last_peered":"2024-09-12T22:10:08.156461+0000","last_clean":"2024-09-12T22:10:08.156461+0000","last_became_active":"2024-09-12T22:09:50.967755+0000","last_became_peered":"2024-09-12T22:09:50.967755+0000","last_unstale":"2024-09-12T22:10:08.156461+0000","last_undegraded":"2024-09-12T22:10:08.156461+0000","last_fullsized":"2024-09-12T22:10:08.156461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159289+0000","last_change":"2024-09-12T22:09:49.949316+0000","last_active":"2024-09-12T22:10:08.159289+0000","last_peered":"2024-09-12T22:10:08.159289+0000","last_clean":"2024-09-12T22:10:08.159289+0000","last_became_active":"2024-09-12T22:09:49.948859+0000","last_became_peered":"2024-09-12T22:09:49.948859+0000","last_unstale":"2024-09-12T22:10:08.159289+0000","last_undegraded":"2024-09-12T22:10:08.159289+0000","last_fullsized":"2024-09-12T22:10:08.159289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.158887+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:10:08.158887+0000","last_peered":"2024-09-12T22:10:08.158887+0000","last_clean":"2024-09-12T22:10:08.158887+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:10:08.158887+0000","last_undegraded":"2024-09-12T22:10:08.158887+0000","last_fullsized":"2024-09-12T22:10:08.158887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:10:08.159166+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:10:08.159166+0000","last_peered":"2024-09-12T22:10:08.159166+0000","last_clean":"2024-09-12T22:10:08.159166+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:10:08.159166+0000","last_undegraded":"2024-09-12T22:10:08.159166+0000","last_fullsized":"2024-09-12T22:10:08.159166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":659656,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":660291,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":68129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:10:11.093 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T22:10:11.093 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:10:11.093 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T22:10:11.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T22:10:11.175 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:10:11.187 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:11.187+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:11.206 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 30.055688793000002, 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056684099999999996, 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:11.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149053+0000", 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8380000000000004e-06 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149060+0000", 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.092e-06 2024-09-12T22:10:11.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149064+0000", 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9199999999999997e-06 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149094+0000", 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9960000000000001e-05 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149108+0000", 2024-09-12T22:10:11.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4229e-05 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154682+0000", 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005574313 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154717+0000", 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4619999999999997e-05 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.211 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'87)", 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 30.055169285000002, 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051784550000000002, 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149569+0000", 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149630+0000", 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1387e-05 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149638+0000", 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5870000000000004e-06 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149641+0000", 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:10:11.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149672+0000", 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0533000000000001e-05 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149683+0000", 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1589e-05 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154719+0000", 2024-09-12T22:10:11.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050359139999999998 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154747+0000", 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7361000000000001e-05 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:11.216 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 30.054587992999998, 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046234479999999996, 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150150+0000", 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3799999999999997e-07 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150155+0000", 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.656e-06 2024-09-12T22:10:11.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150165+0000", 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0674e-05 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150170+0000", 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6739999999999996e-06 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150204+0000", 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4279000000000002e-05 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150218+0000", 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3301e-05 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154748+0000", 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045300269999999998 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154773+0000", 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5199e-05 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.760090163000001, 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055762709999999998, 2024-09-12T22:10:11.221 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444648+0000", 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444713+0000", 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5523000000000003e-05 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444721+0000", 2024-09-12T22:10:11.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3150000000000003e-06 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444726+0000", 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444763+0000", 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7836000000000002e-05 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444776+0000", 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2801e-05 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450190+0000", 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0054141800000000002 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450224+0000", 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3160000000000001e-05 2024-09-12T22:10:11.225 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:180 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'130, mlcod=10'125)", 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.759395226999999, 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051388110000000001, 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445343+0000", 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:10:11.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445347+0000", 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2400000000000001e-06 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445357+0000", 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.91e-06 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445361+0000", 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447533+0000", 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021720350000000001 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447546+0000", 2024-09-12T22:10:11.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2461e-05 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450459+0000", 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029135670000000002 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450481+0000", 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1569999999999998e-05 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.230 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'126)", 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.758850741, 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046082930000000003, 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445888+0000", 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5099999999999999e-06 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445898+0000", 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0139999999999999e-05 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445924+0000", 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5233e-05 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445936+0000", 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1960000000000001e-05 2024-09-12T22:10:11.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447745+0000", 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018097390000000001 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447757+0000", 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.145e-05 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450482+0000", 2024-09-12T22:10:11.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027252930000000002 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450495+0000", 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2968e-05 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-09-12T22:10:11.235 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.535194594, 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053037229999999998, 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5400000000000002e-07 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669602+0000", 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8372000000000003e-05 2024-09-12T22:10:11.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669610+0000", 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9570000000000002e-06 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669614+0000", 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1799999999999998e-06 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669639+0000", 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5559e-05 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669651+0000", 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1572e-05 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674822+0000", 2024-09-12T22:10:11.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051706929999999996 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674847+0000", 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4936e-05 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:11.240 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.246543067000001, 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061352830000000001, 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958195+0000", 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2899999999999999e-07 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958204+0000", 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5300000000000002e-06 2024-09-12T22:10:11.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958224+0000", 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958241+0000", 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6574000000000001e-05 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958326+0000", 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5526999999999996e-05 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964330+0000", 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060033889999999996 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.244 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.246336573000001, 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013942721999999999, 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2897999999999999e-05 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958421+0000", 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4019999999999996e-06 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958434+0000", 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2425999999999999e-05 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958445+0000", 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1063999999999999e-05 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962479+0000", 2024-09-12T22:10:11.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040343549999999999 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962774+0000", 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029505999999999998 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962946+0000", 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000171495 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967061+0000", 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0041158369999999998 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972243+0000", 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051817770000000003 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972291+0000", 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7797000000000003e-05 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972344+0000", 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2611000000000002e-05 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.246271133, 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014018879999999999, 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.250 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958467+0000", 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958481+0000", 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4049999999999999e-05 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3788000000000001e-05 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958502+0000", 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0820000000000001e-06 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963718+0000", 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052157330000000002 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963797+0000", 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8894999999999996e-05 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963912+0000", 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115408 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967755+0000", 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038428450000000001 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972392+0000", 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046365540000000002 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972439+0000", 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7221000000000001e-05 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972485+0000", 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6483999999999997e-05 2024-09-12T22:10:11.255 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.246224425000001, 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013933348999999999, 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.256 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958514+0000", 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.37e-07 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958518+0000", 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9040000000000002e-06 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958526+0000", 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7970000000000006e-06 2024-09-12T22:10:11.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8464e-05 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963700+0000", 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051047130000000003 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963786+0000", 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6839e-05 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963908+0000", 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012141099999999999 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967748+0000", 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038402990000000001 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972354+0000", 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046053960000000003 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972403+0000", 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9598000000000002e-05 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972446+0000", 2024-09-12T22:10:11.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3191e-05 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.246116016999999, 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01398747, 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.262 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958622+0000", 2024-09-12T22:10:11.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958628+0000", 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7690000000000002e-06 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958989+0000", 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000360639 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959021+0000", 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2175000000000003e-05 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964221+0000", 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052003379999999997 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964306+0000", 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4939999999999997e-05 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964432+0000", 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012610400000000001 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967768+0000", 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033359459999999998 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972501+0000", 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047327589999999996 2024-09-12T22:10:11.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972555+0000", 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4435000000000003e-05 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972609+0000", 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3591000000000002e-05 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.267 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.244806988000001, 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011590303, 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:11.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959932+0000", 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2440000000000001e-06 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959938+0000", 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.528e-06 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959954+0000", 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5883e-05 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959963+0000", 2024-09-12T22:10:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4190000000000002e-06 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960178+0000", 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021503399999999999 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op must wait for map", 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960184+0000", 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9660000000000001e-06 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962999+0000", 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028151610000000001 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963125+0000", 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012594200000000001 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963238+0000", 2024-09-12T22:10:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112866 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967067+0000", 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003829673 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971152+0000", 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040845760000000004 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971476+0000", 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032402800000000002 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971521+0000", 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4982999999999999e-05 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.244628987999999, 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012104059, 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960109+0000", 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.16e-07 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960115+0000", 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0209999999999996e-06 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960162+0000", 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7012999999999999e-05 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960233+0000", 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0489999999999998e-05 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963739+0000", 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035056879999999999 2024-09-12T22:10:11.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963795+0000", 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6274999999999999e-05 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963924+0000", 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012943000000000001 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967683+0000", 2024-09-12T22:10:11.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037590010000000001 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971944+0000", 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042611330000000003 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972096+0000", 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015156499999999999 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972213+0000", 2024-09-12T22:10:11.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116527 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.244481450999999, 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012377496, 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.280 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960257+0000", 2024-09-12T22:10:11.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6899999999999996e-07 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960264+0000", 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960274+0000", 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0036e-05 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960282+0000", 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964601+0000", 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004319051 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964672+0000", 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0648000000000005e-05 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964758+0000", 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5881e-05 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971455+0000", 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066973750000000002 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972530+0000", 2024-09-12T22:10:11.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001074684 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972582+0000", 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1601999999999998e-05 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972634+0000", 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1903000000000001e-05 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.244444430000001, 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081337059999999992, 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960294+0000", 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8100000000000002e-07 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960297+0000", 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9459999999999998e-06 2024-09-12T22:10:11.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960305+0000", 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7690000000000002e-06 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960312+0000", 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8390000000000001e-06 2024-09-12T22:10:11.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960372+0000", 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9635000000000001e-05 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960545+0000", 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017338499999999999 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.968427+0000", 2024-09-12T22:10:11.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078814509999999994 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.244409230999999, 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075124349999999996, 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960329+0000", 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960339+0000", 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0282000000000001e-05 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960349+0000", 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0226e-05 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960357+0000", 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961038+0000", 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068101499999999998 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961157+0000", 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119157 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967841+0000", 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066831770000000002 2024-09-12T22:10:11.293 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.242487533999999, 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048339589999999997, 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9499999999999998e-07 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962257+0000", 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.178e-06 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962264+0000", 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962272+0000", 2024-09-12T22:10:11.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1559999999999995e-06 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962389+0000", 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011691700000000001 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962449+0000", 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9188999999999999e-05 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967044+0000", 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045949880000000004 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967084+0000", 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0318999999999998e-05 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:11.298 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.242452822000001, 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004830399, 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:11.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8700000000000001e-07 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962297+0000", 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2252999999999999e-05 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962304+0000", 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962309+0000", 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0320000000000003e-06 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00067960500000000001 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963008+0000", 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8924e-05 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967089+0000", 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040809399999999999 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967115+0000", 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6298000000000001e-05 2024-09-12T22:10:11.302 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 20.242283885999999, 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046231019999999996, 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:11.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962458+0000", 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.002e-06 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962559+0000", 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101159 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962596+0000", 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.718e-05 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962793+0000", 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019661599999999999 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962811+0000", 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8447000000000001e-05 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004205627 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:11.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967077+0000", 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9772000000000003e-05 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:11.307 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:11.308 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:11.309 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:11.307+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:11.409 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:11.408+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:11.421 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:11.421 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:10:11.421 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 24, 2024-09-12T22:10:11.421 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "2fe6789e-9afe-4094-9a02-5d2cb3971ecc", 2024-09-12T22:10:11.421 INFO:teuthology.orchestra.run.smithi019.stdout: "created": "2024-09-12T22:09:28.783000+0000", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "modified": "2024-09-12T22:10:11.168146+0000", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "last_up_change": "2024-09-12T22:09:38.783190+0000", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "last_in_change": "2024-09-12T22:09:30.541441+0000", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_num": 5806080, 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_set": [ 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "nodeep-scrub", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "noscrub", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "pglog_hardlimit", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "purged_snapdirs", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_deletes", 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: "sortbitwise" 2024-09-12T22:10:11.422 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_version": 4, 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_snapshot": "", 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_max": 4, 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd": 3, 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "require_min_compat_client": "luminous", 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "min_compat_client": "jewel", 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "require_osd_release": "squid", 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_crimson": false, 2024-09-12T22:10:11.423 INFO:teuthology.orchestra.run.smithi019.stdout: "pools": [ 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 1, 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": ".mgr", 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:39.111590+0000", 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:11.424 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 1, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 1, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 1, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 1, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 1, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:11.425 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "11", 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:10:11.426 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:11.427 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:11.428 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_max": 32, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 1 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": {} 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.429 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 2.9900000095367432, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 2.9900000095367432, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 2, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 2, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.430 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 2, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "rbd", 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:44.758823+0000", 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 8193, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:11.431 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 8, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 8, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 8, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 8, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 8, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:11.432 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "15", 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 2, 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 15, 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:11.433 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:11.434 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:11.435 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd": {} 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T22:10:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 3, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_metadata", 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:48.811189+0000", 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:10:11.437 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T22:10:11.438 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.439 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "18", 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:11.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:11.442 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_bias": 4, 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 16, 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_priority": 5 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": "cephfs" 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.1299999952316284, 2024-09-12T22:10:11.443 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.1299999952316284, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 4, 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_data", 2024-09-12T22:10:11.444 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:49.271244+0000", 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:11.445 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 64, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 64, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 64, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 64, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 64, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:11.446 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "19", 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:11.447 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:11.449 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 64, 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "data": "cephfs" 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:11.450 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.1299999952316284, 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.1299999952316284, 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "osds": [ 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.451 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "65e58e9b-56bf-491e-aaa7-2c19805f71f8", 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 17, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:10:11.452 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6800", 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6801", 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6802", 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6803", 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.454 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6806", 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6807", 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.455 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6804", 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.456 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6805", 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.107:6801/3734941882", 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.107:6803/3734941882", 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.107:6807/3734941882", 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.107:6805/3734941882", 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "12c1612a-797e-4568-b2ad-a072c212de6a", 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 17, 2024-09-12T22:10:11.458 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6800", 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6801", 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.459 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6802", 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6803", 2024-09-12T22:10:11.460 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6806", 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.461 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6807", 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6804", 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.462 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6805", 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.148:6801/2199871564", 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.148:6803/2199871564", 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.148:6807/2199871564", 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.148:6805/2199871564", 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "975ed872-557f-49b3-a957-216e3ae8dbb6", 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 17, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:10:11.464 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6800", 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6801", 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6802", 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6803", 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.466 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6806", 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6807", 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.467 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6804", 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6805", 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.468 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.164:6801/2383753808", 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.164:6803/2383753808", 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2383753808", 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2383753808", 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_xinfo": [ 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.469 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:09:36.777946+0000", 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:10:11.470 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:09:36.948106+0000", 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:10:11.471 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:09:36.460528+0000", 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap": [], 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_items": [], 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_primaries": [], 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_temp": [], 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_temp": [], 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklist": {}, 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "range_blocklist": {}, 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profiles": { 2024-09-12T22:10:11.472 INFO:teuthology.orchestra.run.smithi019.stdout: "default": { 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-failure-domain": "osd", 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "k": "2", 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "m": "1", 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin": "jerasure", 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "technique": "reed_sol_van" 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps_queue": [], 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "new_removed_snaps": [], 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "new_purged_snaps": [], 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_node_flags": {}, 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "device_class_flags": {}, 2024-09-12T22:10:11.473 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode": { 2024-09-12T22:10:11.474 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_enabled": false, 2024-09-12T22:10:11.474 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_bucket_count": 0, 2024-09-12T22:10:11.474 INFO:teuthology.orchestra.run.smithi019.stdout: "degraded_stretch_mode": 0, 2024-09-12T22:10:11.474 INFO:teuthology.orchestra.run.smithi019.stdout: "recovering_stretch_mode": 0, 2024-09-12T22:10:11.474 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_bucket": 0 2024-09-12T22:10:11.474 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:11.474 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:10:11.476 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:11.476 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:11.476 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:11.476 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:11.477 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': '2fe6789e-9afe-4094-9a02-5d2cb3971ecc', 'created': '2024-09-12T22:09:28.783000+0000', 'modified': '2024-09-12T22:10:11.168146+0000', 'last_up_change': '2024-09-12T22:09:38.783190+0000', 'last_in_change': '2024-09-12T22:09:30.541441+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T22:09:39.111590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T22:09:44.758823+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T22:09:48.811189+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T22:09:49.271244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '65e58e9b-56bf-491e-aaa7-2c19805f71f8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 3734941882}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 3734941882}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 3734941882}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 3734941882}]}, 'public_addr': '172.21.15.107:6801/3734941882', 'cluster_addr': '172.21.15.107:6803/3734941882', 'heartbeat_back_addr': '172.21.15.107:6807/3734941882', 'heartbeat_front_addr': '172.21.15.107:6805/3734941882', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '12c1612a-797e-4568-b2ad-a072c212de6a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 2199871564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 2199871564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 2199871564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 2199871564}]}, 'public_addr': '172.21.15.148:6801/2199871564', 'cluster_addr': '172.21.15.148:6803/2199871564', 'heartbeat_back_addr': '172.21.15.148:6807/2199871564', 'heartbeat_front_addr': '172.21.15.148:6805/2199871564', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '975ed872-557f-49b3-a957-216e3ae8dbb6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 2383753808}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 2383753808}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 2383753808}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 2383753808}]}, 'public_addr': '172.21.15.164:6801/2383753808', 'cluster_addr': '172.21.15.164:6803/2383753808', 'heartbeat_back_addr': '172.21.15.164:6807/2383753808', 'heartbeat_front_addr': '172.21.15.164:6805/2383753808', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:09:36.777946+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:09:36.948106+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:09:36.460528+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T22:10:11.477 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T22:10:11.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:11.510 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:11.509+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:11.611 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:11.610+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:11.623 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:11.623 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:11.623 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:11.623 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:11.623 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:11.632 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:11.712 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:11.711+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:11.736 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.918371838999999, 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.911389381999999, 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777499443, 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777440130999999, 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777408219000002, 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777376091000001, 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777330698, 2024-09-12T22:10:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777285730999999, 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777249533999999, 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777218363999999, 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.777192635999999, 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.771901796999998, 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.770551621999999, 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.769836496, 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.769665007, 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.769245978000001, 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084722400000000005, 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965549+0000", 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.22e-07 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965552+0000", 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3979999999999999e-06 2024-09-12T22:10:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965559+0000", 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6460000000000004e-06 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965564+0000", 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7980000000000002e-06 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966264+0000", 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069969900000000002 2024-09-12T22:10:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966272+0000", 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8620000000000003e-06 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966396+0000", 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012359900000000001 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.764069684999999, 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.763980587999999, 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.782257348999998, 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.78021745300000001, 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:11.838 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:11.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:11.840 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:11.838+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:11.940 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:11.939+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:11.956 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:11.956 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:11.957 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:11.957 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:11.965 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:12.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:12.041 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:12.040+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:12.110 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:12.110 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:12.111 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:12.111 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:12.111 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:12.119 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:12.142 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:12.141+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:12.163 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:12.249 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:12.250 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:12.250 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:12.254 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:12.254 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:12.254 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:12.255 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:12.252+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:12.354 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:12.353+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:12.370 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:12.370 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:12.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:12.455 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:12.455+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:12.483 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:12.483 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:12.492 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:12.556 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:12.555+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:12.595 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:12.595 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:12.604 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:12.658 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:12.657+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:12.722 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:12.722 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:12.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:12.759 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:12.758+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:12.834 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:12.835 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:12.843 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:12.859 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:12.858+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:12.947 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:12.947 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:12.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:12.999 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:12.998+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:13.061 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:13.061+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:13.063 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.063 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.073 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:13.162 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:13.161+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:13.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:10:13.217 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.217 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:13.264 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:13.263+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:13.365 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:13.364+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:13.370 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.370 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:13.465 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:13.465+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:13.495 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.495 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.505 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:13.567 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:13.566+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:13.609 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.609 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.618 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:13.667 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:13.666+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:13.722 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.723 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.731 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:13.768 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:13.767+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:13.845 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.845 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:13.898 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:13.897+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:13.958 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:13.958 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:13.967 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:13.969 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:13.969+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:14.070 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:14.069+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:14.110 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:14.110 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:14.119 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:14.171 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:14.170+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:10:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:14.244 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:14.253 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:14.272 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:14.271+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:14.373 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:14.372+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:14.384 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:14.385 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:14.388 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:14.388 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:14.397 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:14.402 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:14.402 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:14.419 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:14.474 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:14.473+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:14.502 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:14.502 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:14.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:14.502 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.216291007999999, 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:14.503 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:14.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.831269943999999, 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.509 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:14.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.5421041, 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.515 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:14.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:14.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.542048098999999, 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.522 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:14.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:14.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.528 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.542015482, 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:14.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:14.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:14.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541988814, 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:14.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:14.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.542 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541919601, 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:14.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:14.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541873072000001, 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.549 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:14.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:14.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541843994000001, 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:14.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:14.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:14.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541818035999999, 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:14.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:14.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541774354000001, 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:14.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:14.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.576 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541746782000001, 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:14.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:14.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:14.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:14.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541709599000001, 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:14.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:14.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:14.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541662973000001, 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.590 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:14.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:14.596 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.5416214, 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:14.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:14.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541561080000001, 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:14.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:14.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:14.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541518705000001, 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:14.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:14.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.617 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541484791999999, 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:14.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:14.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541452421999999, 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:14.624 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:14.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:14.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:14.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.541410248999998, 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:14.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:14.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:14.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.635 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:14.636 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:14.636 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:14.637 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:14.638 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:14.636+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:14.738 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:14.737+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:14.753 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:14.754 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:14.754 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-12T22:10:14.754 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:14.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:14.839 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:14.838+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:14.869 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:14.869 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-12T22:10:14.869 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-12T22:10:14.869 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:14.878 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:14.962 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:14.961+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.873760148000002, 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056684099999999996, 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.025 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149053+0000", 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8380000000000004e-06 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149060+0000", 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.092e-06 2024-09-12T22:10:15.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149064+0000", 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9199999999999997e-06 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149094+0000", 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9960000000000001e-05 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149108+0000", 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4229e-05 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154682+0000", 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005574313 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154717+0000", 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4619999999999997e-05 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'87)", 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.873240639999999, 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051784550000000002, 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149569+0000", 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149630+0000", 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1387e-05 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149638+0000", 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5870000000000004e-06 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149641+0000", 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:10:15.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149672+0000", 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0533000000000001e-05 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149683+0000", 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1589e-05 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154719+0000", 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050359139999999998 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154747+0000", 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7361000000000001e-05 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.034 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.872659347999999, 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046234479999999996, 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150150+0000", 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3799999999999997e-07 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150155+0000", 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.656e-06 2024-09-12T22:10:15.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150165+0000", 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0674e-05 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150170+0000", 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6739999999999996e-06 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150204+0000", 2024-09-12T22:10:15.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4279000000000002e-05 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150218+0000", 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3301e-05 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154748+0000", 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045300269999999998 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154773+0000", 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5199e-05 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.578161518000002, 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055762709999999998, 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444648+0000", 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444713+0000", 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5523000000000003e-05 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444721+0000", 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3150000000000003e-06 2024-09-12T22:10:15.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444726+0000", 2024-09-12T22:10:15.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:10:15.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444763+0000", 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7836000000000002e-05 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444776+0000", 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2801e-05 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450190+0000", 2024-09-12T22:10:15.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0054141800000000002 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450224+0000", 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3160000000000001e-05 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:180 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'130, mlcod=10'125)", 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:15.044 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.577466582, 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051388110000000001, 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445343+0000", 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445347+0000", 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2400000000000001e-06 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445357+0000", 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.91e-06 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445361+0000", 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447533+0000", 2024-09-12T22:10:15.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021720350000000001 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447546+0000", 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2461e-05 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450459+0000", 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029135670000000002 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450481+0000", 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1569999999999998e-05 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'126)", 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.576922095999997, 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046082930000000003, 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.049 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:15.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:15.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445888+0000", 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5099999999999999e-06 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445898+0000", 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0139999999999999e-05 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445924+0000", 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5233e-05 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445936+0000", 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1960000000000001e-05 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447745+0000", 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018097390000000001 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447757+0000", 2024-09-12T22:10:15.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.145e-05 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450482+0000", 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027252930000000002 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450495+0000", 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2968e-05 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.056 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.353265948999997, 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053037229999999998, 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5400000000000002e-07 2024-09-12T22:10:15.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669602+0000", 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8372000000000003e-05 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669610+0000", 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9570000000000002e-06 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669614+0000", 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1799999999999998e-06 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669639+0000", 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5559e-05 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669651+0000", 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1572e-05 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674822+0000", 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051706929999999996 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674847+0000", 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4936e-05 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.064614421999998, 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061352830000000001, 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958195+0000", 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2899999999999999e-07 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958204+0000", 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5300000000000002e-06 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958224+0000", 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958241+0000", 2024-09-12T22:10:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6574000000000001e-05 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958326+0000", 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5526999999999996e-05 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964330+0000", 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060033889999999996 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.066 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.066 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:15.066 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.064407928000001, 2024-09-12T22:10:15.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013942721999999999, 2024-09-12T22:10:15.066 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2897999999999999e-05 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958421+0000", 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4019999999999996e-06 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958434+0000", 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2425999999999999e-05 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958445+0000", 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1063999999999999e-05 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962479+0000", 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040343549999999999 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962774+0000", 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029505999999999998 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962946+0000", 2024-09-12T22:10:15.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000171495 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967061+0000", 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0041158369999999998 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972243+0000", 2024-09-12T22:10:15.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051817770000000003 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972291+0000", 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7797000000000003e-05 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972344+0000", 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2611000000000002e-05 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.072 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.064342488000001, 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014018879999999999, 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958467+0000", 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958481+0000", 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4049999999999999e-05 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3788000000000001e-05 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958502+0000", 2024-09-12T22:10:15.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0820000000000001e-06 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963718+0000", 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052157330000000002 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963797+0000", 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8894999999999996e-05 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963912+0000", 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115408 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967755+0000", 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038428450000000001 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972392+0000", 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046365540000000002 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972439+0000", 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7221000000000001e-05 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972485+0000", 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6483999999999997e-05 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.064295779999998, 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013933348999999999, 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:15.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958514+0000", 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.37e-07 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958518+0000", 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9040000000000002e-06 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958526+0000", 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7970000000000006e-06 2024-09-12T22:10:15.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8464e-05 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963700+0000", 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051047130000000003 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963786+0000", 2024-09-12T22:10:15.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6839e-05 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963908+0000", 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012141099999999999 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967748+0000", 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038402990000000001 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972354+0000", 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046053960000000003 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972403+0000", 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9598000000000002e-05 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972446+0000", 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3191e-05 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.084 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.064187371999999, 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01398747, 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958622+0000", 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958628+0000", 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7690000000000002e-06 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958989+0000", 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000360639 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959021+0000", 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2175000000000003e-05 2024-09-12T22:10:15.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964221+0000", 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052003379999999997 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964306+0000", 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4939999999999997e-05 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964432+0000", 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012610400000000001 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967768+0000", 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033359459999999998 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972501+0000", 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047327589999999996 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972555+0000", 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4435000000000003e-05 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972609+0000", 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3591000000000002e-05 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.090 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.062878343000001, 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011590303, 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959932+0000", 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2440000000000001e-06 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959938+0000", 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.528e-06 2024-09-12T22:10:15.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959954+0000", 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5883e-05 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959963+0000", 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4190000000000002e-06 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960178+0000", 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021503399999999999 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op must wait for map", 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960184+0000", 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9660000000000001e-06 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962999+0000", 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028151610000000001 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963125+0000", 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012594200000000001 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963238+0000", 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112866 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967067+0000", 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003829673 2024-09-12T22:10:15.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971152+0000", 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040845760000000004 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971476+0000", 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032402800000000002 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971521+0000", 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4982999999999999e-05 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.062700342999999, 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012104059, 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.097 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960109+0000", 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.16e-07 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960115+0000", 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0209999999999996e-06 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960162+0000", 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7012999999999999e-05 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960233+0000", 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0489999999999998e-05 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963739+0000", 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035056879999999999 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963795+0000", 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6274999999999999e-05 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963924+0000", 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012943000000000001 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967683+0000", 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037590010000000001 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971944+0000", 2024-09-12T22:10:15.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042611330000000003 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972096+0000", 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015156499999999999 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972213+0000", 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116527 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.102 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.062552805999999, 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012377496, 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:15.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960257+0000", 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6899999999999996e-07 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960264+0000", 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960274+0000", 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0036e-05 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960282+0000", 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964601+0000", 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004319051 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964672+0000", 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0648000000000005e-05 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964758+0000", 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5881e-05 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971455+0000", 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066973750000000002 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972530+0000", 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001074684 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972582+0000", 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1601999999999998e-05 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972634+0000", 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1903000000000001e-05 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.062515784999999, 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081337059999999992, 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960294+0000", 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8100000000000002e-07 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960297+0000", 2024-09-12T22:10:15.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9459999999999998e-06 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960305+0000", 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7690000000000002e-06 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960312+0000", 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8390000000000001e-06 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960372+0000", 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9635000000000001e-05 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960545+0000", 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017338499999999999 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.968427+0000", 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078814509999999994 2024-09-12T22:10:15.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.062480586, 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075124349999999996, 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:15.113 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960329+0000", 2024-09-12T22:10:15.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960339+0000", 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0282000000000001e-05 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960349+0000", 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0226e-05 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960357+0000", 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961038+0000", 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068101499999999998 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961157+0000", 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119157 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967841+0000", 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066831770000000002 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.060558888999999, 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048339589999999997, 2024-09-12T22:10:15.117 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9499999999999998e-07 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962257+0000", 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.178e-06 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962264+0000", 2024-09-12T22:10:15.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962272+0000", 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1559999999999995e-06 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962389+0000", 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011691700000000001 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962449+0000", 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9188999999999999e-05 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967044+0000", 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045949880000000004 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967084+0000", 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0318999999999998e-05 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.121 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.060524177000001, 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004830399, 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8700000000000001e-07 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962297+0000", 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2252999999999999e-05 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962304+0000", 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962309+0000", 2024-09-12T22:10:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0320000000000003e-06 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00067960500000000001 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963008+0000", 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8924e-05 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967089+0000", 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040809399999999999 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967115+0000", 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6298000000000001e-05 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:15.126 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.060355241, 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046231019999999996, 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:15.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962458+0000", 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.002e-06 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962559+0000", 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101159 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962596+0000", 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.718e-05 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962793+0000", 2024-09-12T22:10:15.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019661599999999999 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962811+0000", 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8447000000000001e-05 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004205627 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:15.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967077+0000", 2024-09-12T22:10:15.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9772000000000003e-05 2024-09-12T22:10:15.131 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.131 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.131 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.131 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:15.131 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:15.131 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:15.133 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:15.132+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:15.133 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:15.233 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:15.232+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:15.246 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:15.246 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:15.246 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:15.246 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:15.255 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:15.333 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:15.333+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:15.357 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:15.357 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:15.357 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:15.357 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:15.357 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:15.365 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:15.434 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:15.433+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:15.473 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.651737201, 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.644754744, 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510864805000001, 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510805492999999, 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510773580999999, 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510741453000001, 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:15.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:15.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510696060000001, 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:15.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:15.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:15.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.516 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.516 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:15.516 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510651093, 2024-09-12T22:10:15.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:15.516 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.516 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:15.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510614896, 2024-09-12T22:10:15.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:15.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510583726, 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:15.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:15.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:15.532 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.510557997999999, 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:15.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:15.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:15.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.505267158999999, 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.537 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.503916984, 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:15.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.503201858000001, 2024-09-12T22:10:15.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:15.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.503030369000001, 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:15.550 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:15.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e18/16 ondisk, result = 0)", 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.502611340000001, 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084722400000000005, 2024-09-12T22:10:15.555 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965548+0000", 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965549+0000", 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.22e-07 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965552+0000", 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3979999999999999e-06 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965559+0000", 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6460000000000004e-06 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965564+0000", 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7980000000000002e-06 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966264+0000", 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069969900000000002 2024-09-12T22:10:15.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966272+0000", 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8620000000000003e-06 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966396+0000", 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012359900000000001 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.559 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.497435047, 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:15.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:15.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.49734595, 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.565 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:15.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.515622710999999, 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:15.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.5135828150000004, 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.576 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:15.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:15.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:15.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.582 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.582 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.582 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:15.582 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:15.582 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:15.584 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:15.584 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:15.582+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:15.684 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:15.683+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:15.700 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:15.700 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:15.700 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:15.700 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:15.709 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:15.785 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:15.784+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:15.813 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:15.813 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:15.813 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:15.813 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:15.813 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:15.822 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:15.886 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:15.885+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:15.928 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.642229180999998, 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:15.929 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:15.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:15.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.257208116999998, 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:15.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:15.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.968042273000002, 2024-09-12T22:10:15.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:15.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:15.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.947 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967986272000001, 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:15.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:15.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:15.955 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967953654999999, 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:15.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:15.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967926986999998, 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.962 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:15.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:15.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.968 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967857773999999, 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:15.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:15.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967811245, 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:15.975 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:15.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:15.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967782166999999, 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:15.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:15.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:15.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:15.988 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967756209000001, 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:15.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:15.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:15.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967712527, 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:15.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:15.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967684954999999, 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.001 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:16.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967647771999999, 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:16.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:16.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967601146, 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.014 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:16.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:16.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:16.020 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967559572999999, 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.021 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:16.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:16.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.027 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967499253, 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:16.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:16.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967456878, 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.034 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:16.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:16.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.040 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967422965000001, 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:16.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:16.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967390595000001, 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:16.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:16.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:16.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.053 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.967348422000001, 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:16.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:16.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:16.059 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:16.059 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:16.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:16.061 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:16.059+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:16.161 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:16.161+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:16.176 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:16.177 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:16.177 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-12T22:10:16.177 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:16.187 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:16.208 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:10:16.262 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:16.262+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:16.289 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-12T22:10:16.290 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-12T22:10:16.290 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:16.298 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:16.364 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:16.363+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:16.402 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.251636656999999, 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056684099999999996, 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.403 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:16.404 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149053+0000", 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8380000000000004e-06 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149060+0000", 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.092e-06 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.405 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149064+0000", 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9199999999999997e-06 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149094+0000", 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9960000000000001e-05 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149108+0000", 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4229e-05 2024-09-12T22:10:16.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154682+0000", 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005574313 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154717+0000", 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4619999999999997e-05 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'87)", 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.251117149000002, 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051784550000000002, 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.408 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.409 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149569+0000", 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149630+0000", 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1387e-05 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149638+0000", 2024-09-12T22:10:16.410 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5870000000000004e-06 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149641+0000", 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149672+0000", 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0533000000000001e-05 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149683+0000", 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1589e-05 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154719+0000", 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050359139999999998 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.412 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154747+0000", 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7361000000000001e-05 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.250535857000003, 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046234479999999996, 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.413 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.414 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150150+0000", 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3799999999999997e-07 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150155+0000", 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.656e-06 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150165+0000", 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0674e-05 2024-09-12T22:10:16.415 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150170+0000", 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6739999999999996e-06 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150204+0000", 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4279000000000002e-05 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150218+0000", 2024-09-12T22:10:16.416 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3301e-05 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154748+0000", 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045300269999999998 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154773+0000", 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5199e-05 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.956038026999998, 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055762709999999998, 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.418 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444648+0000", 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.419 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444713+0000", 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5523000000000003e-05 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444721+0000", 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3150000000000003e-06 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.420 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444726+0000", 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444763+0000", 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7836000000000002e-05 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444776+0000", 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2801e-05 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.421 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450190+0000", 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0054141800000000002 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450224+0000", 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3160000000000001e-05 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:180 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'130, mlcod=10'125)", 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.955343091000003, 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051388110000000001, 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.423 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445343+0000", 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445347+0000", 2024-09-12T22:10:16.424 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2400000000000001e-06 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445357+0000", 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.91e-06 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445361+0000", 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.425 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447533+0000", 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021720350000000001 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447546+0000", 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2461e-05 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450459+0000", 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029135670000000002 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.426 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450481+0000", 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1569999999999998e-05 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'126)", 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.954798605000001, 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046082930000000003, 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.427 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:16.428 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445888+0000", 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5099999999999999e-06 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445898+0000", 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0139999999999999e-05 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.429 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445924+0000", 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5233e-05 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445936+0000", 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1960000000000001e-05 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447745+0000", 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018097390000000001 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447757+0000", 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.145e-05 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450482+0000", 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027252930000000002 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450495+0000", 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2968e-05 2024-09-12T22:10:16.431 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.731142458000001, 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053037229999999998, 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.432 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:16.433 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5400000000000002e-07 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669602+0000", 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8372000000000003e-05 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669610+0000", 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9570000000000002e-06 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.434 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669614+0000", 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1799999999999998e-06 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669639+0000", 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5559e-05 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669651+0000", 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1572e-05 2024-09-12T22:10:16.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674822+0000", 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051706929999999996 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674847+0000", 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4936e-05 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.436 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.442490930999998, 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061352830000000001, 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.437 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958195+0000", 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2899999999999999e-07 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.438 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958204+0000", 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5300000000000002e-06 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958224+0000", 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958241+0000", 2024-09-12T22:10:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6574000000000001e-05 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958326+0000", 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5526999999999996e-05 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964330+0000", 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060033889999999996 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.440 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.442284437000001, 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013942721999999999, 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.441 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:16.442 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2897999999999999e-05 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958421+0000", 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4019999999999996e-06 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958434+0000", 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2425999999999999e-05 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.443 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958445+0000", 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1063999999999999e-05 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962479+0000", 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040343549999999999 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962774+0000", 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029505999999999998 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.444 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962946+0000", 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000171495 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967061+0000", 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0041158369999999998 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972243+0000", 2024-09-12T22:10:16.445 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051817770000000003 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972291+0000", 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7797000000000003e-05 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972344+0000", 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2611000000000002e-05 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.446 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.442218997000001, 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014018879999999999, 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.447 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958467+0000", 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:10:16.448 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958481+0000", 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4049999999999999e-05 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3788000000000001e-05 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.449 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958502+0000", 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0820000000000001e-06 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963718+0000", 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052157330000000002 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963797+0000", 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8894999999999996e-05 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.450 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963912+0000", 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115408 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967755+0000", 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038428450000000001 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972392+0000", 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046365540000000002 2024-09-12T22:10:16.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972439+0000", 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7221000000000001e-05 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972485+0000", 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6483999999999997e-05 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.452 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.442172288999998, 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013933348999999999, 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:16.453 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958514+0000", 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.37e-07 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958518+0000", 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9040000000000002e-06 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958526+0000", 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7970000000000006e-06 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8464e-05 2024-09-12T22:10:16.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963700+0000", 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051047130000000003 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963786+0000", 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6839e-05 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963908+0000", 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012141099999999999 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967748+0000", 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038402990000000001 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972354+0000", 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046053960000000003 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.457 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972403+0000", 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9598000000000002e-05 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972446+0000", 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3191e-05 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.458 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.442063880999999, 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01398747, 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:16.459 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958622+0000", 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:10:16.460 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.461 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.461 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.461 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958628+0000", 2024-09-12T22:10:16.461 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7690000000000002e-06 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958989+0000", 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000360639 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959021+0000", 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2175000000000003e-05 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.462 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964221+0000", 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052003379999999997 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964306+0000", 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4939999999999997e-05 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964432+0000", 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012610400000000001 2024-09-12T22:10:16.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967768+0000", 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033359459999999998 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972501+0000", 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047327589999999996 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.464 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972555+0000", 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4435000000000003e-05 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972609+0000", 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3591000000000002e-05 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.465 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.440754852000001, 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011590303, 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959932+0000", 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2440000000000001e-06 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959938+0000", 2024-09-12T22:10:16.467 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.528e-06 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959954+0000", 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5883e-05 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959963+0000", 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4190000000000002e-06 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960178+0000", 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021503399999999999 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op must wait for map", 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960184+0000", 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9660000000000001e-06 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.469 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962999+0000", 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028151610000000001 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963125+0000", 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012594200000000001 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963238+0000", 2024-09-12T22:10:16.470 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112866 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967067+0000", 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003829673 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971152+0000", 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040845760000000004 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971476+0000", 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032402800000000002 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971521+0000", 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4982999999999999e-05 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.472 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.440576852, 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012104059, 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960109+0000", 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.16e-07 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.474 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960115+0000", 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0209999999999996e-06 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960162+0000", 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7012999999999999e-05 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960233+0000", 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0489999999999998e-05 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.475 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963739+0000", 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035056879999999999 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963795+0000", 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6274999999999999e-05 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963924+0000", 2024-09-12T22:10:16.476 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012943000000000001 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967683+0000", 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037590010000000001 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971944+0000", 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042611330000000003 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972096+0000", 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015156499999999999 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972213+0000", 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116527 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.440429314999999, 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012377496, 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.479 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960257+0000", 2024-09-12T22:10:16.480 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6899999999999996e-07 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960264+0000", 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960274+0000", 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0036e-05 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.481 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960282+0000", 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964601+0000", 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004319051 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964672+0000", 2024-09-12T22:10:16.482 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0648000000000005e-05 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964758+0000", 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5881e-05 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971455+0000", 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066973750000000002 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.483 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972530+0000", 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001074684 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972582+0000", 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1601999999999998e-05 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972634+0000", 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1903000000000001e-05 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.484 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.440392293999999, 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081337059999999992, 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.485 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960294+0000", 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8100000000000002e-07 2024-09-12T22:10:16.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960297+0000", 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9459999999999998e-06 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960305+0000", 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7690000000000002e-06 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.487 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960312+0000", 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8390000000000001e-06 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960372+0000", 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9635000000000001e-05 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960545+0000", 2024-09-12T22:10:16.488 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017338499999999999 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.968427+0000", 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078814509999999994 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:16.489 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.440357095, 2024-09-12T22:10:16.490 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075124349999999996, 2024-09-12T22:10:16.490 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.490 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.490 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:16.493 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.493 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.494 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960329+0000", 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960339+0000", 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0282000000000001e-05 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960349+0000", 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0226e-05 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.495 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960357+0000", 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961038+0000", 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068101499999999998 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961157+0000", 2024-09-12T22:10:16.496 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119157 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967841+0000", 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066831770000000002 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:16.497 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.438435397999999, 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048339589999999997, 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.498 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9499999999999998e-07 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.499 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962257+0000", 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.178e-06 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962264+0000", 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962272+0000", 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1559999999999995e-06 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.500 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962389+0000", 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011691700000000001 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962449+0000", 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9188999999999999e-05 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967044+0000", 2024-09-12T22:10:16.501 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045949880000000004 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967084+0000", 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0318999999999998e-05 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.438400686000001, 2024-09-12T22:10:16.502 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004830399, 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:16.503 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8700000000000001e-07 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962297+0000", 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2252999999999999e-05 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.504 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962304+0000", 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962309+0000", 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0320000000000003e-06 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00067960500000000001 2024-09-12T22:10:16.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963008+0000", 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8924e-05 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967089+0000", 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040809399999999999 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967115+0000", 2024-09-12T22:10:16.506 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6298000000000001e-05 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.43823175, 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046231019999999996, 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:16.507 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.508 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962458+0000", 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.002e-06 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962559+0000", 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101159 2024-09-12T22:10:16.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962596+0000", 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.718e-05 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962793+0000", 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019661599999999999 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:16.510 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962811+0000", 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8447000000000001e-05 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004205627 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967077+0000", 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9772000000000003e-05 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.511 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.512 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:16.512 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:16.512 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:16.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:16.513 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:10:16.513 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:10:16.513 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T22:10:16.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T22:10:16.515 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:16.512+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:16.515 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:16.615 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:16.614+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:16.631 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:16.631 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:16.631 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:16.631 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:16.640 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:16.641 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:16.641 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:16.670 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:16.687 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:16.687 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:16.716 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:16.715+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:16.744 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:16.744 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:16.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:16.817 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:16.816+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:10:16.823 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 25, 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "2fe6789e-9afe-4094-9a02-5d2cb3971ecc", 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "created": "2024-09-12T22:09:28.783000+0000", 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "modified": "2024-09-12T22:10:14.174212+0000", 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "last_up_change": "2024-09-12T22:09:38.783190+0000", 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "last_in_change": "2024-09-12T22:09:30.541441+0000", 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_num": 5804032, 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_set": [ 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "nodeep-scrub", 2024-09-12T22:10:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: "pglog_hardlimit", 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "purged_snapdirs", 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_deletes", 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "sortbitwise" 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_version": 4, 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T22:10:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_snapshot": "", 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_max": 4, 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd": 3, 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "require_min_compat_client": "luminous", 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "min_compat_client": "jewel", 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "require_osd_release": "squid", 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_crimson": false, 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "pools": [ 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 1, 2024-09-12T22:10:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": ".mgr", 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:39.111590+0000", 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 1, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 1, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 1, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 1, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 1, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:16.828 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "11", 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:16.829 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:16.830 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:16.830 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:16.830 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:16.830 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:16.830 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:16.830 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:16.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:10:16.833 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_max": 32, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 1 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": {} 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 2.9900000095367432, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 2.9900000095367432, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 2, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 2, 2024-09-12T22:10:16.834 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 2, 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "rbd", 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:44.758823+0000", 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 8193, 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:16.835 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:16.836 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 8, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 8, 2024-09-12T22:10:16.837 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 8, 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 8, 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 8, 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "15", 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 2, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 15, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd": {} 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T22:10:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 3, 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_metadata", 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:48.811189+0000", 2024-09-12T22:10:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T22:10:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "18", 2024-09-12T22:10:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_bias": 4, 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 16, 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_priority": 5 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": "cephfs" 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.1299999952316284, 2024-09-12T22:10:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.1299999952316284, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 4, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_data", 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:09:49.271244+0000", 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:10:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 64, 2024-09-12T22:10:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 64, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 64, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 64, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 64, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "19", 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:10:16.851 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:10:16.852 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:10:16.853 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 64, 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T22:10:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "data": "cephfs" 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.1299999952316284, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.1299999952316284, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2024-09-12T22:10:16.855 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "osds": [ 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "65e58e9b-56bf-491e-aaa7-2c19805f71f8", 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:10:16.856 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 17, 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6800", 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.857 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6801", 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6802", 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.858 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6803", 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6806", 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.859 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6807", 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6804", 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.860 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.107:6805", 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734941882 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.107:6801/3734941882", 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.107:6803/3734941882", 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.107:6807/3734941882", 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.107:6805/3734941882", 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "12c1612a-797e-4568-b2ad-a072c212de6a", 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 17, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:10:16.862 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6800", 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6801", 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6802", 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6803", 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.864 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6806", 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6807", 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6804", 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6805", 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2199871564 2024-09-12T22:10:16.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.148:6801/2199871564", 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.148:6803/2199871564", 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.148:6807/2199871564", 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.148:6805/2199871564", 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:10:16.867 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "975ed872-557f-49b3-a957-216e3ae8dbb6", 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 17, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.868 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6800", 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6801", 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6802", 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.870 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6803", 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6806", 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.871 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6807", 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6804", 2024-09-12T22:10:16.872 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.164:6805", 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2383753808 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.164:6801/2383753808", 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.164:6803/2383753808", 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.164:6807/2383753808", 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.164:6805/2383753808", 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:10:16.873 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_xinfo": [ 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:09:36.777946+0000", 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:10:16.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:09:36.948106+0000", 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:10:16.875 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:09:36.460528+0000", 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap": [], 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_items": [], 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_primaries": [], 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_temp": [], 2024-09-12T22:10:16.876 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_temp": [], 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklist": {}, 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "range_blocklist": {}, 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profiles": { 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "default": { 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-failure-domain": "osd", 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "k": "2", 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "m": "1", 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin": "jerasure", 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: "technique": "reed_sol_van" 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps_queue": [], 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "new_removed_snaps": [], 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "new_purged_snaps": [], 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_node_flags": {}, 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "device_class_flags": {}, 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode": { 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_enabled": false, 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_bucket_count": 0, 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "degraded_stretch_mode": 0, 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "recovering_stretch_mode": 0, 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_bucket": 0 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:10:16.878 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:10:16.880 INFO:tasks.thrashosds.thrasher:j is {'epoch': 25, 'fsid': '2fe6789e-9afe-4094-9a02-5d2cb3971ecc', 'created': '2024-09-12T22:09:28.783000+0000', 'modified': '2024-09-12T22:10:14.174212+0000', 'last_up_change': '2024-09-12T22:09:38.783190+0000', 'last_in_change': '2024-09-12T22:09:30.541441+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T22:09:39.111590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T22:09:44.758823+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T22:09:48.811189+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T22:09:49.271244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '65e58e9b-56bf-491e-aaa7-2c19805f71f8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 3734941882}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 3734941882}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 3734941882}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 3734941882}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 3734941882}]}, 'public_addr': '172.21.15.107:6801/3734941882', 'cluster_addr': '172.21.15.107:6803/3734941882', 'heartbeat_back_addr': '172.21.15.107:6807/3734941882', 'heartbeat_front_addr': '172.21.15.107:6805/3734941882', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '12c1612a-797e-4568-b2ad-a072c212de6a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 2199871564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 2199871564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 2199871564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 2199871564}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 2199871564}]}, 'public_addr': '172.21.15.148:6801/2199871564', 'cluster_addr': '172.21.15.148:6803/2199871564', 'heartbeat_back_addr': '172.21.15.148:6807/2199871564', 'heartbeat_front_addr': '172.21.15.148:6805/2199871564', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '975ed872-557f-49b3-a957-216e3ae8dbb6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 2383753808}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 2383753808}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 2383753808}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 2383753808}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 2383753808}]}, 'public_addr': '172.21.15.164:6801/2383753808', 'cluster_addr': '172.21.15.164:6803/2383753808', 'heartbeat_back_addr': '172.21.15.164:6807/2383753808', 'heartbeat_front_addr': '172.21.15.164:6805/2383753808', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:09:36.777946+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:09:36.948106+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:09:36.460528+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T22:10:16.880 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T22:10:16.895 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:16.895 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:16.904 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:16.918 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:16.917+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:17.018 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:17.018+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:17.020 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.020 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.029 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:17.120 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:17.119+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:17.132 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.133 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:17.196 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:10:17.221 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:17.221+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:17.286 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.286 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:17.322 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:17.321+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:17.411 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.411 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.421 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:17.423 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:17.422+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:17.523 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:17.523+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:17.525 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.525 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:17.625 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:17.624+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:17.637 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.637 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:17.726 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:17.725+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:17.757 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.757 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.766 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:17.826 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:17.826+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:17.869 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.870 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:17.928 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:17.927+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:17.981 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:17.981 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:17.989 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:18.028 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:18.028+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:18.097 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:18.097 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:18.106 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:18.129 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:18.129+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:18.208 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:18.209 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:18.217 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:18.231 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:18.230+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:18.319 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:18.320 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:18.329 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:18.332 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:18.331+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:18.433 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:18.432+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:18.437 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:18.437 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:18.446 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:18.534 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:18.533+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:18.549 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:18.549 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:18.558 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:18.635 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:18.635+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:18.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:18.701 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:18.702 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:18.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:18.737 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:18.736+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:18.816 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:18.816 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:18.825 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:18.837 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:18.837+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:18.838 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:18.838 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:18.856 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:18.856 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:18.874 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:18.874 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:18.926 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:18.927 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:18.927 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:18.927 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:18.927 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:18.935 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:18.938 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:18.937+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:19.040 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:19.040 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:19.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:19.040 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:19.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.040 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.220698356, 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:19.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:19.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:19.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:19.046 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.213715899, 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:19.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:19.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:19.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:19.051 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079825960000001, 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.052 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:19.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:19.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079766648, 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:19.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:19.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.064 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079734735999999, 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:19.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079702608000002, 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.070 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:19.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079657215000001, 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.076 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:19.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:19.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:19.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079612248, 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.082 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:19.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:19.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.087 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079576051, 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.091 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079544881, 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:19.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.079519153, 2024-09-12T22:10:19.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:19.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:19.099 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.074228313999999, 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.072878139, 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.103 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:19.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.107 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.072163013000001, 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:19.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.111 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.071991524000001, 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:19.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:19.116 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.066396202, 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:19.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:19.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.066307105, 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:19.125 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.084583865999999, 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:19.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:19.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0825439699999997, 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.131 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:19.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0818258200000002, 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:19.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:19.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:19.142 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:19.144 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:19.038+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:19.144 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:19.143+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:19.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:19.212 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:10:19.245 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:19.244+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:19.251 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:19.252 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:19.252 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:19.252 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:19.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:19.346 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:19.345+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:19.364 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:19.364 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:19.373 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:19.447 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:19.446+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:19.480 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:19.480 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:19.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:19.481 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:19.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.481 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:19.481 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:19.481 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.193378035000002, 2024-09-12T22:10:19.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:19.482 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.482 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.482 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.482 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:19.482 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:19.482 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:19.482 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:19.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.483 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:19.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:19.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:19.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:19.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:19.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:19.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:19.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:19.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:19.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:19.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:19.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:19.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:19.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:19.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:19.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:19.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:19.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:19.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:19.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:19.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:19.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:19.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:19.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:19.495 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.495 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.495 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.496 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:19.496 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:19.496 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.808356971000002, 2024-09-12T22:10:19.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:19.497 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.497 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.497 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:19.497 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:19.497 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:19.498 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:19.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.498 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:19.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:19.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:19.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:19.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:19.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:19.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:19.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:19.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:19.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:19.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:19.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:19.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:19.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:19.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:19.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:19.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:19.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:19.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:19.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:19.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:19.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:19.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:19.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:19.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.508 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.508 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.509 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:19.509 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.519191126999999, 2024-09-12T22:10:19.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:19.509 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.509 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.509 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.509 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:19.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:19.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:19.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:19.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:19.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:19.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:19.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:19.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:19.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:19.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:19.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:19.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:19.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:19.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:19.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:19.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:19.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:19.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:19.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:19.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:19.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:19.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:19.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:19.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:19.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:19.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:19.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:19.521 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.521 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.521 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.522 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.522 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:19.522 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.519135125999998, 2024-09-12T22:10:19.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:19.522 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.522 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.522 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:19.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:19.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:19.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:19.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:19.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:19.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:19.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:19.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:19.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:19.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:19.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:19.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.519102509, 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.532 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:19.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:19.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.519075840999999, 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:19.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.519006628, 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.545 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:19.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:19.551 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518960099000001, 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:19.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:19.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518931021, 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:19.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:19.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:19.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518905062999998, 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.568 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:19.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:19.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:19.574 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518861381000001, 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:19.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:19.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:19.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:19.581 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518833809, 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:19.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:19.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:19.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:19.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:19.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518796626, 2024-09-12T22:10:19.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:19.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518750000000001, 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:19.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:19.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:19.601 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518708427, 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:19.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:19.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:19.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518648107000001, 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518605732000001, 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.614 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:19.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:19.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518571819000002, 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:19.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:19.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518539448999999, 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:19.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.518497276000002, 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:19.633 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:19.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:19.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:19.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.638 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:19.638 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:19.638 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:19.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:19.640 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:19.638+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:19.741 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:19.739+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:19.755 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:19.755 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:19.755 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-12T22:10:19.755 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:19.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:19.842 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:19.841+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:19.909 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:19.909 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:19.909 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-12T22:10:19.909 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-12T22:10:19.909 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:19.918 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:19.943 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:19.942+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:20.021 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.870628607, 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056684099999999996, 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149053+0000", 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8380000000000004e-06 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149060+0000", 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.092e-06 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149064+0000", 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9199999999999997e-06 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149094+0000", 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9960000000000001e-05 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149108+0000", 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4229e-05 2024-09-12T22:10:20.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154682+0000", 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005574313 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154717+0000", 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4619999999999997e-05 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'87)", 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.870109098999997, 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051784550000000002, 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149569+0000", 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149630+0000", 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1387e-05 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149638+0000", 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5870000000000004e-06 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149641+0000", 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149672+0000", 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0533000000000001e-05 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149683+0000", 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1589e-05 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154719+0000", 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050359139999999998 2024-09-12T22:10:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154747+0000", 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7361000000000001e-05 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.869527806999997, 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046234479999999996, 2024-09-12T22:10:20.031 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150150+0000", 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3799999999999997e-07 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150155+0000", 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.656e-06 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150165+0000", 2024-09-12T22:10:20.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0674e-05 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150170+0000", 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6739999999999996e-06 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150204+0000", 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4279000000000002e-05 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150218+0000", 2024-09-12T22:10:20.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3301e-05 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154748+0000", 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045300269999999998 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154773+0000", 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5199e-05 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.575029977, 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055762709999999998, 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:20.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444648+0000", 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444713+0000", 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5523000000000003e-05 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444721+0000", 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3150000000000003e-06 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444726+0000", 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444763+0000", 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7836000000000002e-05 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444776+0000", 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2801e-05 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450190+0000", 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0054141800000000002 2024-09-12T22:10:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450224+0000", 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3160000000000001e-05 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:180 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'130, mlcod=10'125)", 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.574335040999998, 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051388110000000001, 2024-09-12T22:10:20.040 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445343+0000", 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445347+0000", 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2400000000000001e-06 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445357+0000", 2024-09-12T22:10:20.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.91e-06 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445361+0000", 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447533+0000", 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021720350000000001 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447546+0000", 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2461e-05 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450459+0000", 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029135670000000002 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450481+0000", 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1569999999999998e-05 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.044 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'126)", 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.573790555000002, 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046082930000000003, 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445888+0000", 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5099999999999999e-06 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445898+0000", 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0139999999999999e-05 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445924+0000", 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5233e-05 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445936+0000", 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1960000000000001e-05 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447745+0000", 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018097390000000001 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447757+0000", 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.145e-05 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450482+0000", 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027252930000000002 2024-09-12T22:10:20.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450495+0000", 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2968e-05 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 38.350134408000002, 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053037229999999998, 2024-09-12T22:10:20.049 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5400000000000002e-07 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669602+0000", 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8372000000000003e-05 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669610+0000", 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9570000000000002e-06 2024-09-12T22:10:20.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669614+0000", 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1799999999999998e-06 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669639+0000", 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5559e-05 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669651+0000", 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1572e-05 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674822+0000", 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051706929999999996 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674847+0000", 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4936e-05 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.053 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.061482881, 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061352830000000001, 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958195+0000", 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2899999999999999e-07 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958204+0000", 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5300000000000002e-06 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958224+0000", 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958241+0000", 2024-09-12T22:10:20.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6574000000000001e-05 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958326+0000", 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5526999999999996e-05 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964330+0000", 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060033889999999996 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.061276386999999, 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013942721999999999, 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:20.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2897999999999999e-05 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958421+0000", 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4019999999999996e-06 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958434+0000", 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2425999999999999e-05 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958445+0000", 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1063999999999999e-05 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962479+0000", 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040343549999999999 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962774+0000", 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029505999999999998 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962946+0000", 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000171495 2024-09-12T22:10:20.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967061+0000", 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0041158369999999998 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972243+0000", 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051817770000000003 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972291+0000", 2024-09-12T22:10:20.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7797000000000003e-05 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972344+0000", 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2611000000000002e-05 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.061210946999999, 2024-09-12T22:10:20.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014018879999999999, 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958467+0000", 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958481+0000", 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4049999999999999e-05 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3788000000000001e-05 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958502+0000", 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0820000000000001e-06 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963718+0000", 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052157330000000002 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963797+0000", 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8894999999999996e-05 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963912+0000", 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115408 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967755+0000", 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038428450000000001 2024-09-12T22:10:20.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972392+0000", 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046365540000000002 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972439+0000", 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7221000000000001e-05 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972485+0000", 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6483999999999997e-05 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.061164239, 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013933348999999999, 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.069 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958514+0000", 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.37e-07 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958518+0000", 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9040000000000002e-06 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958526+0000", 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7970000000000006e-06 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8464e-05 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963700+0000", 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051047130000000003 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963786+0000", 2024-09-12T22:10:20.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6839e-05 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963908+0000", 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012141099999999999 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967748+0000", 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038402990000000001 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.073 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972354+0000", 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046053960000000003 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972403+0000", 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9598000000000002e-05 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972446+0000", 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3191e-05 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.074 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.061055831000001, 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01398747, 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:20.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958622+0000", 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958628+0000", 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7690000000000002e-06 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958989+0000", 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000360639 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959021+0000", 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2175000000000003e-05 2024-09-12T22:10:20.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964221+0000", 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052003379999999997 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964306+0000", 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4939999999999997e-05 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964432+0000", 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012610400000000001 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967768+0000", 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033359459999999998 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972501+0000", 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047327589999999996 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972555+0000", 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4435000000000003e-05 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972609+0000", 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3591000000000002e-05 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.080 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.059746801999999, 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011590303, 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959932+0000", 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2440000000000001e-06 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959938+0000", 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.528e-06 2024-09-12T22:10:20.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959954+0000", 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5883e-05 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959963+0000", 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4190000000000002e-06 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960178+0000", 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021503399999999999 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op must wait for map", 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960184+0000", 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9660000000000001e-06 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962999+0000", 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028151610000000001 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963125+0000", 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012594200000000001 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963238+0000", 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112866 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967067+0000", 2024-09-12T22:10:20.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003829673 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971152+0000", 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040845760000000004 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971476+0000", 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032402800000000002 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971521+0000", 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4982999999999999e-05 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.059568802000001, 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012104059, 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.087 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960109+0000", 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.16e-07 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960115+0000", 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0209999999999996e-06 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960162+0000", 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7012999999999999e-05 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960233+0000", 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0489999999999998e-05 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963739+0000", 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035056879999999999 2024-09-12T22:10:20.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963795+0000", 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6274999999999999e-05 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963924+0000", 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012943000000000001 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:20.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967683+0000", 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037590010000000001 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971944+0000", 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042611330000000003 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972096+0000", 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015156499999999999 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972213+0000", 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116527 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.059421265000001, 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012377496, 2024-09-12T22:10:20.093 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960257+0000", 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6899999999999996e-07 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960264+0000", 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960274+0000", 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0036e-05 2024-09-12T22:10:20.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960282+0000", 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964601+0000", 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004319051 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964672+0000", 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0648000000000005e-05 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964758+0000", 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5881e-05 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971455+0000", 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066973750000000002 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972530+0000", 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001074684 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972582+0000", 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1601999999999998e-05 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972634+0000", 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1903000000000001e-05 2024-09-12T22:10:20.098 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.059384244, 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081337059999999992, 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960294+0000", 2024-09-12T22:10:20.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8100000000000002e-07 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960297+0000", 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9459999999999998e-06 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960305+0000", 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7690000000000002e-06 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960312+0000", 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8390000000000001e-06 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960372+0000", 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9635000000000001e-05 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960545+0000", 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017338499999999999 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.968427+0000", 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078814509999999994 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.059349045000001, 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075124349999999996, 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.103 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960329+0000", 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960339+0000", 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0282000000000001e-05 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960349+0000", 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0226e-05 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960357+0000", 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961038+0000", 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068101499999999998 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961157+0000", 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119157 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967841+0000", 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066831770000000002 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.057427348000001, 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048339589999999997, 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.107 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9499999999999998e-07 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962257+0000", 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.178e-06 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962264+0000", 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962272+0000", 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1559999999999995e-06 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962389+0000", 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011691700000000001 2024-09-12T22:10:20.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962449+0000", 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9188999999999999e-05 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967044+0000", 2024-09-12T22:10:20.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045949880000000004 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967084+0000", 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0318999999999998e-05 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:20.112 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.057392635999999, 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004830399, 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8700000000000001e-07 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962297+0000", 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2252999999999999e-05 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962304+0000", 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962309+0000", 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0320000000000003e-06 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00067960500000000001 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963008+0000", 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8924e-05 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967089+0000", 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040809399999999999 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967115+0000", 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6298000000000001e-05 2024-09-12T22:10:20.116 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.057223700000002, 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046231019999999996, 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962458+0000", 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.002e-06 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962559+0000", 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101159 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962596+0000", 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.718e-05 2024-09-12T22:10:20.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962793+0000", 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019661599999999999 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962811+0000", 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8447000000000001e-05 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:20.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004205627 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967077+0000", 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9772000000000003e-05 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:20.121 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:20.123 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:20.123 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:20.122+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:20.213 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:10:20.223 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:20.222+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:20.237 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:20.238 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:20.238 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:20.238 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:20.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:20.325 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:20.324+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:20.350 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:20.350 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:20.350 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:20.350 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:20.350 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:20.359 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:20.425 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:20.424+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:20.463 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.645017727999999, 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.638035271, 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.504145332, 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.504086019999999, 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.504054107999998, 2024-09-12T22:10:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.504021980000001, 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.503976587, 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.503931619999999, 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.503895422999999, 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.503864253, 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.503838524999999, 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:20.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.498547685999998, 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:20.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:20.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.497197511, 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:20.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.496482385, 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.496310896000001, 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:20.539 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:20.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:20.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.490715573999999, 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:20.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:20.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:20.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:20.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:20.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:20.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:20.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:20.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:20.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.550 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.490626476999999, 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:20.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:20.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.508903237999998, 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:20.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:20.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:20.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.5068633420000008, 2024-09-12T22:10:20.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:20.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:20.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.506145192, 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:20.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:20.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:20.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:20.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:20.577 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:20.579 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:20.580 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:20.578+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:20.680 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:20.679+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:20.694 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:20.695 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:20.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:20.781 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:20.781+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:20.808 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:20.808 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:20.808 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:20.808 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:20.808 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:20.817 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:20.882 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:20.882+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:20.885 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:20.922 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.636357996999998, 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:20.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.251336932999997, 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.929 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:20.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:20.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:20.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.962171089000002, 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:20.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.941 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.962115088000001, 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:20.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:20.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.962082470999999, 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:20.948 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:20.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:20.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.954 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.962055802999998, 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:20.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:20.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961986589999999, 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:20.961 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:20.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:20.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.967 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961940061, 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:20.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:20.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961910982999999, 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:20.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:20.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.980 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961885025000001, 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:20.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:20.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961841343, 2024-09-12T22:10:20.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:20.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:20.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:20.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:20.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:20.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:20.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:20.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:20.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:20.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:20.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:20.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:20.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:20.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:20.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961813770999999, 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.000 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:21.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:21.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:21.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:21.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:21.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:21.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:21.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:21.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:21.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:21.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:21.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:21.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.011 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961776587999999, 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:21.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:21.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:21.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:21.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:21.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:21.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:21.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:21.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:21.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:21.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.022 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961729962, 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:21.023 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.024 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.024 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.024 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:21.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:21.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:21.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:21.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:21.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:21.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:21.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:21.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:21.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:21.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:21.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:21.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:21.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:21.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:21.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.034 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961688388999999, 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.035 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:21.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:21.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:21.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:21.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:21.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:21.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:21.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:21.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:21.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:21.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:21.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:21.046 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961628069, 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:21.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:21.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:21.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:21.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:21.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:21.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:21.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:21.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:21.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.057 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961585694, 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:21.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:21.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:21.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:21.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.064 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961551781000001, 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:21.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:21.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961519411000001, 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:21.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:21.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:21.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.077 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.961477238000001, 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:21.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:21.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:21.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:21.082 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:21.083 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:21.084 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:21.085 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:21.086 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:21.086 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:21.087 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:21.088 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:21.083+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:21.185 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:21.185+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:21.204 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:21.204 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:21.213 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:21.286 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:21.286+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:21.317 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:21.317 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:21.326 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:21.387 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:21.386+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:21.430 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:21.430 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:21.440 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:21.488 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:21.487+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:21.555 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:21.555 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:21.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:21.589 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:21.588+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:21.667 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:21.668 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:21.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:21.689 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:21.689+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:21.779 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:21.780 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:21.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:21.791 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:21.789+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:21.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:10:21.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:10:21.882 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-12T22:10:21.882 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T22:10:21.882 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T22:10:21.882 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-12T22:10:21.897 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:21.897 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:21.898 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:21.896+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:21.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:21.988 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:21.988 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T22:10:21.988 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:21.992 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:21.992+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:22.052 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.052 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:22.093 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:22.093+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:22.164 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.165 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.173 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:22.194 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:22.193+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:22.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:10:22.285 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.285 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.294 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:22.296 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:22.295+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:22.396 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:22.395+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:22.399 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.399 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.408 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:22.497 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:22.496+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:22.551 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.552 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:22.597 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:22.596+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.684 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:22.697 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:22.697+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:22.799 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:22.798+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:22.900 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:22.899+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:22.900 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:22.900 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:22.909 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:23.000 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:22.999+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:23.019 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:23.020 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:23.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:23.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:23.102 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:23.101+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:23.172 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:23.172 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:23.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:23.203 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:23.202+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:23.217 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:23.217 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:23.223 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:10:23.238 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:23.255 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:23.256 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:23.287 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:23.287 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:23.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:23.287 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:23.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.001518822000001, 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.616497758000001, 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327331913999998, 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327275913000001, 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327243295999999, 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327216628000002, 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327147414999999, 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327100885999997, 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327071807999999, 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327045849999998, 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.327002168, 2024-09-12T22:10:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326974595999999, 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326937413000003, 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326890787000004, 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326849213999999, 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326788894000003, 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326746518999997, 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326712606000001, 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326680236000001, 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:23.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:23.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.326638062999997, 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:23.416 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:23.417 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:23.418 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:23.416+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:23.518 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:23.517+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:23.525 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:23.525 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:23.525 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-12T22:10:23.525 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:23.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:23.619 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:23.618+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:23.637 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-12T22:10:23.637 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-12T22:10:23.637 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:23.647 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:23.720 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:23.719+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:23.752 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:23.752 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-12T22:10:23.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-12T22:10:23.752 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-12T22:10:23.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.752 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 42.601236868000001, 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056684099999999996, 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149053+0000", 2024-09-12T22:10:23.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8380000000000004e-06 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149060+0000", 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.092e-06 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149064+0000", 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9199999999999997e-06 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149094+0000", 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9960000000000001e-05 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149108+0000", 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4229e-05 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154682+0000", 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005574313 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154717+0000", 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4619999999999997e-05 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'87)", 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 42.600717359999997, 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051784550000000002, 2024-09-12T22:10:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149569+0000", 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149630+0000", 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1387e-05 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149638+0000", 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5870000000000004e-06 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149641+0000", 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149672+0000", 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0533000000000001e-05 2024-09-12T22:10:23.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149683+0000", 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1589e-05 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154719+0000", 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050359139999999998 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154747+0000", 2024-09-12T22:10:23.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7361000000000001e-05 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 42.600136067999998, 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046234479999999996, 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150150+0000", 2024-09-12T22:10:23.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3799999999999997e-07 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150155+0000", 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.656e-06 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150165+0000", 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0674e-05 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150170+0000", 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6739999999999996e-06 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150204+0000", 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4279000000000002e-05 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150218+0000", 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3301e-05 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154748+0000", 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045300269999999998 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154773+0000", 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5199e-05 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.766 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 42.305638238, 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055762709999999998, 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444648+0000", 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444713+0000", 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5523000000000003e-05 2024-09-12T22:10:23.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444721+0000", 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3150000000000003e-06 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444726+0000", 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444763+0000", 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7836000000000002e-05 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444776+0000", 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2801e-05 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450190+0000", 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0054141800000000002 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450224+0000", 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3160000000000001e-05 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:180 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'130, mlcod=10'125)", 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 42.304943301999998, 2024-09-12T22:10:23.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051388110000000001, 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:23.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445343+0000", 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445347+0000", 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2400000000000001e-06 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445357+0000", 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.91e-06 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445361+0000", 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447533+0000", 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021720350000000001 2024-09-12T22:10:23.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447546+0000", 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2461e-05 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450459+0000", 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029135670000000002 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450481+0000", 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1569999999999998e-05 2024-09-12T22:10:23.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'126)", 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 42.304398816000003, 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046082930000000003, 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445888+0000", 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5099999999999999e-06 2024-09-12T22:10:23.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445898+0000", 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0139999999999999e-05 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445924+0000", 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5233e-05 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445936+0000", 2024-09-12T22:10:23.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1960000000000001e-05 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447745+0000", 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018097390000000001 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447757+0000", 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.145e-05 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450482+0000", 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027252930000000002 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450495+0000", 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2968e-05 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.780 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 42.080742669000003, 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053037229999999998, 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:23.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5400000000000002e-07 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669602+0000", 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8372000000000003e-05 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669610+0000", 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9570000000000002e-06 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669614+0000", 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1799999999999998e-06 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669639+0000", 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5559e-05 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669651+0000", 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1572e-05 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674822+0000", 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051706929999999996 2024-09-12T22:10:23.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674847+0000", 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4936e-05 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.792091141999997, 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061352830000000001, 2024-09-12T22:10:23.785 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958195+0000", 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2899999999999999e-07 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958204+0000", 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5300000000000002e-06 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958224+0000", 2024-09-12T22:10:23.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:10:23.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958241+0000", 2024-09-12T22:10:23.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6574000000000001e-05 2024-09-12T22:10:23.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958326+0000", 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5526999999999996e-05 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964330+0000", 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060033889999999996 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.791884648, 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013942721999999999, 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2897999999999999e-05 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958421+0000", 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4019999999999996e-06 2024-09-12T22:10:23.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958434+0000", 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2425999999999999e-05 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958445+0000", 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1063999999999999e-05 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962479+0000", 2024-09-12T22:10:23.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040343549999999999 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962774+0000", 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029505999999999998 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962946+0000", 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000171495 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:23.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967061+0000", 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0041158369999999998 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972243+0000", 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051817770000000003 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972291+0000", 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7797000000000003e-05 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972344+0000", 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2611000000000002e-05 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.796 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.796 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:23.796 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.791819208, 2024-09-12T22:10:23.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014018879999999999, 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958467+0000", 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958481+0000", 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4049999999999999e-05 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3788000000000001e-05 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958502+0000", 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0820000000000001e-06 2024-09-12T22:10:23.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963718+0000", 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052157330000000002 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963797+0000", 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8894999999999996e-05 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963912+0000", 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115408 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967755+0000", 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038428450000000001 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972392+0000", 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046365540000000002 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972439+0000", 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7221000000000001e-05 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972485+0000", 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6483999999999997e-05 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.7917725, 2024-09-12T22:10:23.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013933348999999999, 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958514+0000", 2024-09-12T22:10:23.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.37e-07 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958518+0000", 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9040000000000002e-06 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958526+0000", 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7970000000000006e-06 2024-09-12T22:10:23.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8464e-05 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963700+0000", 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051047130000000003 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963786+0000", 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6839e-05 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963908+0000", 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012141099999999999 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.808 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967748+0000", 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038402990000000001 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972354+0000", 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046053960000000003 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972403+0000", 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9598000000000002e-05 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972446+0000", 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3191e-05 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.791664091999998, 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01398747, 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:23.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958622+0000", 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:10:23.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958628+0000", 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7690000000000002e-06 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958989+0000", 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000360639 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.813 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959021+0000", 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2175000000000003e-05 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964221+0000", 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052003379999999997 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964306+0000", 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4939999999999997e-05 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964432+0000", 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012610400000000001 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967768+0000", 2024-09-12T22:10:23.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033359459999999998 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972501+0000", 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047327589999999996 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972555+0000", 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4435000000000003e-05 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972609+0000", 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3591000000000002e-05 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:23.817 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.790355063, 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011590303, 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959932+0000", 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2440000000000001e-06 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959938+0000", 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.528e-06 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959954+0000", 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5883e-05 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959963+0000", 2024-09-12T22:10:23.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4190000000000002e-06 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960178+0000", 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021503399999999999 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op must wait for map", 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960184+0000", 2024-09-12T22:10:23.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9660000000000001e-06 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962999+0000", 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028151610000000001 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963125+0000", 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012594200000000001 2024-09-12T22:10:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963238+0000", 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112866 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967067+0000", 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003829673 2024-09-12T22:10:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971152+0000", 2024-09-12T22:10:23.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040845760000000004 2024-09-12T22:10:23.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971476+0000", 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032402800000000002 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971521+0000", 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4982999999999999e-05 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.790177063000002, 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012104059, 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960109+0000", 2024-09-12T22:10:23.827 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.16e-07 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960115+0000", 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0209999999999996e-06 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960162+0000", 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7012999999999999e-05 2024-09-12T22:10:23.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960233+0000", 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0489999999999998e-05 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963739+0000", 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035056879999999999 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.829 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963795+0000", 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6274999999999999e-05 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963924+0000", 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012943000000000001 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.830 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967683+0000", 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037590010000000001 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971944+0000", 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042611330000000003 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972096+0000", 2024-09-12T22:10:23.831 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015156499999999999 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972213+0000", 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116527 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.832 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.790029525999998, 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012377496, 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960257+0000", 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6899999999999996e-07 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.834 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960264+0000", 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960274+0000", 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0036e-05 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.835 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960282+0000", 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964601+0000", 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004319051 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964672+0000", 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0648000000000005e-05 2024-09-12T22:10:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964758+0000", 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5881e-05 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971455+0000", 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066973750000000002 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.837 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972530+0000", 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001074684 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972582+0000", 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1601999999999998e-05 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.838 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972634+0000", 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1903000000000001e-05 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.789992505000001, 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081337059999999992, 2024-09-12T22:10:23.839 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960294+0000", 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8100000000000002e-07 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960297+0000", 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9459999999999998e-06 2024-09-12T22:10:23.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960305+0000", 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7690000000000002e-06 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960312+0000", 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8390000000000001e-06 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.842 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960372+0000", 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9635000000000001e-05 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960545+0000", 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017338499999999999 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.843 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.968427+0000", 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078814509999999994 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.789957305999998, 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075124349999999996, 2024-09-12T22:10:23.844 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.845 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960329+0000", 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960339+0000", 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0282000000000001e-05 2024-09-12T22:10:23.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960349+0000", 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0226e-05 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960357+0000", 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.847 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961038+0000", 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068101499999999998 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961157+0000", 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119157 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.848 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967841+0000", 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066831770000000002 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:23.849 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.788035608999998, 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048339589999999997, 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.850 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9499999999999998e-07 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.851 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962257+0000", 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.178e-06 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962264+0000", 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.852 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962272+0000", 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1559999999999995e-06 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962389+0000", 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011691700000000001 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962449+0000", 2024-09-12T22:10:23.853 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9188999999999999e-05 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967044+0000", 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045949880000000004 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967084+0000", 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0318999999999998e-05 2024-09-12T22:10:23.854 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.788000897000003, 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004830399, 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.855 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8700000000000001e-07 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962297+0000", 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2252999999999999e-05 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.857 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962304+0000", 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962309+0000", 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0320000000000003e-06 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.858 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:23.860 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00067960500000000001 2024-09-12T22:10:23.860 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.860 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.860 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.860 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963008+0000", 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8924e-05 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967089+0000", 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040809399999999999 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.861 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967115+0000", 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6298000000000001e-05 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:23.862 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 32.787831961000002, 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046231019999999996, 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.864 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962458+0000", 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.002e-06 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962559+0000", 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101159 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962596+0000", 2024-09-12T22:10:23.865 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.718e-05 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962793+0000", 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019661599999999999 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962811+0000", 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8447000000000001e-05 2024-09-12T22:10:23.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004205627 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967077+0000", 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9772000000000003e-05 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.867 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.868 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.868 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:23.868 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:23.868 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:23.870 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:23.871 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:23.869+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:23.970 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:23.969+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:23.980 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:23.980 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:23.980 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:23.980 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:23.989 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:24.074 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:24.073+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:24.134 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:24.134 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:24.134 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:24.134 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:24.134 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:24.142 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:24.172 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:24.171+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:24.273 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:24.272+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:24.287 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.469065010000001, 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.462082553000002, 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.328192614000002, 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.328133301999998, 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.32810139, 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.328069262, 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.328023868999999, 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.327978901999998, 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.327942704999998, 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.327911534999998, 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:24.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.327885807000001, 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:24.342 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:24.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:24.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:24.346 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.322594967999997, 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.321244792999998, 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:24.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.320529667000002, 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:24.356 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:24.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.359 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.320358177999999, 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:24.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.364 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.314762856000002, 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:24.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:24.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.314673759000001, 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:24.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.332950520000001, 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.375 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:24.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.380 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.330910623999999, 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:24.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:24.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.386 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.3301924740000004, 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:24.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:24.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:24.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.392 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:24.393 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:24.393 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:24.394 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:24.395 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:24.393+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:24.495 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:24.494+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:24.500 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:24.501 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:24.501 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:24.501 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:24.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:24.595 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:24.595+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:24.653 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:24.653 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:24.653 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:24.653 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:24.653 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:24.662 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:24.696 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:24.696+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:24.769 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:24.769 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:24.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:24.769 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:24.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.769 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:24.769 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.483016110999998, 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:24.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:24.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.097995046999998, 2024-09-12T22:10:24.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:24.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:24.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:24.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808829203000002, 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808773201999998, 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:24.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:24.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:24.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808740585000002, 2024-09-12T22:10:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808713916999999, 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808644704000002, 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808598175, 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808569097000003, 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808543139000001, 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:24.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:24.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808499457000003, 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:24.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808471885000003, 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:24.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:24.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808434702, 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.847 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:24.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:24.853 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808388076, 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:24.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:24.859 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808346503000003, 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.865 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808286183, 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808243808, 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808209894999997, 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808177524999998, 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.808135352000001, 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:24.896 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:24.898 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:24.899 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:24.897+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:24.998 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:24.998+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:25.014 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:25.014 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:25.014 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-09-12T22:10:25.014 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:25.024 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:25.100 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:25.099+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:25.167 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:25.168 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-09-12T22:10:25.168 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-09-12T22:10:25.168 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-09-12T22:10:25.168 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:25.176 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:25.201 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:25.200+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:25.240 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:10:25.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:136 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'94, mlcod=10'86)", 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 44.131133034000001, 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056684099999999996, 2024-09-12T22:10:25.282 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149049+0000", 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149053+0000", 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8380000000000004e-06 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149060+0000", 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.092e-06 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149064+0000", 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9199999999999997e-06 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149094+0000", 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9960000000000001e-05 2024-09-12T22:10:25.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149108+0000", 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4229e-05 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154682+0000", 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005574313 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.286 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154717+0000", 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4619999999999997e-05 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'87)", 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 44.130613525999998, 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051784550000000002, 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.287 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149568+0000", 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149569+0000", 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149630+0000", 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1387e-05 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149638+0000", 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5870000000000004e-06 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149641+0000", 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149672+0000", 2024-09-12T22:10:25.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0533000000000001e-05 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.149683+0000", 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1589e-05 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154719+0000", 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050359139999999998 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154747+0000", 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7361000000000001e-05 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'87)", 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 44.130032233999998, 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046234479999999996, 2024-09-12T22:10:25.294 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150149+0000", 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150150+0000", 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3799999999999997e-07 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150155+0000", 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.656e-06 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150165+0000", 2024-09-12T22:10:25.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0674e-05 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150170+0000", 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6739999999999996e-06 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150204+0000", 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4279000000000002e-05 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.150218+0000", 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3301e-05 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154748+0000", 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045300269999999998 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.154773+0000", 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5199e-05 2024-09-12T22:10:25.298 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:179 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'129, mlcod=10'125)", 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.835534404000001, 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055762709999999998, 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444647+0000", 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444648+0000", 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4700000000000002e-07 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444713+0000", 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5523000000000003e-05 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444721+0000", 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3150000000000003e-06 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.301 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444726+0000", 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0089999999999998e-06 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444763+0000", 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7836000000000002e-05 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.444776+0000", 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2801e-05 2024-09-12T22:10:25.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450190+0000", 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0054141800000000002 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450224+0000", 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3160000000000001e-05 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:180 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'130, mlcod=10'125)", 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.834839467999998, 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051388110000000001, 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445342+0000", 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445343+0000", 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0500000000000003e-07 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445347+0000", 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2400000000000001e-06 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445357+0000", 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.91e-06 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445361+0000", 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447533+0000", 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021720350000000001 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447546+0000", 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2461e-05 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450459+0000", 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029135670000000002 2024-09-12T22:10:25.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450481+0000", 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1569999999999998e-05 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'126)", 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.834294982000003, 2024-09-12T22:10:25.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046082930000000003, 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445887+0000", 2024-09-12T22:10:25.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445888+0000", 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5099999999999999e-06 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445898+0000", 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0139999999999999e-05 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445924+0000", 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5233e-05 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.445936+0000", 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1960000000000001e-05 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447745+0000", 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018097390000000001 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.447757+0000", 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.145e-05 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450482+0000", 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027252930000000002 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.450495+0000", 2024-09-12T22:10:25.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2968e-05 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.610638835000003, 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053037229999999998, 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.313 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669543+0000", 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5400000000000002e-07 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669602+0000", 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8372000000000003e-05 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669610+0000", 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9570000000000002e-06 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669614+0000", 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1799999999999998e-06 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669639+0000", 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.5559e-05 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.669651+0000", 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1572e-05 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674822+0000", 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051706929999999996 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:41.674847+0000", 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4936e-05 2024-09-12T22:10:25.317 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.321987307999997, 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0061352830000000001, 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-09-12T22:10:25.318 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958194+0000", 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958195+0000", 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2899999999999999e-07 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958204+0000", 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5300000000000002e-06 2024-09-12T22:10:25.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958224+0000", 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958241+0000", 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6574000000000001e-05 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958326+0000", 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5526999999999996e-05 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964330+0000", 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060033889999999996 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:25.322 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.321780814, 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013942721999999999, 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958401+0000", 2024-09-12T22:10:25.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2897999999999999e-05 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958421+0000", 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4019999999999996e-06 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958434+0000", 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2425999999999999e-05 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958445+0000", 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1063999999999999e-05 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962479+0000", 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040343549999999999 2024-09-12T22:10:25.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962774+0000", 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00029505999999999998 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962946+0000", 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000171495 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:25.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967061+0000", 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0041158369999999998 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972243+0000", 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051817770000000003 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972291+0000", 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7797000000000003e-05 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972344+0000", 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2611000000000002e-05 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.321715374, 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014018879999999999, 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.328 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958467+0000", 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958481+0000", 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4049999999999999e-05 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3788000000000001e-05 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958502+0000", 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0820000000000001e-06 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963718+0000", 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052157330000000002 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963797+0000", 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8894999999999996e-05 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963912+0000", 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000115408 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967755+0000", 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038428450000000001 2024-09-12T22:10:25.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972392+0000", 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046365540000000002 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972439+0000", 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7221000000000001e-05 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972485+0000", 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6483999999999997e-05 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.321668666000001, 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013933348999999999, 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958513+0000", 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958514+0000", 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.37e-07 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958518+0000", 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9040000000000002e-06 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958526+0000", 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7970000000000006e-06 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8464e-05 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963700+0000", 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051047130000000003 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963786+0000", 2024-09-12T22:10:25.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.6839e-05 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963908+0000", 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012141099999999999 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967748+0000", 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0038402990000000001 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:25.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972354+0000", 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046053960000000003 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972403+0000", 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9598000000000002e-05 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972446+0000", 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3191e-05 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.339 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.321560257999998, 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01398747, 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958621+0000", 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958622+0000", 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:10:25.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958628+0000", 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7690000000000002e-06 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.958989+0000", 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000360639 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959021+0000", 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2175000000000003e-05 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964221+0000", 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052003379999999997 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964306+0000", 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4939999999999997e-05 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964432+0000", 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012610400000000001 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967768+0000", 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033359459999999998 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972501+0000", 2024-09-12T22:10:25.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047327589999999996 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972555+0000", 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4435000000000003e-05 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972609+0000", 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3591000000000002e-05 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.320251229, 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011590303, 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:25.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959930+0000", 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959932+0000", 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2440000000000001e-06 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959938+0000", 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.528e-06 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959954+0000", 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5883e-05 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.959963+0000", 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.4190000000000002e-06 2024-09-12T22:10:25.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960178+0000", 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021503399999999999 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op must wait for map", 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960184+0000", 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9660000000000001e-06 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962999+0000", 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028151610000000001 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963125+0000", 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012594200000000001 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963238+0000", 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112866 2024-09-12T22:10:25.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967067+0000", 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003829673 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971152+0000", 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040845760000000004 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971476+0000", 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00032402800000000002 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971521+0000", 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4982999999999999e-05 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.352 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.320073229000002, 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012104059, 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960108+0000", 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960109+0000", 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.16e-07 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960115+0000", 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0209999999999996e-06 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960162+0000", 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7012999999999999e-05 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960233+0000", 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0489999999999998e-05 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963739+0000", 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035056879999999999 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963795+0000", 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6274999999999999e-05 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963924+0000", 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012943000000000001 2024-09-12T22:10:25.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967683+0000", 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0037590010000000001 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971944+0000", 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042611330000000003 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972096+0000", 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015156499999999999 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972213+0000", 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116527 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.358 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.319925691999998, 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012377496, 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960256+0000", 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960257+0000", 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6899999999999996e-07 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960264+0000", 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4510000000000003e-06 2024-09-12T22:10:25.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960274+0000", 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0036e-05 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960282+0000", 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8960000000000003e-06 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964601+0000", 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004319051 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964672+0000", 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0648000000000005e-05 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.964758+0000", 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5881e-05 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.362 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.971455+0000", 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066973750000000002 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972530+0000", 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001074684 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972582+0000", 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1601999999999998e-05 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.363 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.972634+0000", 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1903000000000001e-05 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.319888671000001, 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081337059999999992, 2024-09-12T22:10:25.364 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960293+0000", 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.365 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960294+0000", 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8100000000000002e-07 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960297+0000", 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9459999999999998e-06 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960305+0000", 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7690000000000002e-06 2024-09-12T22:10:25.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960312+0000", 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8390000000000001e-06 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960372+0000", 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9635000000000001e-05 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960545+0000", 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017338499999999999 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.968427+0000", 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078814509999999994 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:25.368 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.319853471999998, 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075124349999999996, 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960328+0000", 2024-09-12T22:10:25.369 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960329+0000", 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6700000000000003e-07 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960339+0000", 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0282000000000001e-05 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.370 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960349+0000", 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0226e-05 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.960357+0000", 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.011e-06 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961038+0000", 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068101499999999998 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.371 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.961157+0000", 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119157 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967841+0000", 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066831770000000002 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.372 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.317931774999998, 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0048339589999999997, 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962250+0000", 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9499999999999998e-07 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962257+0000", 2024-09-12T22:10:25.374 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.178e-06 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962264+0000", 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8169999999999999e-06 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962272+0000", 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1559999999999995e-06 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.375 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962389+0000", 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011691700000000001 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962449+0000", 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9188999999999999e-05 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967044+0000", 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045949880000000004 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.376 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967084+0000", 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0318999999999998e-05 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.317897062999997, 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004830399, 2024-09-12T22:10:25.377 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962285+0000", 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8700000000000001e-07 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962297+0000", 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2252999999999999e-05 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962304+0000", 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9600000000000003e-06 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962309+0000", 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0320000000000003e-06 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00067960500000000001 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.380 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.963008+0000", 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8924e-05 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967089+0000", 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040809399999999999 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967115+0000", 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6298000000000001e-05 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.381 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:18 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 34.317728127000002, 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0046231019999999996, 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:10:25.382 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962454+0000", 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.383 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962458+0000", 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.002e-06 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962559+0000", 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000101159 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962596+0000", 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.718e-05 2024-09-12T22:10:25.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962793+0000", 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019661599999999999 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.962811+0000", 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8447000000000001e-05 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:25.385 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004205627 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:09:50.967077+0000", 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9772000000000003e-05 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:10:25.386 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:10:25.388 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:25.387+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:25.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:25.489 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:25.488+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:25.504 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:25.504 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:25.504 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:25.504 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:25.512 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:25.512 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:25.513 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:25.530 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:25.530 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:25.547 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:25.590 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:25.589+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:25.616 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:25.616 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:25.626 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:25.691 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:25.690+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:25.730 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:25.730 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:25.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:25.792 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:25.791+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:25.854 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:25.854 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:25.864 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:25.892 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:25.891+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:25.967 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:25.968 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:25.976 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:26.020 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:26.018+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:26.080 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.081 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.089 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:10:26.094 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:26.093+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:26.195 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:26.194+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:26.196 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.196 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.205 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:10:26.232 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:10:26.297 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:26.295+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:26.308 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.308 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.318 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:10:26.397 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:26.397+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:26.422 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.422 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.431 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:26.498 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:26.498+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:26.537 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.538 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.546 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:26.599 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:26.598+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:26.649 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.649 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.658 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:26.699 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:10:26.698+0000 7fd088073640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30680) UID: 0 2024-09-12T22:10:26.800 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:26.798+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:26.801 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.801 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:26.901 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:26.899+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:26.917 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:26.917 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:26.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:26.998 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:10:26.998 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:10:26.998 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-09-12T22:10:26.998 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:10:26.999 INFO:teuthology.orchestra.console.smithi164:Power off 2024-09-12T22:10:26.999 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-12T22:10:27.011 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:27.009+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:27.024 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-09-12T22:10:27.070 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:27.071 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:27.080 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:27.110 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:27.109+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:27.211 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:27.209+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:27.224 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:27.224 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:27.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:27.312 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:27.311+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:27.338 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:27.338 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:27.347 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:27.413 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:27.412+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:27.450 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:27.450 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:27.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:27.513 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:27.512+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:27.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:27.602 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:27.602 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:27.610 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:27.655 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:27.653+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:27.684 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:27.685 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:27.704 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:27.704 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:27.714 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:27.713+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:27.715 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:27.716 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:27.716 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:27.716 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:27.721 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:27.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:27.816 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:27.814+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:27.868 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:27.868 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:27.868 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:27.869 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:27.869 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:27.877 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:27.918 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:27.916+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:28.017 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.017+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.025 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.739405849999997, 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.026 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:28.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:28.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:28.032 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.354384785999997, 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:28.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:28.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:28.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:28.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.065218942000001, 2024-09-12T22:10:28.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:28.039 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.039 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.039 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.039 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:28.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:28.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:28.046 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.065162940999997, 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:28.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:28.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:28.052 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.065130324000002, 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.053 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:28.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:28.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.059 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.065103655999998, 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:28.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:28.065 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.065034443000002, 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.066 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:28.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.072 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064987914, 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:28.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:28.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.079 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064958836000002, 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:28.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:28.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.086 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064932878, 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.087 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:28.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:28.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064889196000003, 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:28.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064861624000002, 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064824440999999, 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064777814999999, 2024-09-12T22:10:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064736242000002, 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064675921999999, 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064633547, 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064599633999997, 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064567263999997, 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.064525091, 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:28.156 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:28.157 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.156+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.158 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:28.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:10:28.257 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.256+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.262 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:28.263 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:28.263 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:28.263 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:28.271 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:28.358 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.357+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.413 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:28.414 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:28.414 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:28.414 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:28.414 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:28.423 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:28.459 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:28.457+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:28.559 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.558+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.567 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.749530608999997, 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:28.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.572 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.742548151999998, 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:28.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:28.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.577 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608658212999998, 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:28.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:28.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:28.583 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608598901000001, 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:28.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608566989000003, 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.589 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:28.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608534861000003, 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:28.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608489468000002, 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:28.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:28.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608444501000001, 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:28.606 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:28.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:28.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:28.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:28.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:28.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608408304000001, 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:28.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608377134000001, 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:28.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.608351405999997, 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:28.621 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:28.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:28.625 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.603060567, 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:28.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:28.629 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.601710392000001, 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:28.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:28.634 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.600995265999998, 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.600823777000002, 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:28.638 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:28.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:28.642 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.595228454999997, 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:28.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.595139357999997, 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.613416119, 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:28.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.611376223000001, 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.610658073, 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:28.670 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:28.672 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:28.672 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.671+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.772 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.771+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.786 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:28.786 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:28.786 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:28.786 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:28.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:28.872 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.872+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:28.899 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:28.899 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:28.899 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:28.899 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:28.899 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:28.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:28.973 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:28.973+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:29.013 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:29.013 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:29.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:29.013 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:29.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.727269728000003, 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.014 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:29.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:29.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:29.020 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.342248664000003, 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:29.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.05308282, 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:29.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:29.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.033 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.053026819000003, 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:29.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:29.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.040 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052994202000001, 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:29.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:29.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052967533999997, 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:29.047 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:29.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052898321000001, 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.054 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:29.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.060 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052851791999998, 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:29.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:29.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:29.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052822714000001, 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:29.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052796755999999, 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:29.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052753074000002, 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:29.080 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:29.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:29.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:29.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052725502000001, 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:29.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:29.093 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052688318999998, 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:29.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:29.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:29.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052641692999998, 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:29.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:29.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052600120000001, 2024-09-12T22:10:29.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:29.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052539799999998, 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:29.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:29.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:29.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052497424999999, 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:29.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:29.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052463512000003, 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:29.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.131 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052431142000003, 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:29.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:29.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:29.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.138 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.052388968999999, 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:29.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:29.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:29.143 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:29.145 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:29.145 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:29.143+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:29.240 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:10:29.246 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:29.244+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:29.253 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:29.253 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:29.253 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:29.253 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:29.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:29.346 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:29.344+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:29.404 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:29.405 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:29.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:29.446 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:29.445+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:29.516 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.698426882, 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.691444425, 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557554486000001, 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557495174000003, 2024-09-12T22:10:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557463261999999, 2024-09-12T22:10:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557431133999998, 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557385740999997, 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557340773999996, 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:29.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557304576999996, 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:29.566 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:29.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:29.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:29.570 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557273406999997, 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:29.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.574 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.557247679, 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:29.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.551956840000003, 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:29.579 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:29.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:29.583 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.550606664999997, 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:29.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.549891539000001, 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:29.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.549720049999998, 2024-09-12T22:10:29.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:29.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:29.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.544124728, 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:29.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:29.604 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.544035631, 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:29.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.562312392000003, 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.560272496, 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:29.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:29.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:29.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.559554346000001, 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:29.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:29.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:29.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:29.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:29.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:29.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.626 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:29.626 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:29.626 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:29.628 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:29.628 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:29.627+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:29.728 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:29.728+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:29.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:29.734 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:29.734 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:29.734 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:29.734 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:29.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:29.829 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:29.828+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:29.845 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:29.846 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:29.846 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:29.846 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:29.846 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:29.854 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:29.859 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:29.859 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:29.877 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:29.897 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:10:29.898 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:10:29.929 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:29.929+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:29.957 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:29.957 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:29.966 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:30.031 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:30.030+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:30.071 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.071 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.080 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:30.164 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:30.163+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:30.222 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.222 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:30.233 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:30.231+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:30.333 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:30.331+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:30.374 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.375 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.383 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:30.434 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:30.434+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:30.491 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.492 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.500 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:30.544 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:30.542+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:30.604 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.604 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:30.635 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:30.635+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:30.736 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:30.735+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:30.758 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.758 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:30.837 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:30.835+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:30.871 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.871 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:30.937 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:30.936+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:30.983 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:30.983 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:30.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:31.026 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:10:31.039 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:31.037+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:31.095 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.095 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.104 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:31.137 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-09-12T22:10:31.139 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:31.138+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:31.210 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.210 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.219 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:31.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:10:31.262 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:31.260+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:31.325 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.325 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.334 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:31.375 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:31.373+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:31.441 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:31.440+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:31.477 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.477 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.486 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:31.542 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:31.540+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:31.590 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.590 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:31.643 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:31.641+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:31.701 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.702 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:31.751 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:31.749+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:31.845 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:31.843+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:31.852 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.852 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.861 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:31.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:31.946 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:31.945+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:31.965 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:31.974 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:32.037 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:32.038 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:32.047 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:32.045+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:32.056 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:32.057 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:32.057 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:32.059 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:32.060 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:32.078 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:32.078 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:32.078 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:32.078 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:32.078 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:32.087 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:32.147 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:32.145+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:32.233 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.947501868000003, 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:32.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:32.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.562480804000003, 2024-09-12T22:10:32.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:32.241 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.241 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.241 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.241 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:32.241 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:32.241 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:32.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.27331496, 2024-09-12T22:10:32.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:32.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:32.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.273258959000003, 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.254 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:32.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:32.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:32.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.273226342000001, 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.261 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:32.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.273199673999997, 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:32.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:32.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.273130461000001, 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:32.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.280 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.273083931999999, 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:32.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.273054854000002, 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:32.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:32.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.273028896, 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:32.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:32.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:32.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:32.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:32.300 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272985214000002, 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:32.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:32.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272957642000001, 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:32.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272920458999998, 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.313 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:32.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:32.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.319 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272873832999998, 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:32.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272832260000001, 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:32.326 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:32.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:32.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:32.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:32.332 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272771939999998, 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:32.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:32.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.338 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272729564999999, 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:32.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:32.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:32.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272695652000003, 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.345 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:32.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:32.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272663282000003, 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:32.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.272621108999999, 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:32.358 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:32.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:32.362 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.363 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.363 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.363 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:32.363 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:32.363 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:10:32.365 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:32.366 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:32.362+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:32.465 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:32.463+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:32.468 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:32.468 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:32.468 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:32.469 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:32.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:32.566 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:32.564+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:32.620 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:32.620 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:32.628 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:32.667 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:32.666+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:32.732 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:32.732 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.914363706000003, 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:32.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:32.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:32.737 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.907381248999997, 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:32.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:32.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.742 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773491309999997, 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:32.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:32.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:32.748 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773431998, 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:32.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:32.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773400086000002, 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:32.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.759 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773367958000001, 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:32.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:32.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:32.765 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773322565000001, 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:32.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:32.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773277598, 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:32.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773241401, 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:32.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:32.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773210231, 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:32.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.784 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.773184503000003, 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.767893663999999, 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.766543489, 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:32.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.765828362999997, 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.797 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.765656874000001, 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:32.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.760061552000003, 2024-09-12T22:10:32.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.809 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.759972455000003, 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:32.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.778249215999999, 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:32.814 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:32.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:32.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.77620932, 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.775491169999999, 2024-09-12T22:10:32.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:32.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:32.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:32.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:32.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:32.831 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:32.833 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:32.833 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:32.831+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:32.934 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:32.932+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:32.947 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:32.947 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:32.948 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:32.948 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:32.957 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:33.042 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:33.040+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:33.101 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:33.101 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:33.101 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:33.101 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:33.102 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:33.111 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:33.152 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:33.150+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:33.237 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:33.235+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.970104966999997, 2024-09-12T22:10:33.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:33.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.262 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.585083902999997, 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:33.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:33.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.268 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295918059000002, 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295862057999997, 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:33.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:33.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:33.282 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295829441000002, 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.283 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:33.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:33.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:33.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295802772999998, 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.290 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:33.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:33.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.296 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295733560000002, 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:33.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:33.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295687031, 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:33.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295657953000003, 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:33.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:33.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:33.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295631995000001, 2024-09-12T22:10:33.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:33.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:33.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295588313000003, 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:33.323 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:33.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:33.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295560741000003, 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:33.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:33.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295523557999999, 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:33.336 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:33.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:33.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:33.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295476932, 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.343 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:33.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:33.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295435359000003, 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:33.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:33.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295375039, 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:33.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:33.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:33.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295332664, 2024-09-12T22:10:33.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:33.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:33.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:33.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295298750999997, 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:33.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:33.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:33.374 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295266380999998, 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:33.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.381 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.295224208, 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:33.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:33.386 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:33.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:33.388 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:33.386+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:33.489 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:33.488+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:33.493 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:33.493 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:33.493 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:33.493 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:33.502 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:33.590 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:33.588+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:33.603 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:33.603 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:33.603 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:33.603 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:33.603 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:33.611 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:33.695 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:33.693+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:33.757 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.938480705000003, 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.931498247999997, 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.797608308999997, 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:33.767 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:33.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.797548997, 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:33.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:33.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.797517085000003, 2024-09-12T22:10:33.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:33.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.797484957000002, 2024-09-12T22:10:33.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:33.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:33.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:33.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.797439564000001, 2024-09-12T22:10:33.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:33.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:33.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.797394597, 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.797 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:33.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:33.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.7973584, 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:33.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:33.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.79732723, 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:33.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.797301502000003, 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:33.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.792010662999999, 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:33.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:33.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.790660488, 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:33.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:33.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.789945361999997, 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:33.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.829 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.789773873000001, 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:33.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:33.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.834 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.784178550999997, 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:33.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.784089453999997, 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:33.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:33.844 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.802366214999999, 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:33.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.800326319, 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:33.850 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:33.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:33.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.799608168999999, 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:33.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:33.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:33.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:33.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:33.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:33.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:33.863 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:33.864 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:33.862+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:33.964 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:33.962+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:33.976 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:33.977 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:33.986 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:34.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:34.064 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:34.063+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:34.088 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:34.089 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:34.089 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:34.089 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:34.089 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:34.097 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:34.165 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:34.163+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:34.194 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:34.202 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:34.202 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:34.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:34.202 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:34.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.202 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.916455992000003, 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:34.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.531434928000003, 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.209 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:34.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:34.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:34.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:34.215 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.242269084, 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:34.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:34.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:34.222 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.242213083000003, 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:34.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:34.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.242180466000001, 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:34.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:34.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:34.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.237 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.237 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.237 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.242153797999997, 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:34.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:34.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:34.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.242084585000001, 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.245 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:34.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:34.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.242038055999998, 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.252 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:34.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:34.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:34.258 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.242008978000001, 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:34.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:34.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241983019999999, 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.265 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:34.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:34.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241939338000002, 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.272 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:34.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:34.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241911766000001, 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:34.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:34.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:34.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:34.285 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241874582999998, 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:34.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:34.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:34.292 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241827956999998, 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:34.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:34.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:34.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241786384000001, 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:34.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:34.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241726063999998, 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.307 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:34.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241683688999998, 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:34.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:34.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:34.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241649776000003, 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:34.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:34.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:34.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241617406000003, 2024-09-12T22:10:34.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:34.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.241575232999999, 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:34.334 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:34.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:34.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:34.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:34.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:34.339 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.339 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.339 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.339 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:34.339 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:34.339 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:34.340 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:34.341 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:34.341 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:34.339+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:34.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:34.342 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:34.342 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:34.343 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:34.366 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:10:34.441 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:34.440+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:34.448 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:34.449 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:34.457 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:34.542 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:34.540+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:34.560 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:34.561 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:34.569 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:34.653 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:34.651+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:34.711 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:34.711 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:34.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:34.760 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:10:34.761 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:34.758+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:34.827 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:34.827 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:34.836 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:34.880 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:34.879+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:34.939 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:34.939 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:34.945 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:34.944+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:34.947 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:35.046 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:35.046+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:35.091 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.091 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:35.100 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:35.138 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:10:35.149 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:35.146+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:35.202 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.202 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:35.211 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:35.248 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-09-12T22:10:35.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T22:10:35.252 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:35.250+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:35.350 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:35.348+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:35.353 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.354 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:35.362 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:35.451 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:35.449+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:35.506 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.506 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:35.515 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:35.559 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:35.558+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:35.619 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.619 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:35.627 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:35.669 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:35.668+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:35.754 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:35.752+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:35.771 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.772 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:35.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:35.855 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:35.853+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:35.885 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.886 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:35.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:35.955 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:35.954+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:35.998 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:35.998 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:36.007 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:36.056 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:36.054+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:36.108 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:36.108 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:36.117 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:36.157 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:36.156+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:36.258 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:36.257+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:36.260 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:36.260 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:36.269 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:36.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:36.359 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:36.358+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:36.376 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:36.376 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:36.384 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:36.460 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:36.458+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:36.474 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:36.474 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:36.493 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:36.494 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:36.497 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:36.498 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:36.529 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:36.529 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:36.529 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:36.529 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:36.529 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:36.542 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:36.562 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:36.560+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.361651502000001, 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.648 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:36.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:36.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 54.976630438000001, 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:36.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:36.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.661 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.661 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:36.661 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687464593999998, 2024-09-12T22:10:36.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:36.661 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.662 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.662 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:36.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:36.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:36.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:36.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:36.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:36.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:36.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:36.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:36.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:36.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:36.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:36.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:36.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.671 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687408593000001, 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:36.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:36.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:36.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:36.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:36.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687375975999998, 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:36.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:36.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:36.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687349308000002, 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.686 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:36.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:36.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.692 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687280094999998, 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:36.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687233566000003, 2024-09-12T22:10:36.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:36.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:36.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:36.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687204487999999, 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:36.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:36.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:36.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:36.712 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687178529999997, 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:36.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:36.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:36.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687134847999999, 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:36.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:36.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:36.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:36.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:36.725 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687107275999999, 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:36.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:36.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:36.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687070093000003, 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:36.732 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:36.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:36.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:36.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:36.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:36.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:36.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:36.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:36.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:36.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:36.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:36.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:36.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.741 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.742 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:36.742 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.687023467000003, 2024-09-12T22:10:36.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:36.742 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.742 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.742 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:36.748 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.686981893999999, 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:36.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:36.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:36.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:36.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:36.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:36.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:36.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:36.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:36.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.757 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.757 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.757 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.686921574000003, 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:36.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:36.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.686879199000003, 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:36.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.686845286, 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:36.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:36.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:36.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:36.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:36.778 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.686812916000001, 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:36.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:36.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:36.786 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 45.686770742999997, 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:36.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:36.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:36.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:36.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:36.792 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:36.793 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:10:36.794 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:36.792+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:36.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:36.894 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:36.893+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:36.898 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:36.898 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:36.898 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:36.899 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:36.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:36.995 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:36.994+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:37.009 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:37.009 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:37.009 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:37.009 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:37.009 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:37.018 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:37.096 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:37.094+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:37.123 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:37.123 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:37.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:37.123 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:37.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.304923846999998, 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:37.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:37.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:37.128 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.297941389999998, 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.164051450999999, 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:37.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:37.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163992139000001, 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:37.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163960226999997, 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:37.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.150 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163928099000003, 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:37.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163882706000003, 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:37.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:37.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163837739000002, 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163801542000002, 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:37.169 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:37.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.173 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163770372000002, 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.163744643999998, 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:37.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:37.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:37.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.183 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:37.183 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:37.183 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.158453805000001, 2024-09-12T22:10:37.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:37.183 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.183 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.184 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:37.184 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:37.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:37.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:37.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:37.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:37.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:37.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:37.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:37.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:37.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:37.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:37.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:37.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:37.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:37.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.191 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:37.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:37.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.157103630000002, 2024-09-12T22:10:37.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:37.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.193 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:37.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:37.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:37.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:37.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:37.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:37.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:37.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:37.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:37.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:37.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:37.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:37.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:37.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:37.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:37.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:37.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.202 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.202 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:37.202 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:37.203 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.156388503999999, 2024-09-12T22:10:37.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:37.203 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:37.203 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:37.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:37.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:37.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:37.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:37.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:37.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:37.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.156217015000003, 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:37.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.150621692999998, 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:37.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.150532595999998, 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.168809357000001, 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:37.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.166769461000001, 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.166051311, 2024-09-12T22:10:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:37.251 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:37.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:37.254 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:37.251+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:10:37.353 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:37.352+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:37.360 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:37.360 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:37.360 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:37.360 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:37.369 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:37.457 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:37.453+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:37.472 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:37.473 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:37.473 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:37.473 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:37.473 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:37.481 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:37.555 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:37.554+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:37.587 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:37.587 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:37.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:37.587 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:37.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.587 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.301026039, 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:37.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:37.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.916004975, 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.594 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:37.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:37.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626839130999997, 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:37.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.62678313, 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:37.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:37.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.612 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626750512999998, 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:37.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:37.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626723845000001, 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:37.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:37.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.626 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626654631999997, 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:37.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:37.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:37.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:37.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:37.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626608103000002, 2024-09-12T22:10:37.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:37.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:37.642 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626579024999998, 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626553067000003, 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.650 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:37.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:37.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626509384999999, 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:37.657 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:37.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626481812999998, 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:37.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:37.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626444630000002, 2024-09-12T22:10:37.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:37.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626398004000002, 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.678 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:37.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:37.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.684 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626356430999998, 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:37.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:37.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:37.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626296111000002, 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:37.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:37.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:37.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626253736000002, 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:37.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:37.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626219823, 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:37.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:37.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:37.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.712 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626187453, 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:37.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:37.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:37.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.626145280000003, 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:37.719 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:37.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:37.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:37.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:37.724 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:37.726 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:37.726 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:37.724+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:37.827 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:37.826+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:37.935 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:37.936 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:37.936 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:37.936 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:37.936 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:37.936 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:37.934+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:38.036 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:38.035+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:38.079 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:38.079 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:38.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:38.136 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:38.134+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:38.191 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.373527777, 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:38.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:38.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.36654532, 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.197 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:38.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:38.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232655381000001, 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:38.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:38.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232596069000003, 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:38.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:38.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:38.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.213 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232564156999999, 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:38.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232532028999998, 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:38.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:38.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232486635999997, 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:38.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:38.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232441669000004, 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:38.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:38.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232405472000003, 2024-09-12T22:10:38.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232374301999997, 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:38.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:38.244 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.232348574, 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:38.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.227057735000002, 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:38.249 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:38.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:38.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:38.253 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.225707559999996, 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:38.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:38.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.224992434000001, 2024-09-12T22:10:38.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:38.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:38.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:38.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.224820944999998, 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:38.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:38.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.219225623, 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:38.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.219136526, 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.272 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:38.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.237413287000003, 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:38.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.235373391, 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:38.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.234655240999999, 2024-09-12T22:10:38.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:38.294 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:38.295 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:38.296 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:38.294+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:38.396 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:38.395+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:38.403 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:38.403 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:38.403 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:38.403 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:38.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:38.497 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:38.496+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:38.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:38.515 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:38.516 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:38.516 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:38.516 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:38.516 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:38.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:38.598 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:38.597+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:38.625 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:38.644 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:38.645 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:38.645 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:38.648 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:38.648 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:38.670 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:38.670 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:38.679 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:38.699 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:38.698+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:38.783 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:38.783 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:38.793 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:38.799 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:38.799+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:38.896 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:38.896 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:38.900 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:38.899+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:38.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:39.001 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.000+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.008 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.008 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.017 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:39.102 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.101+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.120 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.121 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:39.203 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.202+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.234 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.234 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.243 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:39.250 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:10:39.282 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:10:39.304 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:39.303+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:39.346 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.346 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:39.363 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-09-12T22:10:39.363 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-09-12T22:10:39.405 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.403+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.459 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.460 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.469 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:39.506 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:39.505+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:39.607 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.606+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.611 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.611 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.620 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:39.708 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.707+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.762 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.763 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.771 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:39.812 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.811+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.876 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.877 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.885 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:39.909 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:39.908+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:39.988 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:39.988 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:39.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:40.040 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:40.039+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:40.099 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:40.099 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:40.108 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:40.149 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:40.148+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:40.211 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:40.211 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:40.212 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:40.210+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:40.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:40.280 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:10:40.312 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:40.311+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:40.323 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:40.323 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:40.332 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:40.413 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:40.412+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:40.475 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:40.475 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:40.485 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:40.529 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:40.528+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:40.588 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:40.588 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:40.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:40.638 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:40.637+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:40.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:40.717 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:40.716+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:40.740 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:40.741 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:40.750 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:40.790 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:40.790 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:40.817 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:40.817+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:40.822 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:40.822 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:40.822 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:40.826 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:40.827 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:40.857 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.570949616, 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:40.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.863 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.185928552, 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:40.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:40.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.869 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896762707999997, 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:40.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:40.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:40.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.876 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896706707, 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.882 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896674089999998, 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:40.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:40.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:40.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896647422000001, 2024-09-12T22:10:40.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:40.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:40.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:40.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896578208999998, 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:40.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896531680000002, 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.902 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:40.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:40.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:40.908 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896502601999998, 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:40.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:40.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.914 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896476644000003, 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:40.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:40.921 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896432961999999, 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:40.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:40.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896405389999998, 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:40.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:40.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896368207000002, 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:40.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:40.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:40.940 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896321581000002, 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:40.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:40.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.946 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896280007999998, 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:40.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.953 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896219688000002, 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:40.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:40.959 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896177313000003, 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:40.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:40.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:40.966 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.8961434, 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:40.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:40.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:40.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.89611103, 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:40.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:40.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.896068857000003, 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:40.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:40.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:40.984 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:40.984 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:40.985 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:40.986 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:40.984+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:41.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-09-12T22:10:41.086 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:41.085+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:41.088 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:41.088 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:41.097 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:41.187 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:41.186+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:41.239 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:41.240 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:41.248 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:41.290 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:41.289+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:41.389 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:41.388+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.575776224000002, 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.568793767000003, 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434903828000003, 2024-09-12T22:10:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434844515999998, 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434812604000001, 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434780476, 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434735083, 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434690115999999, 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434653918999999, 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434622748999999, 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.434597021000002, 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.429306181999998, 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.427956006999999, 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.427240881000003, 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.427069392, 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.421474070000002, 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 50.421384973000002, 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.439661733999998, 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.437621837999998, 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.436903688000001, 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:41.504 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:41.505 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:41.504+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:41.506 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:41.606 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:41.605+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:41.616 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:41.616 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:41.616 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:41.616 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:41.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:41.707 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:41.706+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:41.729 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:41.729 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:41.729 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:41.729 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:41.729 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:41.737 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:41.809 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:41.808+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:41.843 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:41.843 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:41.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.557333984000003, 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:41.844 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:41.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:41.849 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.172312920000003, 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:41.850 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:41.851 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:41.851 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:41.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.851 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:41.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:41.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:41.860 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.883147076, 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:41.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:41.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:41.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.883091075000003, 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:41.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:41.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.883058458000001, 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.874 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:41.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:41.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.883031789999997, 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.881 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:41.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:41.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882962577000001, 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:41.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:41.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:41.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:41.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882916047999998, 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882886970000001, 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.902 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:41.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:41.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.908 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882861011999999, 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:41.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:41.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882817330000002, 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:41.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:41.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:41.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882789758000001, 2024-09-12T22:10:41.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:41.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:41.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:41.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882752574999998, 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.928 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:41.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:41.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:41.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.934 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882705948999998, 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:41.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:41.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882664376000001, 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:41.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:41.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:41.947 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882604055999998, 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:41.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.953 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882561680999999, 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.954 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:41.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:41.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.960 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882527768000003, 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:41.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:41.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882495398000003, 2024-09-12T22:10:41.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:41.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:41.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.882453224999999, 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:41.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:41.978 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:41.980 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:41.979+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:41.980 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:42.081 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:42.080+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:42.088 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:42.088 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:42.089 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:42.089 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:42.098 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:42.182 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:42.181+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:42.200 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:42.200 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:42.200 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:42.200 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:42.200 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:42.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:42.284 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:42.283+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:42.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:10:42.313 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.495489706000001, 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.314 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:42.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:42.318 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.488507249000001, 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.319 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:42.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354617310000002, 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:42.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:42.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:42.330 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354557997999997, 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:42.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:42.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:42.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354526086, 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:42.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354493957999999, 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:42.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:42.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.348 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354448564999998, 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.349 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:42.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:42.354 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354403597999998, 2024-09-12T22:10:42.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:42.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354367400999998, 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354336230999998, 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:42.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:42.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.354310503000001, 2024-09-12T22:10:42.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:42.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:42.374 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.349019663999997, 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:42.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:42.378 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.347669488999998, 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:42.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:42.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.346954363000002, 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:42.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.386 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.346782873999999, 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:42.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:42.391 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.341187552000001, 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:42.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.341098455000001, 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:42.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:42.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.359375215999997, 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:42.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.406 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.357335320000001, 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:42.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.35661717, 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:42.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:42.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:42.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:42.418 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:42.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:42.420 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:42.418+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:42.521 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:42.520+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:42.529 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:42.529 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:42.530 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:42.530 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:42.539 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:42.622 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:42.621+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:42.683 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:42.683 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:42.683 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:42.683 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:42.683 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:42.692 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:42.722 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:42.721+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.511872152999999, 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:42.798 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:42.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:42.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:42.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.804 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.126851088999999, 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:42.805 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:42.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:42.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837685245000003, 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.811 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837629243999999, 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.818 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:42.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:42.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:42.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837596627000003, 2024-09-12T22:10:42.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:42.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:42.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837569959, 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.832 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:42.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:42.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:42.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837500746000003, 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:42.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:42.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837454217000001, 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:42.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:42.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:42.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:42.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837425138999997, 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:42.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:42.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.859 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837399181000002, 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:42.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:42.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837355498999997, 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:42.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837327926999997, 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:42.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:42.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837290744000001, 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:42.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:42.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:42.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:42.888 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837244118000001, 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:42.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:42.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:42.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:42.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837202544999997, 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:42.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:42.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837142225000001, 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:42.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:42.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.909 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837099850000001, 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:42.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.915 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837065936999998, 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:42.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:42.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:42.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.837033566999999, 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:42.923 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:42.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:42.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.836991394000002, 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:42.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:42.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:42.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:42.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:42.936 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.937 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.937 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.937 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:42.937 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:42.937 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:42.938 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:42.940 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:42.937+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:42.941 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:43.041 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:43.040+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:43.045 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:43.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:43.046 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:43.046 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:43.054 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:43.064 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:43.065 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:43.090 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:43.093 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:43.094 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:43.143 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:43.141+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:43.156 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.156 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:43.244 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:43.243+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:43.269 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.269 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.278 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:43.287 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:10:43.345 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:43.343+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:43.385 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.385 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.394 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:43.445 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:43.444+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:43.498 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.498 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.506 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:43.546 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:43.545+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:43.610 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.610 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:43.663 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:43.662+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:43.724 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.724 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:43.774 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:43.773+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:43.849 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:43.848+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:43.874 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.875 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.884 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:43.950 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:43.949+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:43.985 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:43.985 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:43.994 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:44.050 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:44.049+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:44.099 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:44.099 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:44.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:44.151 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:44.150+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:44.252 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:44.251+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:44.253 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:44.253 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:44.262 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:44.353 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:44.351+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:44.365 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:44.365 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:44.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:44.454 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:44.453+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:44.465 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-12T22:10:44.465 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:10:44.465 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-12T22:10:44.465 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T22:10:44.466 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T22:10:44.466 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-12T22:10:44.477 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:44.477 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:44.486 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:44.568 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "" 2024-09-12T22:10:44.569 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:44.571 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:44.569+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:44.628 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:44.628 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:44.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:44.679 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:44.678+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:44.757 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:44.756+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:44.780 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:44.780 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:44.790 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:44.858 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:44.857+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:44.895 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:44.896 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:44.904 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:44.959 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:44.958+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:45.048 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:45.048 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:45.057 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:45.060 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.059+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:45.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:45.160 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:45.160 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:45.161 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.159+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:45.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:45.236 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:45.254 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:45.254 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:45.254 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:45.257 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:45.258 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:45.261 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.260+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:45.274 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:45.274 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:45.274 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:45.274 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:45.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:45.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:10:45.361 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:45.360+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:45.385 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:45.386 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:45.386 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:45.386 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:45.386 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:45.395 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:45.462 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.462+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:45.538 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.720130505999997, 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.539 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:45.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.713148048999997, 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:45.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:45.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:45.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.551 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.579258109999998, 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.579198798, 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:45.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.579166886000003, 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:45.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:45.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.579134758000002, 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:45.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:45.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:45.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.579089365000002, 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:45.575 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:45.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.579044398000001, 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:45.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:45.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.586 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.579008201000001, 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.578977031000001, 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:45.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:45.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.578951302999997, 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:45.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.573660464, 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:45.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:45.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.572310289000001, 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:45.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.571595162999998, 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:45.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:45.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.571423674000002, 2024-09-12T22:10:45.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:45.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:45.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:45.618 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.565828351999997, 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.565739254999997, 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.623 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.584016016, 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:45.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:45.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:45.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:45.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.633 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.58197612, 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:45.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:45.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:45.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.581257969999999, 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:45.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:45.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:45.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:45.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:45.646 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:45.648 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:45.648 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.646+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:45.748 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.747+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:45.756 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:45.756 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:45.757 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:45.757 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:45.765 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:45.849 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.848+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:45.908 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:45.908 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:45.909 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:45.909 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:45.909 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:45.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:45.959 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:45.958+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:46.050 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:46.049+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:46.064 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.778571392999993, 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.393550328999993, 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104384484999997, 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104328484, 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104295866999998, 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104269199000001, 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104199985999998, 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104153457000002, 2024-09-12T22:10:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104124378999998, 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104098421000003, 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104054738999999, 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.104027166999998, 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103989984000002, 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103943358000002, 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103901784999998, 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103841465000002, 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103799090000003, 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103765177, 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:46.176 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:46.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:46.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:46.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103732807, 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:46.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:46.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:46.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.103690634000003, 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:46.189 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:46.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:46.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:46.194 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:46.196 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:46.196 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:46.194+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:46.298 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:46.296+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:46.298 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:10:46.302 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:46.302 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:46.311 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:46.398 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:46.397+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:46.455 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:46.455 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:46.456 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:46.456 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:46.456 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:46.464 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:46.498 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:46.497+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:46.599 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:46.598+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.789867931000003, 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:46.608 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:46.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:46.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.782885473999997, 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:46.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648995534999997, 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:46.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:46.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:46.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648936223, 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:46.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648904311000003, 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:46.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:46.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:46.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648872183000002, 2024-09-12T22:10:46.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:46.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:46.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648826790000001, 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.641 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:46.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:46.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648781823, 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:46.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:46.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:46.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:46.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:46.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:46.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:46.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:46.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:46.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:46.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:46.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:46.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:46.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:46.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.655 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.656 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.656 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:46.656 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648745626, 2024-09-12T22:10:46.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:46.656 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.657 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:46.657 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:46.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:46.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:46.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648714456, 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:46.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:46.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.648688728000003, 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:46.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.643397888999999, 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.642047714, 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.674 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:46.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.678 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.641332587999997, 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.682 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.641161099000001, 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:46.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.635565776999997, 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:46.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:46.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:46.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:46.692 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.635476679999996, 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:46.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.653753440999999, 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.697 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:46.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:46.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.651713545, 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:46.703 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:46.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.650995394999999, 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:46.709 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:46.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:46.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:46.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:46.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:46.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:46.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:46.715 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:46.717 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:46.717 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:46.715+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:46.817 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:46.817+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:46.823 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:46.823 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:46.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:46.919 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:46.918+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:46.976 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:46.976 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:46.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:47.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-09-12T22:10:47.020 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:47.019+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:47.121 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:47.120+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:47.130 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.844739828000002, 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.131 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:47.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:47.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.459718764000002, 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.137 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:47.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170552919999999, 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.143 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:47.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:47.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:47.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170496919000001, 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:47.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:47.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:47.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:47.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170464301999999, 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.156 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:47.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:47.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:47.162 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170437634000002, 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:47.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:47.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:47.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170368420999999, 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:47.169 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:47.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:47.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.175 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170321891999997, 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:47.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:47.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:47.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170292814, 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:47.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:47.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170266855999998, 2024-09-12T22:10:47.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:47.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:47.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:47.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170223174, 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:47.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.201 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170195602, 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:47.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170158419000003, 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:47.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:47.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170111792999997, 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:47.214 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:47.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:47.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:47.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170070219999999, 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:47.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.227 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.170009899999997, 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:47.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:47.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.169967524999997, 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:47.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:47.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:47.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.169933612000001, 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:47.240 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:47.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.246 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.169901242000002, 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:47.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:47.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:47.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.169859068999997, 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:47.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.257 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:47.258 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:47.258 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:47.259 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:47.258+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:47.259 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:47.260 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:47.360 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:47.359+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:47.366 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:47.366 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:47.375 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:47.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:47.410 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:47.411 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:47.411 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:47.414 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:47.415 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:47.461 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:47.460+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:47.477 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:47.477 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:47.486 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:47.561 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:47.561+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:47.588 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:47.588 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:47.601 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:47.663 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:47.662+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:47.706 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:47.706 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:47.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:47.764 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:47.762+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:47.859 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:47.859 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:47.864 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:47.863+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:47.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:47.965 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:47.964+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:48.012 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.012 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.021 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:48.065 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:48.065+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:48.125 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.125 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.133 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:48.177 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:48.176+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:48.236 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.236 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:48.286 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:48.285+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:48.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:10:48.367 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:48.366+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:48.389 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.389 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.398 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:48.468 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:48.467+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:48.503 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.504 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.512 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:48.596 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:48.595+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:48.656 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.656 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:48.706 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:48.705+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:48.770 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:48.770+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:48.808 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.808 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:48.872 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:48.871+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:48.922 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:48.922 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:48.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:48.973 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:48.971+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:49.073 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:49.074 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:49.074 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:49.073+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:49.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:49.174 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:49.173+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:49.185 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:49.185 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:49.194 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:49.275 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:49.274+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:49.300 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:49.301 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:49.306 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:10:49.310 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:49.375 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:49.374+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:49.413 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:49.413 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:49.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:49.422 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:49.507 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:49.506+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:49.558 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:49.558 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:49.566 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:49.566 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:49.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:49.576 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:49.575+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:49.577 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-12T22:10:49.578 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:10:49.578 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-12T22:10:49.578 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:10:49.578 INFO:teuthology.orchestra.console.smithi164:Power on 2024-09-12T22:10:49.578 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-12T22:10:49.590 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:49.591 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:49.591 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:49.593 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:49.594 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:49.604 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-09-12T22:10:49.678 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:49.678 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:49.678 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:49.678 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:49.679 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:49.677+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:49.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:49.778 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:49.777+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:49.830 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:49.831 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:49.831 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:49.831 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:49.831 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:49.839 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:49.879 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:49.878+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:49.980 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:49.979+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.166289606000007, 2024-09-12T22:10:49.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:49.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:49.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:49.990 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.159307149, 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:49.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:49.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:49.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025417210000001, 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:49.995 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:49.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:49.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:50.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:50.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025357898000003, 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:50.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:50.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.007 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025325985999999, 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:50.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025293857999998, 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:50.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025248464999997, 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.019 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:50.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:50.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025203498000003, 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.025 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:50.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:50.030 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025167301000003, 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:50.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.035 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025136130999996, 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:50.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:50.039 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.025110402999999, 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:50.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.019819564000002, 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:50.044 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.048 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.018469389000003, 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:50.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:50.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.017754263, 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.017582773999997, 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.011987452, 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.011898355, 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:50.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.030175116000002, 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:50.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:50.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.028135220000003, 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:50.076 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:50.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:50.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.027417069999998, 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:50.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:50.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.088 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:50.089 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:50.090 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:50.088+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:50.190 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:50.189+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:50.195 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:50.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:50.292 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:50.291+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:50.306 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:50.307 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:50.307 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:50.307 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:50.307 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:50.316 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:50.401 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:50.400+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:50.462 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:50.463 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:50.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:50.463 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:50.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.463 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:50.463 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:50.463 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.176431836999996, 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.464 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:50.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.791410772999996, 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:50.470 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:50.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.502244929, 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.476 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:50.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.502188928000002, 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:50.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.489 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.502156311, 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:50.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.502129643000004, 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:50.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:50.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.50206043, 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:50.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:50.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.502013900999998, 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:50.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:50.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:50.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:50.516 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501984823000001, 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:50.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501958864999999, 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:50.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:50.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.530 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501915183000001, 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:50.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501887611000001, 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:50.538 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:50.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501850427999997, 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.545 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:50.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.551 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501803801999998, 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:50.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:50.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:50.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501762229000001, 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:50.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:50.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:50.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:50.565 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501701908999998, 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:50.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:50.571 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501659533999998, 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:50.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:50.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501625621000002, 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:50.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:50.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:50.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501593251000003, 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:50.585 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:50.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:50.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:50.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.501551077999999, 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:50.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:50.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:50.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:50.598 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:50.600 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:50.599+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:50.600 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:50.700 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:50.699+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:50.708 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:50.708 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:50.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:50.801 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:50.800+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:50.820 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:50.821 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:50.829 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:50.903 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:50.902+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.115585459000002, 2024-09-12T22:10:50.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.938 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.108603002000002, 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:50.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.943 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974713063000003, 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:50.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974653750999998, 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:50.949 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974621839000001, 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:50.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.960 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.961 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.961 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.961 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974589711, 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:50.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.967 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974544318, 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:50.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:50.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974499350999999, 2024-09-12T22:10:50.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:50.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:50.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974463153999999, 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:50.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974431983999999, 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:50.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.974406256000002, 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:50.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.969115416999998, 2024-09-12T22:10:50.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:50.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.967765241999999, 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:50.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:50.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:50.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:50.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.967050116000003, 2024-09-12T22:10:51.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:51.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.966878627, 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.961283305000002, 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.013 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.961194208000002, 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:51.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.979470968999998, 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:51.018 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:51.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:51.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:51.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.977431072999998, 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:51.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:51.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:51.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.976712923000001, 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:51.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:51.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:51.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:51.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:51.035 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:51.037 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:51.037 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:51.035+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:51.138 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:51.137+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:51.152 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:51.152 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:51.152 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:51.152 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:51.162 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:51.240 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:51.239+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:51.306 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:51.306 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:51.306 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:51.306 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:51.306 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:51.316 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:51.323 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:10:51.360 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:51.359+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:51.423 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:51.423 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:51.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:51.424 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:51.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.424 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:51.424 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:51.424 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.136151509000001, 2024-09-12T22:10:51.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:51.425 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.425 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.425 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.426 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:51.426 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:51.427 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:51.427 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:51.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.427 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:51.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:51.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:51.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:51.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:51.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:51.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:51.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:51.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:51.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:51.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.434 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.434 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:51.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:51.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:51.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:51.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:51.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:51.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:51.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:51.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:51.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:51.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.440 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:51.441 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.751130445000001, 2024-09-12T22:10:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:51.442 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.445 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.448 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.449 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.450 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:51.452 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:51.454 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:51.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.454 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.454 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:51.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:51.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:51.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:51.456 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.456 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.456 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.457 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.457 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:51.457 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461964600999998, 2024-09-12T22:10:51.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:51.458 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.458 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.458 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.458 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:51.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.460 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.460 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:51.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:51.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:51.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:51.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:51.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:51.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:51.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.464 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.464 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:51.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:51.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:51.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:51.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:51.466 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:51.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:51.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:51.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:51.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:51.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:51.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:51.470 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461908600000001, 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:51.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:51.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461875982999999, 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:51.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461849315000002, 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:51.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:51.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:51.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:51.491 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461780101999999, 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.492 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:51.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:51.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:51.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:51.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:51.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.502 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461733572999997, 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:51.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.509 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461704494999999, 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:51.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:51.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:51.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:51.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:51.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:51.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:51.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:51.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:51.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:51.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:51.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:51.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:51.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:51.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:51.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:51.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:51.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:51.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:51.521 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.521 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.521 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.522 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.522 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:51.522 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461678536999997, 2024-09-12T22:10:51.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:51.522 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.523 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.523 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:51.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:51.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:51.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:51.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:51.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:51.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:51.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:51.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:51.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:51.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:51.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:51.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:51.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:51.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:51.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:51.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:51.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:51.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:51.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:51.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:51.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:51.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:51.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:51.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:51.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:51.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:51.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:51.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.537 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.538 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.538 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:51.538 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461634855, 2024-09-12T22:10:51.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:51.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:51.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:51.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461607282999999, 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.546 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:51.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:51.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461570100000003, 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:51.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:51.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:51.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.560 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461523474000003, 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:51.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:51.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:51.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:51.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:51.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461481900999999, 2024-09-12T22:10:51.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:51.569 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.569 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:51.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:51.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:51.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461421581000003, 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:51.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:51.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:51.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.584 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461379205999997, 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:51.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:51.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461345293000001, 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.592 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:51.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:51.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:51.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:51.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:51.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.600 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.601 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:51.601 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461312923000001, 2024-09-12T22:10:51.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:51.601 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.601 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:51.601 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:51.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:51.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.461270749999997, 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:51.608 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:51.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:51.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:51.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:51.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:51.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:51.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:51.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:51.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:51.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:51.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:51.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:51.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:51.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:51.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:51.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:51.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:51.617 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:51.617 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:51.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:51.619 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:51.617+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:51.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:51.719 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:51.718+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:51.729 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:51.729 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:51.729 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:51.729 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:51.738 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:51.811 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:51.812 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:51.820 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:51.819+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:51.840 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:51.841 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:51.844 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:51.844 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:51.844 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:51.849 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:51.850 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:51.851 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:51.921 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:51.920+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:51.954 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:51.954 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:51.962 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:52.022 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:52.021+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:52.067 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.067 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.076 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:52.123 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:52.122+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:52.179 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.179 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.188 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:52.224 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:52.223+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:52.321 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:10:52.324 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:52.323+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:52.333 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.333 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:52.425 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:52.424+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:52.446 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.447 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.455 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:52.526 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:52.525+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:52.598 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.598 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.606 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:52.650 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:52.649+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:52.709 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.709 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.717 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:52.759 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:52.758+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:52.821 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.822 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-09-12T22:10:52.828 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:52.827+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:52.830 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:52.929 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:52.928+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:52.975 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:52.975 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:52.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:53.029 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:53.028+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:53.128 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:53.128 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:53.130 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:53.129+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:53.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:53.231 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:53.230+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:53.243 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:53.243 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:53.251 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:53.337 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:53.336+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:53.395 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:53.396 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:53.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:53.445 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:53.444+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:53.534 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:53.533+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:53.546 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:53.546 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:53.555 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:53.604 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:10:53.635 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:53.634+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:53.660 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:53.660 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:53.670 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:53.716 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-09-12T22:10:53.736 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:53.735+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:53.773 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:53.773 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:53.781 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:53.837 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:53.836+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:53.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:53.885 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:53.885 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:53.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:53.938 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:53.937+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:53.999 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:54.000 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:54.003 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:54.003 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:54.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:54.035 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:54.035 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:54.035 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:54.040 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:54.039+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:54.041 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:54.041 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:54.141 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:54.140+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:54.152 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:54.153 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:54.160 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:54.242 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:54.241+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:54.306 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:54.306 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:54.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:54.306 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:54.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.306 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:54.306 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.487780276999999, 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:54.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.480797820000006, 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.311 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:54.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346907881, 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:54.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:54.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:54.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346848569000002, 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:54.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:54.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346816656999998, 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:54.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346784528999997, 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:54.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346739135999997, 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:54.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:54.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346694169000003, 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.352 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346657972000003, 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:54.353 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:54.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346626802000003, 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.358 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:54.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.346601073999999, 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:54.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:54.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:54.366 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.341310235000002, 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:54.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:54.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.339960060000003, 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:54.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:54.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.375 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.339244934, 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:54.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.379 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.339073444999997, 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:54.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.333478122999999, 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:54.384 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:54.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.333389025999999, 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.351665787000002, 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.349625891000002, 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:54.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:54.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.348907740999998, 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.405 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:54.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:54.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:54.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:54.410 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:54.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:10:54.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:54.413 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:54.411+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:54.513 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:54.512+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:54.519 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:54.519 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:54.520 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:54.520 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:54.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:54.614 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:54.612+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:54.633 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:54.633 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:54.633 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:54.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:54.715 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:54.714+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:54.747 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:54.747 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:54.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:54.747 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:54.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.747 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:54.747 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.461203444000006, 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:54.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.076182380000006, 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.754 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:54.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:54.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:54.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.787016536000003, 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:54.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:54.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:54.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:54.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786960534999999, 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:54.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786927918000004, 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:54.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.78690125, 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:54.781 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:54.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:54.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786832037000003, 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:54.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:54.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786785508000001, 2024-09-12T22:10:54.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:54.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:54.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:54.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786756429999997, 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.801 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786730472000002, 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:54.807 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:54.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:54.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786686789999997, 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.814 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:54.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786659217999997, 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:54.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:54.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:54.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:54.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786622035000001, 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.827 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:54.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:54.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786575409000001, 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:54.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:54.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:54.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786533835999997, 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:54.840 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:54.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.846 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786473516000001, 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:54.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:54.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:54.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786431141000001, 2024-09-12T22:10:54.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:54.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:54.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.859 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786397227999998, 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:54.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:54.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786364857999999, 2024-09-12T22:10:54.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:54.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:54.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.786322685000002, 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:54.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:54.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:54.878 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:54.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:54.880 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:54.878+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:54.981 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:54.980+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:54.987 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:54.988 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:54.988 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:54.988 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:54.997 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:55.081 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:55.080+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:55.101 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:55.101 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:55.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:55.195 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:55.194+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:55.255 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:55.255 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:55.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:55.255 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.437140432000007, 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:55.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:55.260 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.430157975, 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:55.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:55.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.296268036000001, 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.265 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:55.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.296208723999996, 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:55.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.296176811999999, 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:55.276 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:55.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:55.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.281 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.296144683999998, 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:55.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.287 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.296099291000004, 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:55.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:55.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:55.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.296054323999996, 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.293 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:55.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:55.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.298 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.296018126999996, 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:55.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:55.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.295986956999997, 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.303 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:55.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.307 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.295961229, 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:55.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:55.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.290670390000002, 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:55.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.289320215000004, 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:55.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.288605089000001, 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.320 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:55.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:55.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.288433600000005, 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.324 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:55.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.282838278, 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:55.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.282749181, 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:55.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.337 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.301025942000003, 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:55.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:55.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:55.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.298986046000003, 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:55.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:55.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.298267895999999, 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:55.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:55.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:55.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:55.355 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:55.357 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:10:55.358 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:55.358 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:55.355+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:55.457 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:55.456+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:55.461 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:55.461 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:55.461 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:55.462 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:55.471 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:55.558 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:55.557+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:55.574 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:55.574 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:55.583 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:55.667 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:55.666+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:55.729 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:55.730 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:55.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:55.730 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:55.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.730 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:55.730 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:55.730 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.443661137999996, 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:55.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.736 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.058640073999996, 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:55.737 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:55.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:55.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:55.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.76947423, 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.744 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:55.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:55.750 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769418228999996, 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:55.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:55.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769385611999994, 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:55.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:55.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:55.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:55.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:55.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:55.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769358944000004, 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.767 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:55.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.774 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.774 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:55.774 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769289731000001, 2024-09-12T22:10:55.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:55.775 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.775 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.775 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.775 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:55.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:55.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:55.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:55.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:55.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:55.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:55.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:55.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:55.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:55.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:55.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:55.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:55.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:55.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769243201999998, 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.785 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.788 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:55.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:55.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769214124000001, 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:55.794 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:55.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769188166000006, 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.801 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:55.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:55.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:55.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:55.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769144483999995, 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.809 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:55.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:55.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769116912000001, 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.816 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:55.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:55.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769079728999998, 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.823 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:55.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:55.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:55.830 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.769033102999998, 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:55.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:55.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.768991529999994, 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.837 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:55.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:55.844 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.768931210000005, 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:55.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.768888834999998, 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:55.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:55.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.858 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.768854922000003, 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:55.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:55.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.865 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.768822552000003, 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:55.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:55.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.872 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.768780379000006, 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:55.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:55.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:55.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:55.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:55.878 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:55.879 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:55.878+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:55.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:55.981 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:55.980+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:55.988 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:55.988 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:55.988 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:55.988 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:55.997 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:56.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:10:56.082 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:56.081+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:56.139 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:56.139 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:56.139 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:56.139 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:56.139 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:56.147 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:56.183 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:56.182+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:56.230 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:56.231 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:56.250 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:56.250 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:56.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:56.263 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:56.263 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:56.264 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:56.268 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:56.268 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:56.304 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:56.303+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:56.364 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:56.364 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:56.372 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:56.384 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:56.383+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:56.485 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:56.484+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:56.517 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:56.517 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:56.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:56.586 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:56.585+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:56.629 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:56.629 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:56.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:56.686 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:56.686+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:56.742 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:56.742 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:56.751 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:56.794 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:56.793+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:56.853 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:56.853 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:56.862 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:56.903 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:56.902+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:56.990 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:56.989+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:57.005 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.005 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:57.091 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:57.090+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:57.121 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.121 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:57.215 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:57.214+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:57.274 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.275 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.283 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:57.325 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:57.324+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:57.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:10:57.393 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:57.392+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:57.427 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.427 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.436 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:57.494 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:57.493+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:57.543 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.543 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:57.596 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:57.594+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:57.694 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.695 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.696 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:57.695+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:57.703 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:57.717 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:10:57.798 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:57.797+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:57.806 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.806 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:57.828 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-09-12T22:10:57.829 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-09-12T22:10:57.898 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:57.897+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:57.919 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:57.919 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:57.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:57.929 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-09-12T22:10:57.929 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-09-12T22:10:57.999 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:57.998+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:58.030 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:58.030 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:58.040 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:58.099 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:58.099+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:58.185 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:58.185 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:58.194 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:58.238 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:58.237+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:58.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:10:58.298 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:10:58.298 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:10:58.302 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:58.301+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:58.308 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:58.334 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:10:58.402 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:58.401+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:58.419 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:10:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:10:58.437 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:10:58.437 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:10:58.437 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:10:58.444 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:10:58.445 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:10:58.453 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:58.453 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:58.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:58.503 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:58.502+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:58.604 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:58.604+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:58.606 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:58.606 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:58.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:58.606 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.788073199999999, 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:58.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.781090742999993, 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:58.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:58.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.647200803999993, 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:58.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.622 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.647141492000003, 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:58.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:58.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.647109580000006, 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:58.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.647077452000005, 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:58.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:58.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.647032058999997, 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:58.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:58.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.646987092000003, 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:58.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.646950895000003, 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:58.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:58.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.646919725000004, 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:58.659 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:58.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:58.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.646893997000006, 2024-09-12T22:10:58.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:58.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:58.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.641603157999995, 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:58.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.671 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.640252982999996, 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:58.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.639537856999993, 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:58.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:58.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.680 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.639366367999997, 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:58.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.685 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.633771046000007, 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:58.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:58.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.633681949000007, 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:58.690 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.694 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.651958710000002, 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:58.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:58.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:58.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.649918814000003, 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:58.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:58.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:58.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.649200663999999, 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:58.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:58.712 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:58.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~23s 2024-09-12T22:10:58.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:58.715 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:58.713+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:58.814 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:58.813+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:58.820 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:58.820 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:58.820 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:58.820 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:58.829 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:58.916 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:58.915+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:58.931 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:58.932 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:58.940 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:59.017 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:59.016+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.759791036999999, 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:10:59.046 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:59.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:10:59.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:10:59.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.374769972999999, 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:10:59.053 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:59.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:10:59.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085604129000004, 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.060 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:10:59.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:10:59.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085548127999999, 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:59.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:10:59.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085515510999997, 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:10:59.073 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:10:59.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:10:59.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085488842999993, 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:10:59.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:10:59.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085419630000004, 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.086 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:10:59.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:10:59.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:10:59.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085373101000002, 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:10:59.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:10:59.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.099 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085344023000005, 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:10:59.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:10:59.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:10:59.105 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085318064999996, 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:10:59.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:10:59.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:10:59.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085274382999998, 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.112 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:10:59.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:10:59.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:10:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085246811000005, 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:10:59.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:10:59.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:10:59.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085209628000001, 2024-09-12T22:10:59.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:10:59.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:10:59.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.131 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085163002000002, 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:10:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085121428999997, 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:10:59.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:10:59.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:10:59.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:59.144 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085061108999994, 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:10:59.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:10:59.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:10:59.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.085018734000002, 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.151 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:10:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:59.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:10:59.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.084984821000006, 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:10:59.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:10:59.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.084952451000007, 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.164 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:10:59.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:10:59.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:10:59.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:10:59.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:10:59.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:10:59.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.084910277999995, 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:10:59.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:10:59.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:10:59.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.176 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.177 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.177 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:10:59.177 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:10:59.177 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:59.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:10:59.179 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:59.177+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:59.279 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:59.278+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:59.286 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:59.286 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:59.286 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:10:59.286 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:59.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:10:59.380 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:59.380+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:59.438 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:59.439 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:10:59.439 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:10:59.439 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:10:59.439 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:59.447 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:10:59.481 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:59.480+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:59.552 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:10:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:10:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:10:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:10:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.733924904999995, 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:10:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:10:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.726942448000003, 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:10:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:10:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.593052509000003, 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:10:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592993196999998, 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:10:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:10:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592961285000001, 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:10:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:10:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:10:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592929157, 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:10:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:10:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592883764000007, 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:10:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:10:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592838796999999, 2024-09-12T22:10:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:10:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:10:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592802599999999, 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:10:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:10:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592771429999999, 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.592745702000002, 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.587454863000005, 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:10:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:10:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.586104688000006, 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:10:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.585389562000003, 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:10:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:10:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.585218072999993, 2024-09-12T22:10:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:10:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.579622751000002, 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:10:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:10:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.579533654000002, 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:10:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.597810414999998, 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:10:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:10:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.595770518999998, 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:10:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.595052369000001, 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:10:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:10:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:10:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:10:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:10:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:10:59.651 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:10:59.652 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:59.651+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:59.653 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:10:59.753 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:59.752+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:10:59.757 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:59.757 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:10:59.758 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:59.767 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:10:59.854 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:10:59.853+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:10:59.871 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:10:59.871 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:10:59.871 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:10:59.871 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:10:59.871 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:10:59.880 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:10:59.955 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:10:59.955+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:00.025 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:00.025 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.739481349000002, 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:00.026 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:00.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:00.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:00.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:00.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:00.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.033 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.354460285000002, 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:00.034 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:00.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:00.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065294441000006, 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065238440000002, 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065205822999999, 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065179154999996, 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065109942000007, 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065063413000004, 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065034335000007, 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.065008376999998, 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064964695, 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064937123000007, 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064899940000004, 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064853314000004, 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064811741, 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064751420999997, 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064709046000004, 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064675132999994, 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064642762999995, 2024-09-12T22:11:00.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:00.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:00.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.064600589999998, 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:00.158 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:00.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:00.163 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:00.165 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:00.166 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:00.164+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:00.266 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:00.265+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:00.276 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:00.276 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:00.276 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:00.276 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:00.285 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:00.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:11:00.369 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:00.368+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:00.428 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:00.429 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:00.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:00.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:00.478 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:00.477+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:00.569 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:00.568+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:00.581 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.763210439000005, 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:11:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.756227981999999, 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622338042999999, 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:00.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622278730999994, 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:00.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:00.602 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622246818999997, 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:00.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:00.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.608 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622214690999996, 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:00.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622169298000003, 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:00.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622124330999995, 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:00.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:00.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622088133999995, 2024-09-12T22:11:00.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:00.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:00.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622056963999995, 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:00.631 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:00.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:00.635 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.622031235999998, 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:00.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.616740397000001, 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:11:00.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:11:00.643 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.615390222000002, 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.644 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:11:00.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.648 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.614675095999999, 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:11:00.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.614503607000003, 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.653 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:11:00.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.657 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.608908284999998, 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:11:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.662 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.608819187999998, 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:11:00.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.627095948999994, 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.667 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:11:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:11:00.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.625056053000002, 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.673 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:11:00.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:11:00.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.624337902999997, 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:11:00.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:11:00.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:00.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:00.685 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:00.686 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:00.685+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:00.686 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:00.687 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:00.688 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:00.688 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:00.689 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:00.787 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:00.786+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:00.796 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:00.796 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:00.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:00.889 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:00.888+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:00.948 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:00.948 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:00.957 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:00.988 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:00.987+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.089 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:01.088+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:01.101 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:01.101 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:01.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:01.190 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.189+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.219 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:01.219 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:01.228 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:01.312 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.311+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.355 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:11:01.371 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:01.372 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:01.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:01.421 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.420+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.493 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.492+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.522 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:01.522 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:01.531 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:01.594 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.593+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.636 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:01.636 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:01.645 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:01.695 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:01.694+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:01.749 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:01.749 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:01.758 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:01.796 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.795+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.897 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.896+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:01.900 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:01.900 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:01.909 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:01.998 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:01.997+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:02.012 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:02.012 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:02.021 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:02.105 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:02.104+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:02.163 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:02.163 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:02.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:02.213 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:02.212+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:02.301 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:02.300+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:02.316 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:02.316 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:02.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:02.402 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:02.401+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:02.430 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:02.431 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:02.439 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:02.524 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:02.523+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:02.583 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:02.583 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:02.592 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:02.604 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:02.603+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:02.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:02.704 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:02.703+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:02.735 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:02.735 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:02.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:02.805 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:02.805+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:02.848 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:02.848 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:02.857 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:02.885 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:02.885 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:02.906 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:02.905+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:02.916 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:02.917 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:02.920 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:02.920 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:02.960 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:02.960 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:02.960 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:02.960 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:02.960 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:02.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:03.010 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:03.009+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:03.109 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:03.108+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.295116089999993, 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:11:03.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.288133633000001, 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.118 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:11:03.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.154243694000002, 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:03.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.154184381999997, 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:03.128 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:03.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:03.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.15415247, 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:03.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:03.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.154120341999999, 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:03.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:03.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:03.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:03.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.146 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.154074949000005, 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:03.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:03.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:03.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:03.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.154029981999997, 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.155 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:03.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:03.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.161 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.153993784999997, 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:03.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:03.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:03.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:03.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:03.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:03.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.153962614999998, 2024-09-12T22:11:03.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:03.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:03.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.153936887, 2024-09-12T22:11:03.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:03.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.148646048000003, 2024-09-12T22:11:03.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:03.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:11:03.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.182 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:03.182 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:03.182 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.147295873000004, 2024-09-12T22:11:03.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:11:03.182 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:03.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:03.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:11:03.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:11:03.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:11:03.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.146580747000002, 2024-09-12T22:11:03.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:03.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.146409258000006, 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:11:03.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:11:03.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:11:03.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.140813936000001, 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:03.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.140724839000001, 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:11:03.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:11:03.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.159001599999996, 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:03.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:11:03.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:11:03.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.215 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.216 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:11:03.216 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:03.216 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.156961703999997, 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:11:03.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:11:03.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:11:03.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.156243554, 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:11:03.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:11:03.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:11:03.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:03.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:11:03.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:11:03.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:03.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:11:03.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:11:03.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:03.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:11:03.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:11:03.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:11:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:11:03.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:03.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:03.232 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:03.234 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:03.234 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:03.233+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:03.335 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:03.334+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:03.339 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:03.339 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:03.348 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:03.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:11:03.435 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:03.434+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:03.452 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:03.452 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:03.461 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:03.536 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:03.536+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.319960335999994, 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.934939271999994, 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645773427999998, 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645717426999994, 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645684810000006, 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645658142000002, 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645588928999999, 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645542399999997, 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645513321999999, 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645487364000005, 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645443682000007, 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645416109999999, 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645378926999996, 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.685 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:03.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:03.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645332300999996, 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:03.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645290728000006, 2024-09-12T22:11:03.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:03.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645230408000003, 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:03.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:03.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645188032999997, 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.711 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:03.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.717 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645154120000001, 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:03.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:03.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645121750000001, 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.724 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:03.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:03.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.645079577000004, 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:03.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:03.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:03.736 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:03.736 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:03.737 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:03.736+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:03.738 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:03.837 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:03.836+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:03.847 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:03.848 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:03.848 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:03.848 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:03.857 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:03.942 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:03.941+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:03.999 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:03.999 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:03.999 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:04.000 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:04.000 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:04.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:04.049 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:04.048+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:04.140 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:04.139+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:04.151 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:04.151 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:04.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:04.151 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:04.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.333180351999999, 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:04.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:11:04.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.156 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.326197895000007, 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:11:04.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192307955999993, 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:04.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:04.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192248644000003, 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:04.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:04.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:04.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.174 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192216732000006, 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:04.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:04.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192184604000005, 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.181 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:04.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:04.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192139210999997, 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:04.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:04.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:04.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192094244000003, 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:04.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:04.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:04.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192058047000003, 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:04.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192026877000004, 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:04.203 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:04.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:04.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.192001149000006, 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:04.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:04.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.186710309999995, 2024-09-12T22:11:04.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:11:04.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:04.216 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.185360134999996, 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:11:04.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.184645008999993, 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:11:04.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.225 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.184473519999997, 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:11:04.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:11:04.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:04.230 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.178878198000007, 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:04.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:11:04.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.178789101000007, 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:11:04.235 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:04.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:11:04.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.197065862000002, 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:11:04.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.245 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.195025966000003, 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:11:04.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:11:04.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.194307815999998, 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:04.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:11:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:04.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:04.257 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:04.259 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:04.258+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:04.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:04.359 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:04.359+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:04.363 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:11:04.368 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:04.368 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:04.368 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:04.368 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:04.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:04.460 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:04.459+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:04.480 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:04.480 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:04.489 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:04.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-09-12T22:11:04.573 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:04.572+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:04.634 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:04.634 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:04.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:04.634 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.348381459999999, 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:04.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:04.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.640 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.963360395999999, 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:04.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:04.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:04.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.674194552000003, 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:04.647 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:04.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:04.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:04.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.674138550999999, 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.654 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:04.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:04.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.660 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.674105933999996, 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:04.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:04.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.674079266000007, 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.667 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.674010053000003, 2024-09-12T22:11:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:04.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:04.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.680 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673963524000001, 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:04.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:04.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673934446000004, 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:04.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:04.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673908487999995, 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.694 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:04.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673864805999997, 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:04.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:04.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673837234000004, 2024-09-12T22:11:04.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:04.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:04.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:04.713 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673800051000001, 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:04.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.720 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673753425000001, 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:04.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:04.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673711851999997, 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.727 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:04.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.733 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673651531999994, 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:04.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:04.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673609157000001, 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.740 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:04.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673575244000006, 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673542874000006, 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.673500700999995, 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:04.765 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:04.766 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:04.766+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:04.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:04.867 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:04.866+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:04.874 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:04.874 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:04.874 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:04.874 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:04.883 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:04.921 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:04.969 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:04.967+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:05.025 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:05.025 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:05.026 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:05.026 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:05.026 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:05.035 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:05.050 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:05.068 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:05.069 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:05.069 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:05.068+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:05.072 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:05.072 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:05.170 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:05.169+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:05.177 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:05.177 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:05.186 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:05.271 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:05.270+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:05.289 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:05.290 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:05.299 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:05.372 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:05.371+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:05.402 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:05.402 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:05.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:05.472 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:05.471+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:05.514 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:05.514 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:05.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:05.574 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:05.573+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:05.627 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:05.627 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:05.635 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:05.675 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:05.674+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:05.776 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:05.776+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:05.778 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:05.778 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:05.787 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:05.877 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:05.876+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:05.890 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:05.890 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:05.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:05.978 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:05.977+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.004 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.004 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.013 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:06.097 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.096+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.155 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.155 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.164 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:06.205 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.204+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.280 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:06.280+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:06.308 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.308 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.317 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:06.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:11:06.381 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.381+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.421 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.421 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:06.483 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.482+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.532 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.540 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:06.584 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.583+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.642 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.642 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.651 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:06.684 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:06.683+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:06.755 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.755 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:06.807 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.806+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.866 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:06.867 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:06.875 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:06.916 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.915+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:06.987 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:06.986+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:07.019 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:07.019 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:07.028 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:07.073 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:07.087 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:07.087+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:07.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:07.189 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:07.188+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:07.200 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:07.200 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:07.218 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:07.219 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:07.219 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:07.222 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:07.222 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:07.243 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:07.243 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:07.251 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:07.290 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:07.289+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:07.302 INFO:tasks.workunit.client.0.smithi019.stderr:Updating files: 94% (12241/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T22:11:07.355 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.537323735000001, 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:11:07.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.530341277999995, 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:07.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:11:07.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396451338999995, 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:07.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:07.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.371 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396392027000005, 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:07.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396360114999993, 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.377 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:07.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.382 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396327987000006, 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:07.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:07.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396282593999999, 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:07.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:07.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:07.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396237627000005, 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:07.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396201430000005, 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:07.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:07.404 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396170260000005, 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.396144531999994, 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:07.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:07.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.412 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.390853692999997, 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:11:07.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.389503517999998, 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:11:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.388788391999995, 2024-09-12T22:11:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.388616902999999, 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:11:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.383021580999994, 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.382932483999994, 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.401209245000004, 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:11:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.399169348999997, 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.398451199, 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:11:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:07.455 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:07.457 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:11:07.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:07.458 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:07.455+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:07.557 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:07.556+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:07.563 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:07.563 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:07.563 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:07.563 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:07.573 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:07.659 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:07.658+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:07.716 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:07.716 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:07.716 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:07.716 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:07.717 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:07.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:07.769 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:07.768+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:07.830 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.544484600999994, 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.159463536999993, 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870297692999998, 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870241691999993, 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870209075000005, 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870182407000001, 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870113193999998, 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870066664999996, 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870037586999999, 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.870011629000004, 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869967947000006, 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869940374999999, 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.912 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869903191999995, 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:07.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:07.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869856565999996, 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.919 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:07.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:07.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:07.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.925 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869814993000006, 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:07.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:07.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.932 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869754673000003, 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:07.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:07.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.939 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869712297999996, 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:07.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:07.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869678385, 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.946 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:07.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:07.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.952 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869646015000001, 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:07.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:07.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.959 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.869603842000004, 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:07.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.965 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:07.965 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:07.965 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'. 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:11:07.967 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:11:07.968 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 7741f7f9ee2 Merge pull request #59718 from afreen23/wip-67994-squid 2024-09-12T22:11:07.968 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:07.965+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:07.969 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T22:11:07.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:07.994 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T22:11:07.996 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T22:11:07.996 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T22:11:08.067 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:08.066+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:08.075 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:08.075 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:08.075 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:08.075 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:08.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:08.169 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:08.168+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:08.227 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:08.228 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:08.236 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:08.270 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:08.269+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:08.371 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:08.370+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.561605442000001, 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019761800000000001, 2024-09-12T22:11:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816422+0000", 2024-09-12T22:11:08.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816423+0000", 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.86e-07 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816430+0000", 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3490000000000003e-06 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816437+0000", 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5910000000000001e-06 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816444+0000", 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.007e-06 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816504+0000", 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0071999999999997e-05 2024-09-12T22:11:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.816537+0000", 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3263000000000003e-05 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818359+0000", 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00182245 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:45.818399+0000", 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9261999999999998e-05 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4198.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.554622984999995, 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087027299999999997, 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823405+0000", 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823413+0000", 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9449999999999993e-06 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823421+0000", 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3250000000000008e-06 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823429+0000", 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.498e-06 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823470+0000", 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1208999999999998e-05 2024-09-12T22:11:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.823485+0000", 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4552999999999999e-05 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824238+0000", 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00075310899999999996 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:47.824275+0000", 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7428000000000001e-05 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420733045999995, 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420673734000005, 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420641821999993, 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420609694000007, 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420564300999999, 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420519334000005, 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420483137000005, 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420451967000005, 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.420426238999994, 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.415135399999997, 2024-09-12T22:11:08.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044768830000000001, 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962892+0000", 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962893+0000", 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1600000000000001e-07 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962904+0000", 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0973e-05 2024-09-12T22:11:08.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962925+0000", 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0990000000000001e-05 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962948+0000", 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963052+0000", 2024-09-12T22:11:08.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103509 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967369+0000", 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043175749999999997 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:08.443 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.413785224999998, 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034311150000000002, 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964243+0000", 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0699999999999997e-07 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964265+0000", 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1946999999999998e-05 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964634+0000", 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036907900000000002 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964650+0000", 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5727999999999999e-05 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964720+0000", 2024-09-12T22:11:08.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9890999999999999e-05 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964735+0000", 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4841000000000001e-05 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967643+0000", 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029077560000000001 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967674+0000", 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1266000000000002e-05 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 1 lcod 18'1)", 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.413070098999995, 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087504800000000002, 2024-09-12T22:11:08.448 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964958+0000", 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964962+0000", 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5889999999999999e-06 2024-09-12T22:11:08.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964977+0000", 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749000000000001e-05 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964984+0000", 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1969999999999999e-06 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965683+0000", 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069866700000000004 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965833+0000", 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015027700000000001 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.412898609999999, 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026214160000000001, 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965129+0000", 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965130+0000", 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6600000000000002e-07 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965136+0000", 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000001e-06 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965145+0000", 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2699999999999993e-06 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965153+0000", 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5580000000000003e-06 2024-09-12T22:11:08.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965345+0000", 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000192058 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965366+0000", 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1029000000000001e-05 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967723+0000", 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023576909999999999 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967751+0000", 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7373e-05 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T22:11:08.457 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.407303287999994, 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047708459999999996, 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6100000000000002e-07 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970729+0000", 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970737+0000", 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2749999999999998e-06 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970743+0000", 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4339999999999997e-06 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970792+0000", 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9097000000000001e-05 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970812+0000", 2024-09-12T22:11:08.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9967e-05 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975464+0000", 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046521160000000004 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975495+0000", 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1161999999999997e-05 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.462 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.407214190999994, 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046996219999999997, 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970814+0000", 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970816+0000", 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5500000000000001e-06 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970820+0000", 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6040000000000001e-06 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970825+0000", 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7260000000000002e-06 2024-09-12T22:11:08.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970987+0000", 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162588 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971001+0000", 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3879e-05 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975497+0000", 2024-09-12T22:11:08.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044959479999999996 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.975513+0000", 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6090999999999999e-05 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.467 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.425490952000004, 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00165726, 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952537+0000", 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952540+0000", 2024-09-12T22:11:08.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952567+0000", 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6974999999999998e-05 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952582+0000", 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5631999999999999e-05 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952607+0000", 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4912000000000001e-05 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952659+0000", 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1700999999999998e-05 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952754+0000", 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5420000000000005e-05 2024-09-12T22:11:08.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.952842+0000", 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7707999999999994e-05 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.953525+0000", 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068278800000000004 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954111+0000", 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058647899999999999 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954146+0000", 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4712000000000002e-05 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:52.954194+0000", 2024-09-12T22:11:08.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8205999999999999e-05 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.423451055999998, 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001669394, 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954577+0000", 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954580+0000", 2024-09-12T22:11:08.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1839999999999999e-06 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954598+0000", 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8289000000000001e-05 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954632+0000", 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4037e-05 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954655+0000", 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2291999999999999e-05 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954799+0000", 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144246 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954872+0000", 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2719999999999995e-05 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.954984+0000", 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112415 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.955723+0000", 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073937000000000004 2024-09-12T22:11:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956163+0000", 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000440071 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956200+0000", 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6488e-05 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:10.956246+0000", 2024-09-12T22:11:08.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6282000000000002e-05 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.422732906, 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018418480000000001, 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.480 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955295+0000", 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955298+0000", 2024-09-12T22:11:08.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955310+0000", 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2296000000000001e-05 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955339+0000", 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9232999999999999e-05 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955355+0000", 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5707000000000001e-05 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955476+0000", 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120878 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955624+0000", 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014832800000000001 2024-09-12T22:11:08.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.955767+0000", 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014284599999999999 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.956417+0000", 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065036200000000003 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957061+0000", 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00064344800000000002 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957094+0000", 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2894e-05 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:10:15.957137+0000", 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3226000000000003e-05 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:08.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:08.486 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:08.487 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:08.488 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:08.486+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:08.588 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:08.587+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:08.593 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:08.594 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:08.602 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:08.607 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T22:11:08.676 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T22:11:08.689 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:08.688+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:08.706 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:08.706 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:08.706 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:08.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:08.717 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T22:11:08.719 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T22:11:08.719 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T22:11:08.760 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T22:11:08.763 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:11:08.763 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T22:11:08.799 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:08.798+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:08.820 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-12T22:11:08.823 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-12T22:11:08.823 DEBUG:teuthology.orchestra.run.smithi019:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7741f7f9ee20524f89b8f61d1609b32fb3b1570a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-12T22:11:08.864 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:08.864 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 87.574533427999995, 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.865 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:08.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:08.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:08.871 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 87.189512363999995, 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:08.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:08.878 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900346519999999, 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:08.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:08.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:08.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.884 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900290518999995, 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:08.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900257902000007, 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:08.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:08.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.898 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900231234000003, 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:08.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:08.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.906 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900162021, 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:08.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:08.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900115491999998, 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.913 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:08.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:08.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900086414, 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:08.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:08.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.926 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900060456000006, 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.927 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:08.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:08.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.900016773999994, 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.935 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:08.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.941 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899989202, 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:08.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:08.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:08.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:08.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:08.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899952018999997, 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:08.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:08.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:08.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.956 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899905392999997, 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:08.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:08.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.963 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899863819999993, 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.964 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:08.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.971 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899803500000004, 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:08.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:08.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:08.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899761124999998, 2024-09-12T22:11:08.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:08.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:08.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:08.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899727212000002, 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:08.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:08.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899694842000002, 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:08.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:08.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:08.999 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.899652669000005, 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:09.000 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:09.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:09.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:09.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:09.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:09.006 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:09.006 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:09.006 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:09.006 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:09.006 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:09.006 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:09.007 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:09.006+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:09.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:09.030 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir -p fsstress 2024-09-12T22:11:09.031 INFO:tasks.workunit.client.0.smithi019.stderr:+ pushd fsstress 2024-09-12T22:11:09.032 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:11:09.032 INFO:tasks.workunit.client.0.smithi019.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-12T22:11:09.109 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:09.108+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:09.113 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:09.113 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:09.113 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:09.113 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:09.122 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:09.209 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:09.208+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:09.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:09.224 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:09.224 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:09.224 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:09.224 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:09.225 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:09.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:09.311 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:09.310+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:09.350 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:09.350 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:09.368 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:09.368 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:09.371 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:09.374 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:09.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:09.375 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:09.375 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:09.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:09.429 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:09.428+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:09.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:11:09.491 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:09.492 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:09.501 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:09.542 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:09.541+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:09.612 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:09.611+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:09.644 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:09.645 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:09.653 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:09.737 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:09.736+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:09.796 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:09.796 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:09.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:09.846 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:09.844+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:09.909 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:09.910 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:09.915 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:09.914+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:09.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:10.016 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:10.015+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:10.061 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:10.062 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:10.070 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:10.117 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:10.116+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:10.214 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:10.214 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:10.218 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:10.217+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:10.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:10.319 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:10.318+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:10.326 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:10.326 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:10.336 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:10.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-09-12T22:11:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:11:10.420 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:10.418+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:10.441 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:10.450 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:10.520 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:10.520+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:10.594 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:10.603 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:10.647 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:10.646+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:10.708 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:10.709 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:10.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:10.758 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:10.757+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:10.823 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:10.822+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:10.860 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:10.860 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:10.869 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:10.954 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:10.953+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.012 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:11.013 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:11.022 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:11.063 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:11.062+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.119 INFO:tasks.workunit.client.0.smithi019.stderr:+ tar xzf ltp-full.tgz 2024-09-12T22:11:11.125 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:11.124+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.129 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:11.130 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:11.139 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:11.226 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:11.225+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.249 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:11.249 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:11.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:11.326 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:11.325+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.368 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:11.368 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:11.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:11.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:11.428 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:11.426+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:11.487 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:11.488 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:11.497 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:11.517 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:11.517 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:11.528 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:11.526+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:11.538 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:11.539 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:11.539 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:11.542 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:11.543 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:11.609 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:11.610 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:11.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:11.661 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:11.660+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.728 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768649530999994, 2024-09-12T22:11:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:11.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:11.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768590219000004, 2024-09-12T22:11:11.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:11.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.742 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768558307000006, 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:11.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768526179000006, 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.748 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:11.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:11.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:11.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:11.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768480785999998, 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.755 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:11.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.762 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768435819000004, 2024-09-12T22:11:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:11.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:11.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.769 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768399622000004, 2024-09-12T22:11:11.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:11.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768368452000004, 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:11.775 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:11.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.768342724000007, 2024-09-12T22:11:11.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:11.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.784 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:372 4.f 4:f018392a:::1000000038f.00000000:head [write 0~359] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.522370+0000", 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.203574388, 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056333039999999996, 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 372 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522370+0000", 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522370+0000", 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522371+0000", 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3399999999999997e-07 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522375+0000", 2024-09-12T22:11:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522385+0000", 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522390+0000", 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2190000000000003e-06 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522424+0000", 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3951000000000001e-05 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522490+0000", 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6167000000000005e-05 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.527919+0000", 2024-09-12T22:11:11.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054284219999999996 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.527962+0000", 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3237e-05 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.528003+0000", 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:374 4.3a e47/17 4:5ea8a5ea:::10000000392.00000000:head v 47'3, mlcod=47'1)", 2024-09-12T22:11:11.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.20071785, 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054846799999999996, 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525233+0000", 2024-09-12T22:11:11.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.981e-06 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525244+0000", 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032e-05 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525251+0000", 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9210000000000003e-06 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525290+0000", 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8510000000000002e-05 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525301+0000", 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1446e-05 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530660+0000", 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053583479999999998 2024-09-12T22:11:11.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530711+0000", 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1668000000000001e-05 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:379 4.36 4:6d6d0b60:::10000000397.00000000:head [write 0~2514] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.530773+0000", 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.195171488, 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005424201, 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 379 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530773+0000", 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530773+0000", 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530774+0000", 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0079999999999999e-06 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530779+0000", 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4219999999999999e-06 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530793+0000", 2024-09-12T22:11:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3213e-05 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530801+0000", 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7339999999999997e-06 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530854+0000", 2024-09-12T22:11:11.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2741000000000002e-05 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530949+0000", 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4747999999999995e-05 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.536122+0000", 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051728399999999997 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.536154+0000", 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2351999999999998e-05 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.536197+0000", 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.806 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:388 4.7 4:e2d740a6:::100000003a1.00000000:head [write 0~2956] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.541725+0000", 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.18421958199999999, 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005267758, 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 388 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541725+0000", 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541725+0000", 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541726+0000", 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541730+0000", 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1069999999999998e-06 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541737+0000", 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1600000000000001e-06 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541741+0000", 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4710000000000001e-06 2024-09-12T22:11:11.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541784+0000", 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2404999999999998e-05 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541851+0000", 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7743000000000005e-05 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546890+0000", 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050386820000000001 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546924+0000", 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3871000000000001e-05 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546993+0000", 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8588000000000001e-05 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:390 4.37 4:eeee4386:::100000003a3.00000000:head [write 0~16738] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.18219685799999999, 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005963744, 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.812 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 390 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4200000000000002e-07 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543757+0000", 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.098e-06 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543763+0000", 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543767+0000", 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5399999999999997e-06 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543812+0000", 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4545999999999997e-05 2024-09-12T22:11:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543890+0000", 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8041999999999996e-05 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549597+0000", 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057073560000000002 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549640+0000", 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3387000000000003e-05 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549711+0000", 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0844000000000001e-05 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:393 4.6 e47/34 4:608b8126:::100000003a6.00000000:head v 47'7, mlcod=47'5)", 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.546962+0000", 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.178982485, 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052684350000000001, 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546962+0000", 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546962+0000", 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546963+0000", 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546972+0000", 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5710000000000004e-06 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546982+0000", 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9019999999999994e-06 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546989+0000", 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5549999999999999e-06 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.547024+0000", 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4820999999999997e-05 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.547037+0000", 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3797e-05 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.552195+0000", 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051573360000000002 2024-09-12T22:11:11.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.552230+0000", 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5642999999999997e-05 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:412 4.3f 4:fd5145c7:::100000003c0.00000000:head [write 0~80] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.15727459699999999, 2024-09-12T22:11:11.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058571639999999998, 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 412 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.823 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568671+0000", 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9400000000000004e-07 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568674+0000", 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5109999999999999e-06 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568683+0000", 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4770000000000003e-06 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568688+0000", 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6840000000000001e-06 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568732+0000", 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3689000000000001e-05 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568797+0000", 2024-09-12T22:11:11.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5099999999999997e-05 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574423+0000", 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056257879999999996 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574459+0000", 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6341999999999999e-05 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574527+0000", 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7779000000000003e-05 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:435 4.39 e47/17 4:9de7aaaf:::100000003d9.00000000:head v 47'4, mlcod=47'2)", 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.590935+0000", 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.13500903, 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056881689999999999, 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590935+0000", 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590935+0000", 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590936+0000", 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2099999999999996e-07 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590943+0000", 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5939999999999999e-06 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590952+0000", 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.346e-06 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590957+0000", 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4360000000000001e-06 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.591025+0000", 2024-09-12T22:11:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7401000000000001e-05 2024-09-12T22:11:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.591038+0000", 2024-09-12T22:11:11.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3072e-05 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.596603+0000", 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055653480000000003 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.596624+0000", 2024-09-12T22:11:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0350999999999999e-05 2024-09-12T22:11:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:463 4.37 4:effa053e:::100000003f8.00000000:head [write 0~1009] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.631532+0000", 2024-09-12T22:11:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.094412051999999996, 2024-09-12T22:11:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056025479999999997, 2024-09-12T22:11:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 463 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631532+0000", 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631532+0000", 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631533+0000", 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.33e-07 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631538+0000", 2024-09-12T22:11:11.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7720000000000002e-06 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631547+0000", 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1169999999999993e-06 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631552+0000", 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631590+0000", 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7716999999999998e-05 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631658+0000", 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8249000000000003e-05 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.637065+0000", 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054064600000000001 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.637095+0000", 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0763999999999999e-05 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.637135+0000", 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9473e-05 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:471 4.36 4:6dd04bdd:::10000000402.00000000:head [write 0~11911] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.639781+0000", 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.086162954, 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053672110000000002, 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 471 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.841 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639781+0000", 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639781+0000", 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639782+0000", 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639793+0000", 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.084e-05 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639802+0000", 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9770000000000006e-06 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639807+0000", 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2440000000000001e-06 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639850+0000", 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2483e-05 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639944+0000", 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3963999999999997e-05 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.645011+0000", 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050673469999999998 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.645064+0000", 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2478000000000001e-05 2024-09-12T22:11:11.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.645149+0000", 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5101999999999999e-05 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:489 4.2d 4:b649425c:::1000000041a.00000000:head [write 0~1038] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.660169+0000", 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.065775071000000004, 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055852619999999997, 2024-09-12T22:11:11.846 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 489 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660169+0000", 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660169+0000", 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660170+0000", 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4e-07 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:11.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660176+0000", 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6640000000000003e-06 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660190+0000", 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4452e-05 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660199+0000", 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.619e-06 2024-09-12T22:11:11.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660254+0000", 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4932999999999997e-05 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660376+0000", 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012237500000000001 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.665632+0000", 2024-09-12T22:11:11.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552830000000003 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.665675+0000", 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3278000000000001e-05 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.665755+0000", 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9717999999999998e-05 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:11.852 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:11.852 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:11.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:11.854 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:11.852+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.954 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:11.953+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:11.965 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:11.965 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:11.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.965 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:53 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header in=42b,omap-set-vals in=51834b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:11.962299+0000", 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.002689454, 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027148480000000002, 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962299+0000", 2024-09-12T22:11:11.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962299+0000", 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962300+0000", 2024-09-12T22:11:11.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7100000000000011e-07 2024-09-12T22:11:11.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:11.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962330+0000", 2024-09-12T22:11:11.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0161000000000001e-05 2024-09-12T22:11:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962344+0000", 2024-09-12T22:11:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3491e-05 2024-09-12T22:11:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962368+0000", 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3943000000000001e-05 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962416+0000", 2024-09-12T22:11:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8204999999999997e-05 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.962467+0000", 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1616999999999997e-05 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:11.964176+0000", 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001708434 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:11.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:11.972 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:11.972 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:11:11.972 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:11:11.972 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:11.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:12.055 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:12.053+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:12.086 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:12.086 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:12.086 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:12.087 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:12.087 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:12.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:12.155 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:12.155+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:12.248 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:12.248 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:12.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:12.249 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:12.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.249 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:12.249 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:12.249 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.961632315000003, 2024-09-12T22:11:12.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:12.250 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.250 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.250 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.250 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:12.250 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:12.251 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:12.251 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:12.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.251 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:12.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:12.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:12.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:12.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:12.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:12.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:12.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:12.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:12.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:12.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:12.259 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.576611251000003, 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:12.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:12.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:12.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.266 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287445407000007, 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:12.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:12.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287389406000003, 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.273 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:12.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:12.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:12.279 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287356789, 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.280 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:12.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:12.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287330120999997, 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:12.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:12.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:12.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:12.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287260907999993, 2024-09-12T22:11:12.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:12.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:12.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:12.299 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287214379000005, 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:12.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.306 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287185300999994, 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:12.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:12.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287159342999999, 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.313 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:12.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:12.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287115661000001, 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:12.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:12.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287088088999994, 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.326 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:12.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:12.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:12.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:12.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287050906000005, 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:12.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.287004280000005, 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:12.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:12.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:12.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.286962707000001, 2024-09-12T22:11:12.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:12.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:12.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.356 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.286902386999998, 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:12.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:12.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.286860012000005, 2024-09-12T22:11:12.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:12.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:12.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:12.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:12.369 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.286826098999995, 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:12.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:12.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.376 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.286793728999996, 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:12.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:12.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:12.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 81.286751555999999, 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:12.383 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:12.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:12.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:12.388 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:12.389 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:12.388+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:12.390 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:12.390 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:11:12.490 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:12.488+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:12.496 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:12.496 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:12.497 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:12.497 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:12.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:12.591 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:12.589+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:12.613 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:12.613 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:12.613 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:12.613 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:12.613 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:12.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:12.692 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:12.690+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:12.732 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:12.732 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:12.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:12.732 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.773162876000001, 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:12.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:12.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:12.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:12.739 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.773103563999996, 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.773071651999999, 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:12.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.751 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.773039523999998, 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:12.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:12.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:12.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:12.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:12.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:12.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:12.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:12.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:12.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.772994131000004, 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.766 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.772949163999996, 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:12.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:12.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.772912966999996, 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:12.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:12.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.777 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.772881796999997, 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:12.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:12.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.782 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.783 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.783 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:12.783 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:12.783 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.772856068999999, 2024-09-12T22:11:12.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:12.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:12.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:12.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:12.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:12.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:12.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:12.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:12.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:12.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:12.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:372 4.f 4:f018392a:::1000000038f.00000000:head [write 0~359] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.790 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.522370+0000", 2024-09-12T22:11:12.791 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.2080877329999999, 2024-09-12T22:11:12.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056333039999999996, 2024-09-12T22:11:12.791 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.791 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.791 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 372 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522370+0000", 2024-09-12T22:11:12.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522370+0000", 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522371+0000", 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3399999999999997e-07 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522375+0000", 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4229999999999998e-06 2024-09-12T22:11:12.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522385+0000", 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522390+0000", 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2190000000000003e-06 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522424+0000", 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3951000000000001e-05 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.522490+0000", 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6167000000000005e-05 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.527919+0000", 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054284219999999996 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.527962+0000", 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3237e-05 2024-09-12T22:11:12.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.528003+0000", 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:374 4.3a e47/17 4:5ea8a5ea:::10000000392.00000000:head v 47'3, mlcod=47'1)", 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.2052311950000001, 2024-09-12T22:11:12.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054846799999999996, 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525227+0000", 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7400000000000002e-07 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525233+0000", 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.981e-06 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525244+0000", 2024-09-12T22:11:12.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032e-05 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525251+0000", 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9210000000000003e-06 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525290+0000", 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8510000000000002e-05 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.525301+0000", 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1446e-05 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530660+0000", 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053583479999999998 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530711+0000", 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1668000000000001e-05 2024-09-12T22:11:12.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:379 4.36 4:6d6d0b60:::10000000397.00000000:head [write 0~2514] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.530773+0000", 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1996848330000001, 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005424201, 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.803 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 379 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530773+0000", 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530773+0000", 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530774+0000", 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0079999999999999e-06 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530779+0000", 2024-09-12T22:11:12.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4219999999999999e-06 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530793+0000", 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3213e-05 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530801+0000", 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7339999999999997e-06 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530854+0000", 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2741000000000002e-05 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.530949+0000", 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4747999999999995e-05 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.536122+0000", 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051728399999999997 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.536154+0000", 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2351999999999998e-05 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.536197+0000", 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:388 4.7 4:e2d740a6:::100000003a1.00000000:head [write 0~2956] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.541725+0000", 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.188732927, 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005267758, 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 388 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.809 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541725+0000", 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541725+0000", 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541726+0000", 2024-09-12T22:11:12.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541730+0000", 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1069999999999998e-06 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541737+0000", 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1600000000000001e-06 2024-09-12T22:11:12.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541741+0000", 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4710000000000001e-06 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541784+0000", 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2404999999999998e-05 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.541851+0000", 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7743000000000005e-05 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546890+0000", 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050386820000000001 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546924+0000", 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3871000000000001e-05 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546993+0000", 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8588000000000001e-05 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:390 4.37 4:eeee4386:::100000003a3.00000000:head [write 0~16738] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1867102030000001, 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005963744, 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 390 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4200000000000002e-07 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543757+0000", 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.098e-06 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543763+0000", 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543767+0000", 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5399999999999997e-06 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543812+0000", 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4545999999999997e-05 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543890+0000", 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8041999999999996e-05 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549597+0000", 2024-09-12T22:11:12.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057073560000000002 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549640+0000", 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3387000000000003e-05 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549711+0000", 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0844000000000001e-05 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:393 4.6 e47/34 4:608b8126:::100000003a6.00000000:head v 47'7, mlcod=47'5)", 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.546962+0000", 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.18349583, 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052684350000000001, 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546962+0000", 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546962+0000", 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546963+0000", 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546972+0000", 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5710000000000004e-06 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546982+0000", 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9019999999999994e-06 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.546989+0000", 2024-09-12T22:11:12.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5549999999999999e-06 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.547024+0000", 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4820999999999997e-05 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.547037+0000", 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3797e-05 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.552195+0000", 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051573360000000002 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.552230+0000", 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5642999999999997e-05 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:412 4.3f 4:fd5145c7:::100000003c0.00000000:head [write 0~80] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1617879419999999, 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058571639999999998, 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 412 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568671+0000", 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9400000000000004e-07 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568674+0000", 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5109999999999999e-06 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568683+0000", 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4770000000000003e-06 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568688+0000", 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6840000000000001e-06 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568732+0000", 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3689000000000001e-05 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568797+0000", 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5099999999999997e-05 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574423+0000", 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056257879999999996 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574459+0000", 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6341999999999999e-05 2024-09-12T22:11:12.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574527+0000", 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7779000000000003e-05 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:435 4.39 e47/17 4:9de7aaaf:::100000003d9.00000000:head v 47'4, mlcod=47'2)", 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.590935+0000", 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1395223750000001, 2024-09-12T22:11:12.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056881689999999999, 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590935+0000", 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590935+0000", 2024-09-12T22:11:12.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590936+0000", 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2099999999999996e-07 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590943+0000", 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5939999999999999e-06 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590952+0000", 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.346e-06 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.590957+0000", 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4360000000000001e-06 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.591025+0000", 2024-09-12T22:11:12.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7401000000000001e-05 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.591038+0000", 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3072e-05 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.596603+0000", 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055653480000000003 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.596624+0000", 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0350999999999999e-05 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:463 4.37 4:effa053e:::100000003f8.00000000:head [write 0~1009] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.631532+0000", 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.0989253969999999, 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056025479999999997, 2024-09-12T22:11:12.835 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 463 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631532+0000", 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631532+0000", 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631533+0000", 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.33e-07 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631538+0000", 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7720000000000002e-06 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631547+0000", 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1169999999999993e-06 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631552+0000", 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0629999999999996e-06 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631590+0000", 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7716999999999998e-05 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.631658+0000", 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8249000000000003e-05 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.637065+0000", 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054064600000000001 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.637095+0000", 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0763999999999999e-05 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.637135+0000", 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9473e-05 2024-09-12T22:11:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:471 4.36 4:6dd04bdd:::10000000402.00000000:head [write 0~11911] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.639781+0000", 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.0906762990000001, 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053672110000000002, 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 471 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639781+0000", 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639781+0000", 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639782+0000", 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639793+0000", 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.084e-05 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639802+0000", 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9770000000000006e-06 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639807+0000", 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2440000000000001e-06 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639850+0000", 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2483e-05 2024-09-12T22:11:12.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.639944+0000", 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3963999999999997e-05 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.645011+0000", 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050673469999999998 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.645064+0000", 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2478000000000001e-05 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.645149+0000", 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5101999999999999e-05 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:489 4.2d 4:b649425c:::1000000041a.00000000:head [write 0~1038] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.660169+0000", 2024-09-12T22:11:12.846 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.0702884159999999, 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055852619999999997, 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 489 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660169+0000", 2024-09-12T22:11:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660169+0000", 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660170+0000", 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4e-07 2024-09-12T22:11:12.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660176+0000", 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6640000000000003e-06 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660190+0000", 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4452e-05 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660199+0000", 2024-09-12T22:11:12.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.619e-06 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660254+0000", 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4932999999999997e-05 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.660376+0000", 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012237500000000001 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.665632+0000", 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552830000000003 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.665675+0000", 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3278000000000001e-05 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.665755+0000", 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9717999999999998e-05 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:12.852 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:12.852 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:12.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:12.854 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:12.851+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:12.954 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:12.952+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:12.964 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:12.965 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:12.965 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:12.965 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:12.974 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:13.055 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:13.054+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:13.126 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:13.127 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:13.136 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:13.180 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:13.178+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:13.255 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 91.968690222000006, 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 91.583669158000006, 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294503313999996, 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294447313000006, 2024-09-12T22:11:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294414696000004, 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294388028, 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294318814999997, 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294272285999995, 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294243207999997, 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294217250000003, 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294173568000005, 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294145995999997, 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:13.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:13.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.339 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294108812999994, 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:13.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.345 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294062186999994, 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:13.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:13.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.294020614000004, 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.352 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:13.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:13.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.293960294000001, 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:13.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:13.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:13.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.364 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.293917918999995, 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:13.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.371 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.293884005999999, 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:13.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:13.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.293851635999999, 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:13.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:13.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:13.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.384 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.293809463000002, 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:13.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:13.389 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:13.390 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:11:13.391 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:13.389+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:13.391 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:13.492 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:13.491+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:13.501 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:13.501 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:13.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.501 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:2080 4.11 4:8b7ebca7:::10000000b46.00000000:head [write 0~8044 in=8044b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:13.501 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:13.500816+0000", 2024-09-12T22:11:13.501 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.000184706, 2024-09-12T22:11:13.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000200707, 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2080 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500816+0000", 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:13.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500816+0000", 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500817+0000", 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0900000000000001e-07 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:13.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500823+0000", 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5429999999999999e-06 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500829+0000", 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0719999999999996e-06 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500834+0000", 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1250000000000001e-06 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500868+0000", 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3249e-05 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.500939+0000", 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0809999999999995e-05 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:13.501011+0000", 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2768000000000005e-05 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:13.505 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:13.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:13.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:13.506 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:13.506 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-09-12T22:11:13.506 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:13.511 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:13.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:13.593 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:13.591+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:13.657 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:13.657 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:13.657 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:13.657 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:13.657 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:13.667 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:13.691 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:13.691 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:13.694 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:13.692+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:13.710 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:13.710 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:13.711 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:13.714 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:13.714 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:13.777 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:13.777 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:13.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:13.831 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:13.829+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:13.897 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:13.895+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:13.901 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:13.901 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:13.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:13.997 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:13.995+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:14.066 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:14.067 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:14.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:14.099 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:14.098+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:14.200 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:14.198+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:14.231 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:14.231 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:14.240 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:14.300 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:14.299+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:14.351 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:14.351 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:14.360 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:14.401 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:14.400+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:14.502 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:14.501+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:14.510 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:14.520 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:14.604 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:14.603+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:14.677 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:14.677 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:14.687 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:14.731 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:14.729+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:14.795 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:14.795 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:14.804 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:14.805 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:14.802+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:14.904 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:14.903+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:14.955 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:14.955 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:14.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:15.006 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:15.005+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:15.076 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:15.077 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:15.086 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:15.130 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:15.129+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:15.201 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:15.201 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:15.208 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:15.207+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:15.211 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:15.309 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:15.307+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:15.359 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:15.360 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:15.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:15.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:11:15.409 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:15.407+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:15.481 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:15.482 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:15.491 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:15.510 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:15.509+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:15.604 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:15.604 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:15.611 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:15.610+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:15.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:15.712 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:15.711+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:15.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:15.721 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:15.722 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:15.731 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:15.813 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:15.812+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:15.839 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:15.839 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:15.849 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:15.857 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:15.881 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:15.881 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:15.881 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:15.884 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:15.884 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:15.913 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:15.911+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4395 4.b 4:d36c21cd:::100000014c9.00000000:head [write 0~2686 in=2686b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:15.953871+0000", 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0038583240000000002, 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038741219999999998, 2024-09-12T22:11:15.958 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4395 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953871+0000", 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:15.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953871+0000", 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953872+0000", 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2200000000000002e-07 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953881+0000", 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5930000000000006e-06 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953891+0000", 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953898+0000", 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5799999999999997e-06 2024-09-12T22:11:15.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953950+0000", 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2502e-05 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.954044+0000", 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3299000000000002e-05 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.954123+0000", 2024-09-12T22:11:15.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9555999999999995e-05 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.954792+0000", 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00066862300000000003 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.964 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4398 4.11 4:888a3346:::100000014cc.00000000:head [write 0~1707 in=1707b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:15.964 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:15.956481+0000", 2024-09-12T22:11:15.964 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0012484429999999999, 2024-09-12T22:11:15.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001311605, 2024-09-12T22:11:15.964 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:15.964 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4398 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956481+0000", 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:15.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956481+0000", 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956482+0000", 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:15.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956485+0000", 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.58e-06 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956492+0000", 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956498+0000", 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0939999999999996e-06 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956541+0000", 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2160999999999998e-05 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956616+0000", 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5692999999999995e-05 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956689+0000", 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:11:15.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.957188+0000", 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049967499999999999 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 2 2024-09-12T22:11:15.969 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:15.970 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:16.015 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:16.014+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:16.079 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:16.079 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:16.079 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:16.079 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:16.079 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:16.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:16.115 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:16.113+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:16.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-09-12T22:11:16.216 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:16.214+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:16.245 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:16.245 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:16.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:16.245 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:16.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.245 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.245 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285820107000006, 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:16.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:16.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:16.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:16.251 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285760795000002, 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:16.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:16.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285728883000004, 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.257 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:16.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285696755000004, 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285651361999996, 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285606395000002, 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285570198000002, 2024-09-12T22:11:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285539028000002, 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.285513300000005, 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:390 4.37 4:eeee4386:::100000003a3.00000000:head [write 0~16738] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.699367434, 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005963744, 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 390 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543748+0000", 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4200000000000002e-07 2024-09-12T22:11:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543757+0000", 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.098e-06 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543763+0000", 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543767+0000", 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5399999999999997e-06 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543812+0000", 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4545999999999997e-05 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.543890+0000", 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8041999999999996e-05 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549597+0000", 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057073560000000002 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549640+0000", 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3387000000000003e-05 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.549711+0000", 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0844000000000001e-05 2024-09-12T22:11:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:412 4.3f 4:fd5145c7:::100000003c0.00000000:head [write 0~80] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.6744451729999996, 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058571639999999998, 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 412 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568670+0000", 2024-09-12T22:11:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568671+0000", 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9400000000000004e-07 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568674+0000", 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5109999999999999e-06 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568683+0000", 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4770000000000003e-06 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568688+0000", 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6840000000000001e-06 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568732+0000", 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3689000000000001e-05 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.568797+0000", 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5099999999999997e-05 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574423+0000", 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056257879999999996 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574459+0000", 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6341999999999999e-05 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:11.574527+0000", 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7779000000000003e-05 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4395 4.b 4:d36c21cd:::100000014c9.00000000:head [write 0~2686 in=2686b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:15.953871+0000", 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.289243904, 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057608759999999998, 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4395 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953871+0000", 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953871+0000", 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953872+0000", 2024-09-12T22:11:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2200000000000002e-07 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953881+0000", 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5930000000000006e-06 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953891+0000", 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953898+0000", 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5799999999999997e-06 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.953950+0000", 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2502e-05 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.954044+0000", 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3299000000000002e-05 2024-09-12T22:11:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.954123+0000", 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9555999999999995e-05 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.954792+0000", 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00066862300000000003 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.959555+0000", 2024-09-12T22:11:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047634979999999997 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.959595+0000", 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9286999999999998e-05 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.959632+0000", 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7400000000000001e-05 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4398 4.11 4:888a3346:::100000014cc.00000000:head [write 0~1707 in=1707b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:15.956481+0000", 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.28663402300000002, 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058113569999999996, 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4398 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956481+0000", 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956481+0000", 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956482+0000", 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956485+0000", 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.58e-06 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956492+0000", 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956498+0000", 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0939999999999996e-06 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956541+0000", 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2160999999999998e-05 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956616+0000", 2024-09-12T22:11:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5692999999999995e-05 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.956689+0000", 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.957188+0000", 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049967499999999999 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962232+0000", 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050437399999999997 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962264+0000", 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1390999999999998e-05 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962292+0000", 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8744000000000001e-05 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4403 4.b 4:d2d0b4e2:::100000014d2.00000000:head [write 0~1333] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:15.962249+0000", 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.28086549300000002, 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057357370000000003, 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4403 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962249+0000", 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962249+0000", 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962250+0000", 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7599999999999996e-07 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962255+0000", 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1080000000000001e-06 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962264+0000", 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.721e-06 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962270+0000", 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2060000000000004e-06 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962306+0000", 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6032999999999999e-05 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962397+0000", 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0816000000000006e-05 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.962472+0000", 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5029000000000003e-05 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.963025+0000", 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055268099999999996 2024-09-12T22:11:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.967929+0000", 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049043799999999999 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.967960+0000", 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0514e-05 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:15.967985+0000", 2024-09-12T22:11:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5473000000000002e-05 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4438 4.3b 4:de8ca68e:::100000014f8.00000000:head [write 0~2062] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.002428+0000", 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.24068679600000001, 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005762667, 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4438 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002428+0000", 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002428+0000", 2024-09-12T22:11:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002429+0000", 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002433+0000", 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5519999999999998e-06 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002443+0000", 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3249999999999997e-06 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002447+0000", 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5730000000000001e-06 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002496+0000", 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8874e-05 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.002617+0000", 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012102799999999999 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.008081+0000", 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054641530000000002 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.008118+0000", 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7147999999999997e-05 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.008191+0000", 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2330999999999996e-05 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4491 4.29 4:9560ce8c:::10000001531.00000000:head [write 0~2583] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.055566+0000", 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.18754923100000001, 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060819209999999997, 2024-09-12T22:11:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4491 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055566+0000", 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055566+0000", 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055567+0000", 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055571+0000", 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7650000000000001e-06 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055582+0000", 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0514e-05 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055587+0000", 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:11:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055642+0000", 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4970999999999999e-05 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055769+0000", 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126592 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.055930+0000", 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016139799999999999 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.056728+0000", 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00079739100000000005 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.061554+0000", 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048264570000000001 2024-09-12T22:11:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.061606+0000", 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1650999999999997e-05 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.061648+0000", 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2026e-05 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4534 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~444] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.097622+0000", 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.14549250599999999, 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070711630000000001, 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4534 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097622+0000", 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097622+0000", 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097623+0000", 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0999999999999998e-07 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097627+0000", 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2080000000000002e-06 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097638+0000", 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0149999999999999e-05 2024-09-12T22:11:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097642+0000", 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9130000000000002e-06 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097710+0000", 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7560999999999999e-05 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097785+0000", 2024-09-12T22:11:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5368000000000001e-05 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.104613+0000", 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068277670000000002 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.104651+0000", 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8034000000000002e-05 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.104694+0000", 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2451999999999999e-05 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4535 4.33 4:cfbc0652:::10000001560.00000000:head [write 0~1695] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.098636+0000", 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.14447904, 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064136330000000002, 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4535 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098636+0000", 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098636+0000", 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098637+0000", 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2099999999999996e-07 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098641+0000", 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3760000000000001e-06 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098653+0000", 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.166e-05 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098658+0000", 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8840000000000002e-06 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098733+0000", 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5067000000000005e-05 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.098813+0000", 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0457999999999994e-05 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.104986+0000", 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061725490000000003 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.105013+0000", 2024-09-12T22:11:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7588000000000001e-05 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.105050+0000", 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6329999999999999e-05 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:4537 4.a e48/17 4:53eef021:::10000001563.00000000:head v 48'77, mlcod=48'75)", 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.101752+0000", 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.14136252299999999, 2024-09-12T22:11:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006067299, 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101752+0000", 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101752+0000", 2024-09-12T22:11:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101753+0000", 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9500000000000002e-07 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101758+0000", 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7169999999999999e-06 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101767+0000", 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9709999999999993e-06 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101772+0000", 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7910000000000004e-06 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101815+0000", 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3477999999999999e-05 2024-09-12T22:11:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.101836+0000", 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622e-05 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.107783+0000", 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059478170000000002 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.107820+0000", 2024-09-12T22:11:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6307999999999999e-05 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:68 3.b 3:d5c7a900:::200.00000003:head [write 0~1665671 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.145285+0000", 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.097830291999999999, 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006560888, 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.145285+0000", 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.145285+0000", 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.145285+0000", 2024-09-12T22:11:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.147143+0000", 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018570329999999999 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.147156+0000", 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3029e-05 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.147161+0000", 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7470000000000002e-06 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.147208+0000", 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6872000000000001e-05 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.147262+0000", 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3474999999999999e-05 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.147338+0000", 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6112999999999994e-05 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.150754+0000", 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034164680000000002 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.151759+0000", 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00100446 2024-09-12T22:11:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.151797+0000", 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8429000000000001e-05 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.151846+0000", 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8458999999999998e-05 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:16.356 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:16.357 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:16.355+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:16.357 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:16.444 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:11:16.458 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:16.455+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:4857 4.27 4:e626d0ee:::100000016cc.00000000:head [write 0~1446 in=1446b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.469369+0000", 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.00051909799999999996, 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053666, 2024-09-12T22:11:16.470 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 4857 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469369+0000", 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469369+0000", 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469369+0000", 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469380+0000", 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0369e-05 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469391+0000", 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0932e-05 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469396+0000", 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0669999999999999e-06 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469442+0000", 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6625999999999997e-05 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.469568+0000", 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012564 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:11:16.474 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:16.479 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:16.559 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:16.558+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:16.632 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:16.632 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:16.632 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:16.633 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:16.633 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:16.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:16.687 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:16.685+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:16.752 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.466510346999996, 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011707398000000001, 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 165 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283627+0000", 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.44e-07 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283631+0000", 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1099999999999996e-06 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283638+0000", 2024-09-12T22:11:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4489999999999996e-06 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.283644+0000", 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.896e-06 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291646+0000", 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080018150000000007 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291726+0000", 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0457000000000006e-05 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.291852+0000", 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125959 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295245+0000", 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033926210000000002 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295257+0000", 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.274e-05 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295300+0000", 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2252999999999997e-05 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.295334+0000", 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4453999999999999e-05 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4147.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.081489282999996, 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011688173, 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4147", 2024-09-12T22:11:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "172.21.15.19:0/1739601822", 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 207 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668648+0000", 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3e-07 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668652+0000", 2024-09-12T22:11:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2890000000000002e-06 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668659+0000", 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.187e-06 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.668664+0000", 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0010000000000001e-06 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674876+0000", 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062124900000000002 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674923+0000", 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6928000000000002e-05 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.674998+0000", 2024-09-12T22:11:16.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5071e-05 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.675684+0000", 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068594200000000004 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680260+0000", 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045752600000000003 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680301+0000", 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1826000000000002e-05 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:41.680336+0000", 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4548999999999997e-05 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792323439, 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792267437999996, 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792234820999994, 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792208153000004, 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792138940000001, 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792092410999999, 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792063333000002, 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.792037375000007, 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791993692999995, 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016243560000000001, 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958143+0000", 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958144+0000", 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0400000000000002e-07 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958150+0000", 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8839999999999999e-06 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958156+0000", 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5110000000000003e-06 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958215+0000", 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3028000000000001e-05 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958226+0000", 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1477999999999999e-05 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963064+0000", 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048382299999999998 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963178+0000", 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113794 2024-09-12T22:11:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963325+0000", 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147236 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968987+0000", 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00566133 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974272+0000", 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052856689999999998 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8959000000000002e-05 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5649000000000003e-05 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791966121000002, 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791928937999998, 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791882311999998, 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012360275, 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.845 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958255+0000", 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3499999999999996e-07 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958266+0000", 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0845999999999999e-05 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958274+0000", 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0940000000000008e-06 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958285+0000", 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0506000000000001e-05 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958375+0000", 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0017000000000002e-05 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:16.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958414+0000", 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9582999999999997e-05 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960529+0000", 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021147190000000001 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960665+0000", 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001361 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.960888+0000", 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00022279600000000001 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966566+0000", 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056777080000000001 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970297+0000", 2024-09-12T22:11:16.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037313390000000002 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970570+0000", 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027277200000000001 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970615+0000", 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5259999999999997e-05 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791840738999994, 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:16.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:16.858 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791780419000006, 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016063704000000002, 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958357+0000", 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958365+0000", 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.469e-06 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958373+0000", 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5790000000000004e-06 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958380+0000", 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4779999999999996e-06 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958522+0000", 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014247000000000001 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958530+0000", 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1699999999999997e-06 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963266+0000", 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047357900000000001 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963379+0000", 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011325299999999999 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963508+0000", 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012853499999999999 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968700+0000", 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051919820000000004 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974342+0000", 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056419510000000001 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974387+0000", 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5114999999999997e-05 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974420+0000", 2024-09-12T22:11:16.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3322999999999999e-05 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791738043999999, 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.865 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:16.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:16.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791704131000003, 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01229158, 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958433+0000", 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0699999999999997e-07 2024-09-12T22:11:16.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958439+0000", 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089999999999996e-06 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958446+0000", 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958454+0000", 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4290000000000004e-06 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958498+0000", 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4233000000000002e-05 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958504+0000", 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9610000000000002e-06 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961765+0000", 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0032608619999999998 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.961893+0000", 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012800299999999999 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962036+0000", 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000143311 2024-09-12T22:11:16.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966572+0000", 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045359679999999996 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970658+0000", 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040860169999999999 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970699+0000", 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0522999999999998e-05 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970725+0000", 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5777000000000001e-05 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.878 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791671761000003, 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015926141000000001, 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958466+0000", 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:11:16.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958477+0000", 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1079e-05 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958483+0000", 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5470000000000002e-06 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958489+0000", 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.694e-06 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958613+0000", 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012355299999999999 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958618+0000", 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.383e-06 2024-09-12T22:11:16.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964124+0000", 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055059940000000002 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964427+0000", 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000302787 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.964561+0000", 2024-09-12T22:11:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013430399999999999 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970169+0000", 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005607903 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974297+0000", 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041275360000000002 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974341+0000", 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4011999999999998e-05 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974391+0000", 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0911000000000001e-05 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:16.885 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 85.791629588000006, 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:16.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:16.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:16.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.890 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:16.891 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:16.891 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:16.892 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:16.891+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:16.893 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:16.993 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:16.992+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:17.002 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5384 4.15 4:a88c430b:::100000018e6.00000000:head [write 0~1773 in=1773b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.001960+0000", 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00049292699999999999, 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050848600000000005, 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.003 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5384 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.001960+0000", 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.001960+0000", 2024-09-12T22:11:17.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.001961+0000", 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9999999999999996e-07 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.001966+0000", 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.51e-06 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.001977+0000", 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0794e-05 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.001982+0000", 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2440000000000001e-06 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.002024+0000", 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1675999999999999e-05 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.002108+0000", 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4127000000000003e-05 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-09-12T22:11:17.007 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:17.012 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:17.096 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:17.095+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:17.169 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:17.169 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:17.169 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:17.169 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:17.170 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:17.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:17.196 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:17.194+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:17.296 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:17.294+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374633622999994, 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070614900000000001, 2024-09-12T22:11:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957295+0000", 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957304+0000", 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5840000000000001e-06 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957313+0000", 2024-09-12T22:11:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8200000000000003e-06 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957322+0000", 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8009999999999993e-06 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957330+0000", 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1720000000000007e-06 2024-09-12T22:11:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957398+0000", 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7648e-05 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957546+0000", 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000148138 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957692+0000", 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014605600000000001 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.961896+0000", 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042041680000000003 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964218+0000", 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023212929999999999 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964311+0000", 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3554999999999995e-05 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964356+0000", 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5255e-05 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374574311000003, 2024-09-12T22:11:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088543230000000007, 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957354+0000", 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957355+0000", 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6000000000000002e-07 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957359+0000", 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4530000000000004e-06 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957368+0000", 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2379999999999997e-06 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957375+0000", 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3799999999999996e-06 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958495+0000", 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011198989999999999 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958608+0000", 2024-09-12T22:11:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113398 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958741+0000", 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133053 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962476+0000", 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037346910000000001 2024-09-12T22:11:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966027+0000", 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035511980000000002 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966165+0000", 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137551 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966208+0000", 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3602e-05 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374542399000006, 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010000508999999999, 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957386+0000", 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957387+0000", 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5599999999999995e-07 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957397+0000", 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0034000000000001e-05 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957403+0000", 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6100000000000002e-06 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957409+0000", 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8510000000000004e-06 2024-09-12T22:11:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958067+0000", 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065788100000000003 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109324 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958338+0000", 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016211599999999999 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962470+0000", 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041313979999999997 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967276+0000", 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048059870000000003 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4499999999999996e-05 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967387+0000", 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6251999999999997e-05 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374510271000005, 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010113004, 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957418+0000", 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957419+0000", 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.39e-07 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957421+0000", 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957427+0000", 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.879e-06 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957432+0000", 2024-09-12T22:11:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958849+0000", 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001416835 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.958952+0000", 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010324599999999999 2024-09-12T22:11:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959081+0000", 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012826800000000001 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964373+0000", 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052925790000000004 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967433+0000", 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030599720000000002 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967494+0000", 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0744e-05 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967531+0000", 2024-09-12T22:11:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7264000000000001e-05 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374464877999998, 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089244540000000001, 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957464+0000", 2024-09-12T22:11:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957465+0000", 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3960000000000001e-06 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957472+0000", 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1940000000000001e-06 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957484+0000", 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2309e-05 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957495+0000", 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0088000000000001e-05 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959005+0000", 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001510043 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959389+0000", 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000384044 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.959554+0000", 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016553299999999999 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.964381+0000", 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004827057 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966278+0000", 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018967299999999999 2024-09-12T22:11:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966334+0000", 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5645e-05 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.966388+0000", 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4415e-05 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374419911000004, 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013027262, 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957509+0000", 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8999999999999996e-07 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957514+0000", 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1159999999999998e-06 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957521+0000", 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8820000000000003e-06 2024-09-12T22:11:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957527+0000", 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9680000000000003e-06 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962288+0000", 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004760668 2024-09-12T22:11:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962417+0000", 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012901699999999999 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962532+0000", 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011487199999999999 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967310+0000", 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047783039999999997 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970437+0000", 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003126616 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970491+0000", 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3961000000000001e-05 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.970536+0000", 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5167999999999999e-05 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374383714000004, 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013467468999999999, 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957545+0000", 2024-09-12T22:11:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7999999999999995e-07 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957549+0000", 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5099999999999999e-06 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957560+0000", 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1562999999999999e-05 2024-09-12T22:11:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957568+0000", 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1239999999999999e-06 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.962989+0000", 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054215649999999997 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.963103+0000", 2024-09-12T22:11:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114146 2024-09-12T22:11:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.971012+0000", 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079089810000000007 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374352544000004, 2024-09-12T22:11:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095550040000000006, 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957576+0000", 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1200000000000003e-07 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957579+0000", 2024-09-12T22:11:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.475e-06 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957587+0000", 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5900000000000002e-06 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957593+0000", 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1319999999999999e-06 2024-09-12T22:11:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960284+0000", 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026912009999999998 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.960438+0000", 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153936 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.967131+0000", 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066931580000000003 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.374326816000007, 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082254400000000005, 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957602+0000", 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957605+0000", 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6529999999999998e-06 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957611+0000", 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4880000000000004e-06 2024-09-12T22:11:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957618+0000", 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957681+0000", 2024-09-12T22:11:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3561999999999999e-05 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.957805+0000", 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123676 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:09:50.965827+0000", 2024-09-12T22:11:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080222520000000005 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:4534 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~444] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.097622+0000", 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.2343060219999999, 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070711630000000001, 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4534 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097622+0000", 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097622+0000", 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097623+0000", 2024-09-12T22:11:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0999999999999998e-07 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097627+0000", 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2080000000000002e-06 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097638+0000", 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0149999999999999e-05 2024-09-12T22:11:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097642+0000", 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9130000000000002e-06 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097710+0000", 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7560999999999999e-05 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.097785+0000", 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5368000000000001e-05 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.104613+0000", 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068277670000000002 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.104651+0000", 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8034000000000002e-05 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.104694+0000", 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2451999999999999e-05 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:69 3.b 3:d5c7a900:::200.00000003:head [write 1665671~1816388 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.649557+0000", 2024-09-12T22:11:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.68237099899999998, 2024-09-12T22:11:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077375389999999999, 2024-09-12T22:11:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.649557+0000", 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.649557+0000", 2024-09-12T22:11:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.649558+0000", 2024-09-12T22:11:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5900000000000005e-07 2024-09-12T22:11:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.651671+0000", 2024-09-12T22:11:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021126959999999998 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.651682+0000", 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.133e-05 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.651690+0000", 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1720000000000001e-06 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.651734+0000", 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4737000000000002e-05 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.651784+0000", 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9490000000000002e-05 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.651854+0000", 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0377999999999996e-05 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.655510+0000", 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036558480000000002 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.657236+0000", 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001726074 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.657268+0000", 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2190000000000002e-05 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.657295+0000", 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6665e-05 2024-09-12T22:11:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.61266174299999998, 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.61206080900000004, 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.60049968399999998, 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5147 4.11 4:8a80f489:::100000017f9.00000000:head [write 0~904] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.781195+0000", 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.55073373999999997, 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071468770000000003, 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5147 2024-09-12T22:11:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781195+0000", 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781195+0000", 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781195+0000", 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.61e-07 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781199+0000", 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9580000000000001e-06 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781207+0000", 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781211+0000", 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.391e-06 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781242+0000", 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0891e-05 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781314+0000", 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1507999999999994e-05 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.781385+0000", 2024-09-12T22:11:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1209000000000002e-05 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.784114+0000", 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027295079999999998 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.788278+0000", 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041631389999999997 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.788309+0000", 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1029999999999999e-05 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.788342+0000", 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3071999999999998e-05 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5181 4.0 4:03127d22:::1000000181b.00000000:head [write 0~1476] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.812502+0000", 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.51942672400000001, 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076572929999999999, 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5181 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812502+0000", 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812502+0000", 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812503+0000", 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9100000000000002e-07 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812507+0000", 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7380000000000002e-06 2024-09-12T22:11:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812518+0000", 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0756e-05 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812524+0000", 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7640000000000002e-06 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812576+0000", 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2469999999999997e-05 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812691+0000", 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114836 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.812806+0000", 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011512 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.815303+0000", 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024968159999999998 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.820084+0000", 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004780673 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.820125+0000", 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1186999999999997e-05 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.820159+0000", 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4041999999999997e-05 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5501 4.0 4:010bf2b9:::1000000195e.00000000:head [write 0~1549] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.115626+0000", 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.21630260300000001, 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081119729999999998, 2024-09-12T22:11:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5501 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115626+0000", 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115626+0000", 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115627+0000", 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4600000000000004e-07 2024-09-12T22:11:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115631+0000", 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.301e-06 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115643+0000", 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2452999999999999e-05 2024-09-12T22:11:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115649+0000", 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1399999999999999e-06 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115695+0000", 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6931000000000002e-05 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115781+0000", 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5809000000000005e-05 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.115849+0000", 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7817000000000005e-05 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.116783+0000", 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093394300000000001 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.123657+0000", 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068741000000000002 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.123701+0000", 2024-09-12T22:11:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3924999999999997e-05 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.123738+0000", 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6807999999999997e-05 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5505 4.1e 4:7b100ea5:::10000001962.00000000:head [write 0~738] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.119184+0000", 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.21274437600000001, 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083143750000000006, 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5505 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119184+0000", 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119184+0000", 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119185+0000", 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6899999999999996e-07 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119189+0000", 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2320000000000003e-06 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119200+0000", 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0574000000000001e-05 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119205+0000", 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2220000000000001e-06 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119243+0000", 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8553000000000002e-05 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119346+0000", 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102483 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.119414+0000", 2024-09-12T22:11:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8330999999999993e-05 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.120574+0000", 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001159783 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.127437+0000", 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068631949999999999 2024-09-12T22:11:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.127475+0000", 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7367999999999999e-05 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.127498+0000", 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3864999999999999e-05 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5630 4.3f 4:fe26d0c4:::100000019ec.00000000:head [write 0~762] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.245757+0000", 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.086171060999999993, 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079785789999999995, 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5630 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245757+0000", 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245757+0000", 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245758+0000", 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7700000000000003e-07 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245765+0000", 2024-09-12T22:11:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5239999999999997e-06 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245772+0000", 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5109999999999997e-06 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245778+0000", 2024-09-12T22:11:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1759999999999998e-06 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245820+0000", 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1105e-05 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.245913+0000", 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3611999999999998e-05 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.253622+0000", 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077091720000000002 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.253666+0000", 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3930000000000001e-05 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.253736+0000", 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9672000000000006e-05 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5663 4.3e 4:7c52bdec:::10000001a12.00000000:head [write 0~3730] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.280217+0000", 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.051711383999999999, 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081898240000000001, 2024-09-12T22:11:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5663 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280217+0000", 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280217+0000", 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280218+0000", 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7300000000000005e-07 2024-09-12T22:11:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280223+0000", 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0039999999999999e-06 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280235+0000", 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2284e-05 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280240+0000", 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1150000000000002e-06 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280295+0000", 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5222000000000001e-05 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.280476+0000", 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180967 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.288330+0000", 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078536709999999996 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.288365+0000", 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4987999999999998e-05 2024-09-12T22:11:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.288407+0000", 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.18e-05 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:17.466 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:17.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:17.469 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:17.466+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:17.568 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:17.567+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5940 4.1a 4:5901ab05:::10000001b43.00000000:head [write 0~1778 in=1778b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:17.578820+0000", 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.00062470400000000001, 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00064418899999999998, 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.580 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5940 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578820+0000", 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578820+0000", 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578821+0000", 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578826+0000", 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1429999999999997e-06 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578839+0000", 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3254e-05 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578847+0000", 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9789999999999993e-06 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578898+0000", 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1153000000000003e-05 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.578977+0000", 2024-09-12T22:11:17.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8972000000000002e-05 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:17.579054+0000", 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7311000000000006e-05 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:11:17.585 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:17.589 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:17.669 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:17.667+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:17.698 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:17.699 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:17.707 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:17.769 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:17.768+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:17.860 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899575999999996, 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899519999000006, 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:17.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:17.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899487382000004, 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:17.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:17.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899460714, 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:17.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:17.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:17.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899391500999997, 2024-09-12T22:11:17.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:17.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:17.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:17.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899344971999994, 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:17.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:17.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.900 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899315893999997, 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:17.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:17.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:17.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:17.907 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899289936000002, 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:17.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899218681999997, 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:17.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:17.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899181498999994, 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:17.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:17.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.899093300000004, 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:17.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:17.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.933 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.898990604999995, 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:17.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:17.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:17.940 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 86.898882149000002, 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:17.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.1384404610000001, 2024-09-12T22:11:17.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:17.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:17.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:17.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.1263778630000001, 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.952 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:17.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5101 4.c 4:30c8de84:::100000017cb.00000000:head [write 0~2007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.1193494639999999, 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023543338, 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.958 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5101 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738041+0000", 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.113e-06 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738048+0000", 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3629999999999999e-06 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738063+0000", 2024-09-12T22:11:17.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5557e-05 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738071+0000", 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2870000000000004e-06 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738109+0000", 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7239e-05 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738186+0000", 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7410000000000006e-05 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738260+0000", 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3590000000000005e-05 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738823+0000", 2024-09-12T22:11:17.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056369500000000002 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761536+0000", 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022712663000000001 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761563+0000", 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7056e-05 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761584+0000", 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0364999999999999e-05 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5102 4.1b 4:d8bd0ea8:::100000017cc.00000000:head [write 0~1672] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.1184731779999999, 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024115083999999998, 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.964 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5102 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738917+0000", 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738922+0000", 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1139999999999997e-06 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738935+0000", 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2700999999999999e-05 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738944+0000", 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738994+0000", 2024-09-12T22:11:17.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0522000000000002e-05 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739117+0000", 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012277699999999999 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739243+0000", 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012553999999999999 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741532+0000", 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022895739999999999 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762948+0000", 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021415500000000001 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762994+0000", 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763032+0000", 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7469000000000003e-05 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5104 4.c 4:331706eb:::100000017ce.00000000:head [write 0~1330] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.1166859920000001, 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022240794000000001, 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.970 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5104 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740705+0000", 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0400000000000005e-07 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740710+0000", 2024-09-12T22:11:17.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1660000000000002e-06 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740724+0000", 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3869999999999999e-05 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740731+0000", 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7500000000000003e-06 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740768+0000", 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740863+0000", 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4761999999999998e-05 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740937+0000", 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4228999999999997e-05 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741834+0000", 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00089672700000000005 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762894+0000", 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021059873999999999 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762922+0000", 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7960999999999999e-05 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762944+0000", 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2583e-05 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5105 4.20 4:054a3248:::100000017cf.00000000:head [write 0~2450] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.1156837289999999, 2024-09-12T22:11:17.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021353684000000001, 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5105 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741707+0000", 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6300000000000004e-07 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741712+0000", 2024-09-12T22:11:17.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2349999999999999e-06 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741725+0000", 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2529e-05 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741734+0000", 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0589999999999992e-06 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741790+0000", 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6150999999999998e-05 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741913+0000", 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012315500000000001 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742042+0000", 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012935799999999999 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742684+0000", 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00064220599999999998 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762976+0000", 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020292039000000001 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763013+0000", 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6634999999999997e-05 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763060+0000", 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6453999999999999e-05 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.982 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5108 4.20 4:05323f20:::100000017d2.00000000:head [write 0~6203] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.1129220959999999, 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018849817000000001, 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:17.983 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5108 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:17.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744477+0000", 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6659999999999997e-06 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744491+0000", 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3658999999999999e-05 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744496+0000", 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4099999999999999e-06 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744539+0000", 2024-09-12T22:11:17.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3409999999999999e-05 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744626+0000", 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6475000000000001e-05 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744707+0000", 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1248999999999994e-05 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.745240+0000", 2024-09-12T22:11:17.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053252799999999999 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763251+0000", 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018011454999999999 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763277+0000", 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5432999999999999e-05 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:17.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763317+0000", 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0757000000000003e-05 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:17.989 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:17.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:17.991 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:17.989+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:17.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:18.092 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:18.090+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:6391 4.26 4:643608c9:::10000001d40.00000000:head [write 0~1092 in=1092b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:18.101235+0000", 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.000343517, 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036640300000000001, 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6391 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101235+0000", 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101235+0000", 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101235+0000", 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0100000000000003e-07 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101240+0000", 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3930000000000001e-06 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101247+0000", 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1160000000000001e-06 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101252+0000", 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2140000000000004e-06 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101285+0000", 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2638999999999997e-05 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101360+0000", 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5279999999999998e-05 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:18.101432+0000", 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1575000000000005e-05 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-09-12T22:11:18.107 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:18.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:18.128 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:18.151 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:18.152 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:18.193 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:18.191+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:18.227 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:18.227 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:18.237 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:18.294 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:18.292+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:18.344 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:18.345 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:18.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:18.396 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:18.395+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:18.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:11:18.467 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:18.467 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:18.477 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:18.520 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:18.518+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:18.596 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:18.597 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:18.596+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:18.698 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:18.696+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:18.748 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:18.749 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:18.758 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:18.799 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:18.797+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:18.870 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:18.870 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:18.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:18.923 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:18.922+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:18.989 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:18.989 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:18.999 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:19.041 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:19.040+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:19.102 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:19.101+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:19.150 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:19.150 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:19.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:19.203 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:19.202+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:19.278 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:19.321 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:19.319+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:19.390 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:19.390 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:19.401 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:19.442 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:19.441+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:19.455 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:11:19.506 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:19.505+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:19.552 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:19.552 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:19.561 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:19.607 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:19.606+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:19.672 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:19.672 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:19.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:19.723 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:19.722+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:19.809 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:19.808+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:19.831 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:19.832 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:19.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:19.911 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:19.910+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:19.951 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:19.951 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:19.960 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:20.011 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:20.010+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:20.068 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:20.069 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:20.078 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:20.119 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:20.118+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:20.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:20.213 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:20.212+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:20.226 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:20.226 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:20.235 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:20.303 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:20.303 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:20.315 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:20.314+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:20.322 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:20.323 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:20.323 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:20.326 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:20.326 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:20.387 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:20.387 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:20.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:20.387 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:20.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.387 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426874679999997, 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:20.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:20.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426818678999993, 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:20.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:20.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:20.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:20.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426786062000005, 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.402 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:20.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:20.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:20.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:20.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:20.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:20.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:20.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:20.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426759394000001, 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.412 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:20.417 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:20.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.418 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:20.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:20.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:20.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:20.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.420 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426690180999998, 2024-09-12T22:11:20.421 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.422 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:20.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.424 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:20.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:20.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.425 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.425 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:20.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:20.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:20.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:20.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:20.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:20.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:20.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:20.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:20.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:20.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:20.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:20.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:20.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:20.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:20.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:20.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:20.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:20.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:20.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:20.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:20.435 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.435 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.435 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426643651999996, 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:20.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:20.442 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426614573999998, 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:20.443 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:20.445 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:20.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.445 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.448 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.448 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:20.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:20.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.448 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.449 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426588616000004, 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.452 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:20.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.454 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:20.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:20.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426517361999998, 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:20.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.460 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:20.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426480178999995, 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:20.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.472 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426391980000005, 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:20.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:20.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.478 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426289284999996, 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:20.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:20.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 89.426180829000003, 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:20.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:20.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.665739141, 2024-09-12T22:11:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:20.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:20.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.653676543, 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:20.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:20.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:20.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5101 4.c 4:30c8de84:::100000017cb.00000000:head [write 0~2007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.6466481440000003, 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023543338, 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:20.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:20.504 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.504 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5101 2024-09-12T22:11:20.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.504 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738041+0000", 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.113e-06 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738048+0000", 2024-09-12T22:11:20.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3629999999999999e-06 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738063+0000", 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5557e-05 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738071+0000", 2024-09-12T22:11:20.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2870000000000004e-06 2024-09-12T22:11:20.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738109+0000", 2024-09-12T22:11:20.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7239e-05 2024-09-12T22:11:20.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738186+0000", 2024-09-12T22:11:20.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7410000000000006e-05 2024-09-12T22:11:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738260+0000", 2024-09-12T22:11:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3590000000000005e-05 2024-09-12T22:11:20.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738823+0000", 2024-09-12T22:11:20.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056369500000000002 2024-09-12T22:11:20.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761536+0000", 2024-09-12T22:11:20.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022712663000000001 2024-09-12T22:11:20.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761563+0000", 2024-09-12T22:11:20.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7056e-05 2024-09-12T22:11:20.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761584+0000", 2024-09-12T22:11:20.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0364999999999999e-05 2024-09-12T22:11:20.514 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.514 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.515 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5102 4.1b 4:d8bd0ea8:::100000017cc.00000000:head [write 0~1672] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.515 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:20.515 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.6457718579999998, 2024-09-12T22:11:20.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024115083999999998, 2024-09-12T22:11:20.516 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.516 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.516 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:20.517 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:20.517 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.517 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5102 2024-09-12T22:11:20.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.517 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:20.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:20.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738917+0000", 2024-09-12T22:11:20.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:11:20.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738922+0000", 2024-09-12T22:11:20.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1139999999999997e-06 2024-09-12T22:11:20.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738935+0000", 2024-09-12T22:11:20.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2700999999999999e-05 2024-09-12T22:11:20.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738944+0000", 2024-09-12T22:11:20.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:20.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738994+0000", 2024-09-12T22:11:20.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0522000000000002e-05 2024-09-12T22:11:20.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739117+0000", 2024-09-12T22:11:20.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012277699999999999 2024-09-12T22:11:20.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739243+0000", 2024-09-12T22:11:20.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012553999999999999 2024-09-12T22:11:20.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741532+0000", 2024-09-12T22:11:20.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022895739999999999 2024-09-12T22:11:20.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762948+0000", 2024-09-12T22:11:20.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021415500000000001 2024-09-12T22:11:20.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762994+0000", 2024-09-12T22:11:20.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:11:20.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763032+0000", 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7469000000000003e-05 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5104 4.c 4:331706eb:::100000017ce.00000000:head [write 0~1330] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.6439846720000002, 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022240794000000001, 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5104 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740705+0000", 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0400000000000005e-07 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740710+0000", 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1660000000000002e-06 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740724+0000", 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3869999999999999e-05 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740731+0000", 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7500000000000003e-06 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740768+0000", 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740863+0000", 2024-09-12T22:11:20.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4761999999999998e-05 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740937+0000", 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4228999999999997e-05 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741834+0000", 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00089672700000000005 2024-09-12T22:11:20.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762894+0000", 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021059873999999999 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762922+0000", 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7960999999999999e-05 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762944+0000", 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2583e-05 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5105 4.20 4:054a3248:::100000017cf.00000000:head [write 0~2450] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.642982409, 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021353684000000001, 2024-09-12T22:11:20.536 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5105 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:20.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741707+0000", 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6300000000000004e-07 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741712+0000", 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2349999999999999e-06 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741725+0000", 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2529e-05 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741734+0000", 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0589999999999992e-06 2024-09-12T22:11:20.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741790+0000", 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6150999999999998e-05 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741913+0000", 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012315500000000001 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742042+0000", 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012935799999999999 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742684+0000", 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00064220599999999998 2024-09-12T22:11:20.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762976+0000", 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020292039000000001 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763013+0000", 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6634999999999997e-05 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763060+0000", 2024-09-12T22:11:20.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6453999999999999e-05 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5108 4.20 4:05323f20:::100000017d2.00000000:head [write 0~6203] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.640220776, 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018849817000000001, 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:20.543 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5108 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744477+0000", 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6659999999999997e-06 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744491+0000", 2024-09-12T22:11:20.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3658999999999999e-05 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744496+0000", 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4099999999999999e-06 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744539+0000", 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3409999999999999e-05 2024-09-12T22:11:20.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744626+0000", 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6475000000000001e-05 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744707+0000", 2024-09-12T22:11:20.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1248999999999994e-05 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.745240+0000", 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053252799999999999 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763251+0000", 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018011454999999999 2024-09-12T22:11:20.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763277+0000", 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5432999999999999e-05 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763317+0000", 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0757000000000003e-05 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.549 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:20.550 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:20.550 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:20.551 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:20.550+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:20.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:20.652 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:20.651+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:8514 4.0 4:020bcee2:::100000026d0.00000000:head [write 0~915 in=915b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:20.661252+0000", 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0014310010000000001, 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001453883, 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8514 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661252+0000", 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661252+0000", 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661253+0000", 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661257+0000", 2024-09-12T22:11:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0239999999999999e-06 2024-09-12T22:11:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661266+0000", 2024-09-12T22:11:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2979999999999992e-06 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661270+0000", 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661311+0000", 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1140999999999998e-05 2024-09-12T22:11:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661388+0000", 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6618000000000004e-05 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.661461+0000", 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2813999999999998e-05 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662026+0000", 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00056539299999999997 2024-09-12T22:11:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:8515 4.a e50/17 4:501fe2ad:::100000026d1.00000000:head v 50'137, mlcod=50'135)", 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:20.662417+0000", 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00026678599999999998, 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035156199999999998, 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662417+0000", 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662417+0000", 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662417+0000", 2024-09-12T22:11:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662424+0000", 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6189999999999996e-06 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662433+0000", 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.268e-06 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662439+0000", 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2090000000000002e-06 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662479+0000", 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:20.662491+0000", 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2139e-05 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 2 2024-09-12T22:11:20.674 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:20.675 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:20.753 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:20.752+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:20.828 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:20.828 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:20.829 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:20.829 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:20.829 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:20.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:20.854 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:20.853+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:20.954 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:20.953+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2353806299999999, 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:20.957 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:20.961 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2347796960000004, 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:20.962 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:20.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:20.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2232185710000003, 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:20.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:20.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 3788828~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0234823159999999, 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021405258, 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931169+0000", 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:20.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931172+0000", 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5839999999999999e-06 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931175+0000", 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.57e-06 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.947825+0000", 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016650323000000002 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.947898+0000", 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2898000000000006e-05 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948006+0000", 2024-09-12T22:11:20.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108378 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951454+0000", 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034474459999999998 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952528+0000", 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010737660000000001 2024-09-12T22:11:20.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952552+0000", 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4919999999999999e-05 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952570+0000", 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 3790232~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0234696809999999, 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021480683, 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931179+0000", 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.333e-06 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931182+0000", 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.01e-06 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931185+0000", 2024-09-12T22:11:20.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.345e-06 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948285+0000", 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017100317 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948324+0000", 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8936999999999997e-05 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948386+0000", 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2094999999999994e-05 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951457+0000", 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030707849999999999 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952603+0000", 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001146418 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952631+0000", 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7535e-05 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952658+0000", 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7662999999999999e-05 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.984 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 3791637~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0234600559999998, 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021574553, 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931188+0000", 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-07 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931189+0000", 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3829999999999999e-06 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931192+0000", 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:11:20.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931194+0000", 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3580000000000001e-06 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948593+0000", 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017398825 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948668+0000", 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4889999999999996e-05 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948781+0000", 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011338800000000001 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951460+0000", 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026785770000000001 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952686+0000", 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012264750000000001 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952729+0000", 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2682999999999998e-05 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952762+0000", 2024-09-12T22:11:20.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2872e-05 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 3793036~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.023450526, 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021643235, 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.991 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.04e-07 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931200+0000", 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0350000000000002e-06 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931203+0000", 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.021e-06 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931205+0000", 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949280+0000", 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018074702000000002 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:20.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949360+0000", 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9987000000000005e-05 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949472+0000", 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111439 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951465+0000", 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019930199999999999 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952793+0000", 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013284219999999999 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952822+0000", 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558e-05 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:20.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952840+0000", 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8454e-05 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 3794435~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0234390809999998, 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021727666999999999, 2024-09-12T22:11:20.997 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:20.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931210+0000", 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4610000000000001e-06 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:20.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931213+0000", 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8899999999999999e-06 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931215+0000", 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.447e-06 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949786+0000", 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018570768000000001 2024-09-12T22:11:21.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949861+0000", 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5154999999999994e-05 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949984+0000", 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012320199999999999 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952074+0000", 2024-09-12T22:11:21.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020892380000000002 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952871+0000", 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00079710999999999996 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952907+0000", 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6049e-05 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952936+0000", 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9130999999999999e-05 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 3795856~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0234294259999999, 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021812946, 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.003 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0800000000000001e-07 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931221+0000", 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8219999999999998e-06 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931227+0000", 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931229+0000", 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7180000000000001e-06 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950607+0000", 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019377976000000002 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950649+0000", 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1968000000000002e-05 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950719+0000", 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9245000000000005e-05 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952304+0000", 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00158519 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952974+0000", 2024-09-12T22:11:21.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00066995900000000003 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953003+0000", 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9184e-05 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953031+0000", 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8014999999999999e-05 2024-09-12T22:11:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 3797262~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0234152029999999, 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021906492999999999, 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931234+0000", 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.404e-06 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931237+0000", 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931239+0000", 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4260000000000002e-06 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951070+0000", 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019830711000000001 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951151+0000", 2024-09-12T22:11:21.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1200999999999997e-05 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951248+0000", 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6430999999999999e-05 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952498+0000", 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012502710000000001 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953074+0000", 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057586699999999998 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953115+0000", 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1817000000000003e-05 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953139+0000", 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3187999999999999e-05 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.014 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 3798667~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0234056950000001, 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021993792000000002, 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:21.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931243+0000", 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5820000000000001e-06 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931246+0000", 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9059999999999998e-06 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931249+0000", 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951505+0000", 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020255813000000001 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951578+0000", 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3119000000000002e-05 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951691+0000", 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113177 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952502+0000", 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00081045499999999996 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953182+0000", 2024-09-12T22:11:21.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068051099999999996 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953216+0000", 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3708999999999999e-05 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953235+0000", 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9497e-05 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 3800068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0233933679999998, 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024017679, 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-07 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931256+0000", 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7e-06 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931261+0000", 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2179999999999998e-06 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931266+0000", 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:11:21.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953273+0000", 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022006537999999999 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953326+0000", 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3256e-05 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953415+0000", 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8657000000000002e-05 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954136+0000", 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072149300000000003 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955218+0000", 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010819110000000001 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955249+0000", 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0542e-05 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955272+0000", 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3037999999999999e-05 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0233750819999998, 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:21.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0233532329999999, 2024-09-12T22:11:21.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:21.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:21.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.037 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0233384430000001, 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:21.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:21.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0233285740000002, 2024-09-12T22:11:21.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:21.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.023314488, 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.049 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 3808482~22555 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.054 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0133672950000001, 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021352561999999999, 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941281+0000", 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941297+0000", 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5633000000000001e-05 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941305+0000", 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2749999999999995e-06 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941310+0000", 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9300000000000002e-06 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956248+0000", 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014938338000000001 2024-09-12T22:11:21.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956286+0000", 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7968e-05 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956348+0000", 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1486000000000001e-05 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957884+0000", 2024-09-12T22:11:21.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015358660000000001 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962581+0000", 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046975039999999999 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962604+0000", 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2938999999999998e-05 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962633+0000", 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8515999999999999e-05 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 3831037~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0133279690000001, 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021365658999999999, 2024-09-12T22:11:21.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941320+0000", 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-07 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941322+0000", 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941326+0000", 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7479999999999999e-06 2024-09-12T22:11:21.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941328+0000", 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7429999999999998e-06 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956691+0000", 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015363086999999999 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956765+0000", 2024-09-12T22:11:21.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3054999999999998e-05 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956880+0000", 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115322 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.958314+0000", 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001434446 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962637+0000", 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043228609999999999 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962659+0000", 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1937999999999999e-05 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962685+0000", 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5965999999999998e-05 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.065 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 3832951~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0133153159999999, 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02140597, 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.29e-07 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941336+0000", 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7589999999999999e-06 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941339+0000", 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.32e-06 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941344+0000", 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3329999999999998e-06 2024-09-12T22:11:21.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957172+0000", 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015828466999999999 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957214+0000", 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2302000000000003e-05 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957284+0000", 2024-09-12T22:11:21.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9183999999999994e-05 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959600+0000", 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002316163 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962689+0000", 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030895430000000002 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:21.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962712+0000", 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2962000000000001e-05 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962738+0000", 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5707999999999998e-05 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.071 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:21.073 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:21.074 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:21.072+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:21.173 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:21.173+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:8961 4.18 4:19938cf9:::1000000290a.00000000:head [write 0~5555 in=5555b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:21.185628+0000", 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0018464600000000001, 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018689900000000001, 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.188 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 8961 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185628+0000", 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185628+0000", 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185629+0000", 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.16e-07 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185636+0000", 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6350000000000006e-06 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185647+0000", 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0866999999999999e-05 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185652+0000", 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0880000000000002e-06 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185694+0000", 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2051000000000001e-05 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185769+0000", 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4949000000000004e-05 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.185844+0000", 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5296999999999994e-05 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:21.186727+0000", 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088210899999999995 2024-09-12T22:11:21.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.193 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.193 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.193 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.193 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:11:21.193 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:11:21.193 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:21.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:21.282 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:21.281+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:21.348 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:21.349 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:21.349 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:21.349 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:21.349 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:21.358 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:21.376 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:21.375+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:21.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:11:21.477 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:21.476+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:21.520 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:21.520 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:21.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:21.520 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.557099101999995, 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:21.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.527 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.557043101000005, 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:21.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.557010484000003, 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:21.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:21.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.540 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556983815999999, 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:21.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:21.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556914602999996, 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:21.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556868073999993, 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:21.554 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:21.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:21.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556838995999996, 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.561 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:21.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:21.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.567 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556813038000001, 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556741783999996, 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:21.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:21.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:21.581 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556704601000007, 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:21.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:21.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:21.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556616402000003, 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:21.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.594 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556513706999993, 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:21.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:21.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 90.556405251000001, 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:21.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:21.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7959635629999999, 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.607 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:21.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:21.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7839009649999999, 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:21.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:21.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5101 4.c 4:30c8de84:::100000017cb.00000000:head [write 0~2007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7768725659999998, 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023543338, 2024-09-12T22:11:21.619 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5101 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738041+0000", 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.113e-06 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738048+0000", 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3629999999999999e-06 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738063+0000", 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5557e-05 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738071+0000", 2024-09-12T22:11:21.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2870000000000004e-06 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738109+0000", 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7239e-05 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738186+0000", 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7410000000000006e-05 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738260+0000", 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3590000000000005e-05 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738823+0000", 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056369500000000002 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761536+0000", 2024-09-12T22:11:21.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022712663000000001 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761563+0000", 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7056e-05 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761584+0000", 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0364999999999999e-05 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5102 4.1b 4:d8bd0ea8:::100000017cc.00000000:head [write 0~1672] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7759962800000002, 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024115083999999998, 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.626 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5102 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738917+0000", 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738922+0000", 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1139999999999997e-06 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738935+0000", 2024-09-12T22:11:21.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2700999999999999e-05 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738944+0000", 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738994+0000", 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0522000000000002e-05 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739117+0000", 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012277699999999999 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739243+0000", 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012553999999999999 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741532+0000", 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022895739999999999 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762948+0000", 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021415500000000001 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762994+0000", 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763032+0000", 2024-09-12T22:11:21.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7469000000000003e-05 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5104 4.c 4:331706eb:::100000017ce.00000000:head [write 0~1330] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7742090939999997, 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022240794000000001, 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.632 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5104 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740705+0000", 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0400000000000005e-07 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740710+0000", 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1660000000000002e-06 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740724+0000", 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3869999999999999e-05 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740731+0000", 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7500000000000003e-06 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740768+0000", 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740863+0000", 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4761999999999998e-05 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740937+0000", 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4228999999999997e-05 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741834+0000", 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00089672700000000005 2024-09-12T22:11:21.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762894+0000", 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021059873999999999 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762922+0000", 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7960999999999999e-05 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762944+0000", 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2583e-05 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5105 4.20 4:054a3248:::100000017cf.00000000:head [write 0~2450] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7732068309999995, 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021353684000000001, 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.638 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5105 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:21.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741707+0000", 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6300000000000004e-07 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741712+0000", 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2349999999999999e-06 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741725+0000", 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2529e-05 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741734+0000", 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0589999999999992e-06 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741790+0000", 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6150999999999998e-05 2024-09-12T22:11:21.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741913+0000", 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012315500000000001 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742042+0000", 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012935799999999999 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742684+0000", 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00064220599999999998 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762976+0000", 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020292039000000001 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763013+0000", 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6634999999999997e-05 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763060+0000", 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6453999999999999e-05 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5108 4.20 4:05323f20:::100000017d2.00000000:head [write 0~6203] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.770445198, 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018849817000000001, 2024-09-12T22:11:21.644 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5108 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:21.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744477+0000", 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6659999999999997e-06 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744491+0000", 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3658999999999999e-05 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744496+0000", 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4099999999999999e-06 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744539+0000", 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3409999999999999e-05 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744626+0000", 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6475000000000001e-05 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744707+0000", 2024-09-12T22:11:21.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1248999999999994e-05 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.745240+0000", 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053252799999999999 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763251+0000", 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018011454999999999 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763277+0000", 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5432999999999999e-05 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763317+0000", 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0757000000000003e-05 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:21.650 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:21.652 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:21.651+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:21.653 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:21.753 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:21.752+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:21.762 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:21.762 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:21.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:9410 4.3f 4:fe4683b3:::10000002b2c.00000000:head [write 0~7876 in=7876b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:21.761810+0000", 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00043268499999999998, 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044995099999999998, 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 9410 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761810+0000", 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761810+0000", 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:21.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761811+0000", 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761818+0000", 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8180000000000004e-06 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761827+0000", 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6580000000000008e-06 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761832+0000", 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5329999999999996e-06 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761872+0000", 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0040000000000003e-05 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:21.761991+0000", 2024-09-12T22:11:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011937700000000001 2024-09-12T22:11:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-09-12T22:11:21.767 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:21.772 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:21.854 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:21.853+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:21.885 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:21.886 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:21.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:21.981 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:21.980+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:22.049 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:22.049 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:22.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:22.049 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.3278541119999998, 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:22.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:22.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:22.054 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.3272531780000003, 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:22.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.3156920530000003, 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:22.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.064 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 3788828~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1159557979999999, 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021405258, 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931169+0000", 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931172+0000", 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5839999999999999e-06 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931175+0000", 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.57e-06 2024-09-12T22:11:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.947825+0000", 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016650323000000002 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.947898+0000", 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2898000000000006e-05 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948006+0000", 2024-09-12T22:11:22.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108378 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951454+0000", 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034474459999999998 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952528+0000", 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010737660000000001 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952552+0000", 2024-09-12T22:11:22.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4919999999999999e-05 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952570+0000", 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 3790232~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:22.070 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1159431629999998, 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021480683, 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:22.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931179+0000", 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.333e-06 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931182+0000", 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.01e-06 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931185+0000", 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.345e-06 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948285+0000", 2024-09-12T22:11:22.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017100317 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948324+0000", 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8936999999999997e-05 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948386+0000", 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2094999999999994e-05 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951457+0000", 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030707849999999999 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952603+0000", 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001146418 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952631+0000", 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7535e-05 2024-09-12T22:11:22.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952658+0000", 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7662999999999999e-05 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 3791637~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1159335380000002, 2024-09-12T22:11:22.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021574553, 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:22.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931188+0000", 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-07 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931189+0000", 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3829999999999999e-06 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931192+0000", 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931194+0000", 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3580000000000001e-06 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948593+0000", 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017398825 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948668+0000", 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4889999999999996e-05 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948781+0000", 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011338800000000001 2024-09-12T22:11:22.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951460+0000", 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026785770000000001 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952686+0000", 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012264750000000001 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952729+0000", 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2682999999999998e-05 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952762+0000", 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2872e-05 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 3793036~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1159240080000004, 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021643235, 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.04e-07 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931200+0000", 2024-09-12T22:11:22.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0350000000000002e-06 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931203+0000", 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.021e-06 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931205+0000", 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949280+0000", 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018074702000000002 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949360+0000", 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9987000000000005e-05 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949472+0000", 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111439 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951465+0000", 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019930199999999999 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952793+0000", 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013284219999999999 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952822+0000", 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558e-05 2024-09-12T22:11:22.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952840+0000", 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8454e-05 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 3794435~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1159125630000002, 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021727666999999999, 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931210+0000", 2024-09-12T22:11:22.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4610000000000001e-06 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931213+0000", 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8899999999999999e-06 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931215+0000", 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.447e-06 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949786+0000", 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018570768000000001 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949861+0000", 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5154999999999994e-05 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949984+0000", 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012320199999999999 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952074+0000", 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020892380000000002 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952871+0000", 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00079710999999999996 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952907+0000", 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6049e-05 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952936+0000", 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9130999999999999e-05 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.094 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 3795856~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1159029079999998, 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021812946, 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0800000000000001e-07 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931221+0000", 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8219999999999998e-06 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931227+0000", 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931229+0000", 2024-09-12T22:11:22.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7180000000000001e-06 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950607+0000", 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019377976000000002 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950649+0000", 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1968000000000002e-05 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950719+0000", 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9245000000000005e-05 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952304+0000", 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00158519 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952974+0000", 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00066995900000000003 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953003+0000", 2024-09-12T22:11:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9184e-05 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953031+0000", 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8014999999999999e-05 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 3797262~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1158886849999998, 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021906492999999999, 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931234+0000", 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.404e-06 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931237+0000", 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931239+0000", 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4260000000000002e-06 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951070+0000", 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019830711000000001 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951151+0000", 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1200999999999997e-05 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951248+0000", 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6430999999999999e-05 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952498+0000", 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012502710000000001 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953074+0000", 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057586699999999998 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953115+0000", 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1817000000000003e-05 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953139+0000", 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3187999999999999e-05 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 3798667~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1158791770000001, 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021993792000000002, 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931243+0000", 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5820000000000001e-06 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931246+0000", 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9059999999999998e-06 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931249+0000", 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951505+0000", 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020255813000000001 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951578+0000", 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3119000000000002e-05 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951691+0000", 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113177 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952502+0000", 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00081045499999999996 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953182+0000", 2024-09-12T22:11:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068051099999999996 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953216+0000", 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3708999999999999e-05 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953235+0000", 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9497e-05 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 3800068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1158668499999997, 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024017679, 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-07 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931256+0000", 2024-09-12T22:11:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7e-06 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931261+0000", 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2179999999999998e-06 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931266+0000", 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953273+0000", 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022006537999999999 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953326+0000", 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3256e-05 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953415+0000", 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8657000000000002e-05 2024-09-12T22:11:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954136+0000", 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072149300000000003 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955218+0000", 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010819110000000001 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955249+0000", 2024-09-12T22:11:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0542e-05 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955272+0000", 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3037999999999999e-05 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1158485640000002, 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1158267149999999, 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.115811925, 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1158020559999997, 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1157879700000004, 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 3808482~22555 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1058407770000001, 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021352561999999999, 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941281+0000", 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941297+0000", 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5633000000000001e-05 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941305+0000", 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2749999999999995e-06 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941310+0000", 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9300000000000002e-06 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956248+0000", 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014938338000000001 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956286+0000", 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7968e-05 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956348+0000", 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1486000000000001e-05 2024-09-12T22:11:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957884+0000", 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015358660000000001 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962581+0000", 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046975039999999999 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962604+0000", 2024-09-12T22:11:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2938999999999998e-05 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962633+0000", 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8515999999999999e-05 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 3831037~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1058014509999996, 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021365658999999999, 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941320+0000", 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-07 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941322+0000", 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941326+0000", 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7479999999999999e-06 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941328+0000", 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7429999999999998e-06 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956691+0000", 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015363086999999999 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956765+0000", 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3054999999999998e-05 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956880+0000", 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115322 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.958314+0000", 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001434446 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962637+0000", 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043228609999999999 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962659+0000", 2024-09-12T22:11:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1937999999999999e-05 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962685+0000", 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5965999999999998e-05 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 3832951~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1057887979999999, 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02140597, 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.29e-07 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941336+0000", 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7589999999999999e-06 2024-09-12T22:11:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941339+0000", 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.32e-06 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941344+0000", 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3329999999999998e-06 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957172+0000", 2024-09-12T22:11:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015828466999999999 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957214+0000", 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2302000000000003e-05 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957284+0000", 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9183999999999994e-05 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959600+0000", 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002316163 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962689+0000", 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030895430000000002 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962712+0000", 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2962000000000001e-05 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962738+0000", 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5707999999999998e-05 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:22.167 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:22.168 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-09-12T22:11:22.168 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:22.167+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:22.169 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:22.269 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:22.268+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:22.276 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:9792 4.30 4:0e86e31f:::10000002cf7.00000000:head [write 0~1819 in=1819b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:22.272842+0000", 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0035745880000000001, 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035949089999999999, 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9792 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.272842+0000", 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.272842+0000", 2024-09-12T22:11:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.272843+0000", 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5000000000000001e-07 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.272848+0000", 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7790000000000003e-06 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.272860+0000", 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2753e-05 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.272868+0000", 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8229999999999995e-06 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.272919+0000", 2024-09-12T22:11:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0488999999999997e-05 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.273003+0000", 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4438999999999996e-05 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.273079+0000", 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.627e-05 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:9794 4.18 4:1be44760:::10000002cf9.00000000:head [write 0~2516 in=2516b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:22.274506+0000", 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.001910707, 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019931749999999998, 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9794 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274506+0000", 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274506+0000", 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274507+0000", 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2699999999999998e-07 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274511+0000", 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.763e-06 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274524+0000", 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2802e-05 2024-09-12T22:11:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274533+0000", 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8859999999999993e-06 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274617+0000", 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3891e-05 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274701+0000", 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4202999999999993e-05 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.274782+0000", 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0488999999999995e-05 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:9795 4.e 4:73aad897:::10000002cfa.00000000:head [write 0~1460 in=1460b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:22.275359+0000", 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.001057328, 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001196384, 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9795 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:22.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275359+0000", 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275359+0000", 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275360+0000", 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0999999999999997e-07 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275365+0000", 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8509999999999998e-06 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275376+0000", 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1484000000000001e-05 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275384+0000", 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7999999999999999e-06 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275430+0000", 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6263000000000001e-05 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.275513+0000", 2024-09-12T22:11:22.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2887999999999997e-05 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4487.0:9796 4.b e50/17 4:d1c81378:::10000002cfb.00000000:head v 50'168, mlcod=50'166)", 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:22.276478+0000", 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4294967295.999938, 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011319000000000001, 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276478+0000", 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276478+0000", 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276479+0000", 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4099999999999998e-07 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276485+0000", 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6439999999999997e-06 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276495+0000", 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9490000000000008e-06 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276501+0000", 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7469999999999999e-06 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276546+0000", 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4549999999999999e-05 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:22.276565+0000", 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9392999999999999e-05 2024-09-12T22:11:22.294 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.295 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:22.295 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.295 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:22.295 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:11:22.295 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 4 2024-09-12T22:11:22.295 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:22.296 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:22.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:22.379 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:22.378+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:22.447 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:22.447 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:22.447 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:22.447 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:22.447 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:22.456 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:22.468 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:22.469 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:22.471 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:22.470+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:22.490 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:22.490 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:22.494 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:22.494 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:22.512 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:11:22.572 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:22.571+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:22.605 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:22.606 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:22.615 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:22.673 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:22.672+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:22.736 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:22.774 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:22.773+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:22.858 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:22.874 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:22.874+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:22.966 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:22.966 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:22.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:22.976 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:22.974+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:23.076 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:23.076+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:23.089 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:23.089 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:23.099 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:23.148 INFO:tasks.workunit.client.0.smithi019.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-12T22:11:23.151 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:11:23.151 INFO:tasks.workunit.client.0.smithi019.stderr:+ make 2024-09-12T22:11:23.171 INFO:tasks.workunit.client.0.smithi019.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-12T22:11:23.184 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:23.183+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:23.244 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:23.244 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:23.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:23.294 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:23.293+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:23.379 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:23.379+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:23.396 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:23.396 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:23.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:23.434 INFO:tasks.workunit.client.0.smithi019.stderr:++ readlink -f fsstress 2024-09-12T22:11:23.435 INFO:tasks.workunit.client.0.smithi019.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-12T22:11:23.435 INFO:tasks.workunit.client.0.smithi019.stderr:+ popd 2024-09-12T22:11:23.436 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:11:23.436 INFO:tasks.workunit.client.0.smithi019.stderr:+ popd 2024-09-12T22:11:23.436 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:11:23.437 INFO:tasks.workunit.client.0.smithi019.stderr:++ mktemp -d -p . 2024-09-12T22:11:23.438 INFO:tasks.workunit.client.0.smithi019.stderr:+ T=./tmp.9UfnLYadXw 2024-09-12T22:11:23.438 INFO:tasks.workunit.client.0.smithi019.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.9UfnLYadXw -l 1 -n 1000 -p 10 -v 2024-09-12T22:11:23.440 INFO:tasks.workunit.client.0.smithi019.stdout:seed = 1726337380 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/0: dread - no filename 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/1: dwrite - no filename 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/2: chown . 479 1 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/3: link - no file 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/4: fsync - no filename 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/5: truncate - no filename 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/6: read - no filename 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/7: dread - no filename 2024-09-12T22:11:23.441 INFO:tasks.workunit.client.0.smithi019.stdout:0/8: stat - no entries 2024-09-12T22:11:23.442 INFO:tasks.workunit.client.0.smithi019.stdout:0/9: write - no filename 2024-09-12T22:11:23.442 INFO:tasks.workunit.client.0.smithi019.stdout:1/0: dread - no filename 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:0/10: creat f0 x:0 0 0 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:2/0: rmdir - no directory 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:1/1: creat f0 x:0 0 0 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:1/2: rmdir - no directory 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:0/11: mknod c1 0 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/0: rename - no filename 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/1: rename - no filename 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/2: fsync - no filename 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/3: write - no filename 2024-09-12T22:11:23.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/4: dread - no filename 2024-09-12T22:11:23.444 INFO:tasks.workunit.client.0.smithi019.stdout:3/5: chown . 43648 1 2024-09-12T22:11:23.444 INFO:tasks.workunit.client.0.smithi019.stdout:3/6: dwrite - no filename 2024-09-12T22:11:23.444 INFO:tasks.workunit.client.0.smithi019.stdout:3/7: write - no filename 2024-09-12T22:11:23.444 INFO:tasks.workunit.client.0.smithi019.stdout:1/3: truncate f0 3092 0 2024-09-12T22:11:23.444 INFO:tasks.workunit.client.0.smithi019.stdout:2/1: mkdir d0 0 2024-09-12T22:11:23.444 INFO:tasks.workunit.client.0.smithi019.stdout:0/12: read - f0 zero size 2024-09-12T22:11:23.444 INFO:tasks.workunit.client.0.smithi019.stdout:1/4: mkdir d1 0 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:0/13: dread - f0 zero size 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:3/8: symlink l0 0 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:3/9: dwrite - no filename 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:0/14: readlink - no filename 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:0/15: rmdir - no directory 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:0/16: readlink - no filename 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:5/0: write - no filename 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:5/1: dwrite - no filename 2024-09-12T22:11:23.447 INFO:tasks.workunit.client.0.smithi019.stdout:5/2: read - no filename 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:5/3: write - no filename 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:5/4: stat - no entries 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:5/5: link - no file 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:2/2: symlink d0/l1 0 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:4/0: mknod c0 0 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:4/1: write - no filename 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:4/2: dread - no filename 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:3/10: creat f1 x:0 0 0 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:6/0: truncate - no filename 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:6/1: write - no filename 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:6/2: rmdir - no directory 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:1/5: mkdir d1/d2 0 2024-09-12T22:11:23.448 INFO:tasks.workunit.client.0.smithi019.stdout:2/3: readlink d0/l1 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:0/17: truncate f0 1014663 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:0/18: readlink - no filename 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:5/6: mkdir d0 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:5/7: truncate - no filename 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:4/3: chown c0 24577 1 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:7/0: truncate - no filename 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:3/11: truncate f1 672685 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:0/19: creat f2 x:0 0 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:2/4: mkdir d0/d2 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:2/5: read - no filename 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:6/3: getdents . 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:1/6: dread f0 [0,4194304] 0 2024-09-12T22:11:23.449 INFO:tasks.workunit.client.0.smithi019.stdout:4/4: rename c0 to c1 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:3/12: truncate f1 747766 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:7/1: symlink l0 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:5/8: creat d0/f1 x:0 0 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:1/7: stat d1/d2 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:0/20: truncate f0 1367598 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:2/6: unlink d0/l1 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:4/5: mknod c2 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:6/4: symlink l0 0 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:6/5: dwrite - no filename 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:6/6: dread - no filename 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:6/7: dread - no filename 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:6/8: write - no filename 2024-09-12T22:11:23.450 INFO:tasks.workunit.client.0.smithi019.stdout:6/9: dread - no filename 2024-09-12T22:11:23.451 INFO:tasks.workunit.client.0.smithi019.stdout:7/2: unlink l0 0 2024-09-12T22:11:23.451 INFO:tasks.workunit.client.0.smithi019.stdout:7/3: dread - no filename 2024-09-12T22:11:23.451 INFO:tasks.workunit.client.0.smithi019.stdout:0/21: chown f2 106926 1 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:8/0: symlink l0 0 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:8/1: dwrite - no filename 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:1/8: symlink d1/l3 0 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:2/7: mkdir d0/d3 0 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:4/6: unlink c2 0 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:8/2: chown l0 270 1 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:0/22: chown f0 1810 1 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:6/10: symlink l1 0 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:2/8: chown d0 38075 1 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:7/4: mknod c1 0 2024-09-12T22:11:23.453 INFO:tasks.workunit.client.0.smithi019.stdout:9/0: getdents . 0 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:9/1: rmdir - no directory 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/3: unlink l0 0 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/4: dread - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/5: dread - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/6: rmdir - no directory 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/7: write - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/8: truncate - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/9: unlink - no file 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/10: dread - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/11: dwrite - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/12: dread - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:6/11: chown l0 28952 1 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:6/12: write - no filename 2024-09-12T22:11:23.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/13: chown . 0 1 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:7/5: rename c1 to c2 0 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:1/9: write f0 [840078,57511] 0 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:8/14: chown . 66415807 1 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:8/15: dread - no filename 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:8/16: unlink - no file 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:8/17: read - no filename 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:9/2: creat f0 x:0 0 0 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:6/13: symlink l2 0 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:2/9: mkdir d0/d2/d4 0 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:2/10: dread - no filename 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:8/18: creat f1 x:0 0 0 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:1/10: mkdir d1/d4 0 2024-09-12T22:11:23.455 INFO:tasks.workunit.client.0.smithi019.stdout:9/3: write f0 [1041973,81555] 0 2024-09-12T22:11:23.456 INFO:tasks.workunit.client.0.smithi019.stdout:1/11: mknod d1/c5 0 2024-09-12T22:11:23.456 INFO:tasks.workunit.client.0.smithi019.stdout:1/12: fdatasync f0 0 2024-09-12T22:11:23.457 INFO:tasks.workunit.client.0.smithi019.stdout:8/19: rename f1 to f2 0 2024-09-12T22:11:23.458 INFO:tasks.workunit.client.0.smithi019.stdout:5/9: dwrite d0/f1 [0,4194304] 0 2024-09-12T22:11:23.458 INFO:tasks.workunit.client.0.smithi019.stdout:1/13: chown d1/d2 38 1 2024-09-12T22:11:23.459 INFO:tasks.workunit.client.0.smithi019.stdout:6/14: link l0 l3 0 2024-09-12T22:11:23.459 INFO:tasks.workunit.client.0.smithi019.stdout:6/15: write - no filename 2024-09-12T22:11:23.459 INFO:tasks.workunit.client.0.smithi019.stdout:8/20: dread - f2 zero size 2024-09-12T22:11:23.459 INFO:tasks.workunit.client.0.smithi019.stdout:8/21: rmdir - no directory 2024-09-12T22:11:23.459 INFO:tasks.workunit.client.0.smithi019.stdout:0/23: dwrite f2 [0,4194304] 0 2024-09-12T22:11:23.459 INFO:tasks.workunit.client.0.smithi019.stdout:2/11: getdents d0/d3 0 2024-09-12T22:11:23.460 INFO:tasks.workunit.client.0.smithi019.stdout:1/14: chown f0 932 1 2024-09-12T22:11:23.460 INFO:tasks.workunit.client.0.smithi019.stdout:7/6: rename c2 to c3 0 2024-09-12T22:11:23.461 INFO:tasks.workunit.client.0.smithi019.stdout:6/16: creat f4 x:0 0 0 2024-09-12T22:11:23.462 INFO:tasks.workunit.client.0.smithi019.stdout:6/17: rmdir - no directory 2024-09-12T22:11:23.463 INFO:tasks.workunit.client.0.smithi019.stdout:2/12: creat d0/d3/f5 x:0 0 0 2024-09-12T22:11:23.463 INFO:tasks.workunit.client.0.smithi019.stdout:6/18: symlink l5 0 2024-09-12T22:11:23.464 INFO:tasks.workunit.client.0.smithi019.stdout:5/10: getdents d0 0 2024-09-12T22:11:23.464 INFO:tasks.workunit.client.0.smithi019.stdout:1/15: truncate f0 170952 0 2024-09-12T22:11:23.464 INFO:tasks.workunit.client.0.smithi019.stdout:6/19: read - f4 zero size 2024-09-12T22:11:23.465 INFO:tasks.workunit.client.0.smithi019.stdout:6/20: rmdir - no directory 2024-09-12T22:11:23.465 INFO:tasks.workunit.client.0.smithi019.stdout:9/4: dwrite f0 [0,4194304] 0 2024-09-12T22:11:23.465 INFO:tasks.workunit.client.0.smithi019.stdout:5/11: stat d0/f1 0 2024-09-12T22:11:23.466 INFO:tasks.workunit.client.0.smithi019.stdout:6/21: dread - f4 zero size 2024-09-12T22:11:23.466 INFO:tasks.workunit.client.0.smithi019.stdout:7/7: rename c3 to c4 0 2024-09-12T22:11:23.467 INFO:tasks.workunit.client.0.smithi019.stdout:7/8: write - no filename 2024-09-12T22:11:23.467 INFO:tasks.workunit.client.0.smithi019.stdout:5/12: creat d0/f2 x:0 0 0 2024-09-12T22:11:23.468 INFO:tasks.workunit.client.0.smithi019.stdout:6/22: fsync f4 0 2024-09-12T22:11:23.468 INFO:tasks.workunit.client.0.smithi019.stdout:1/16: mknod d1/d4/c6 0 2024-09-12T22:11:23.469 INFO:tasks.workunit.client.0.smithi019.stdout:9/5: getdents . 0 2024-09-12T22:11:23.469 INFO:tasks.workunit.client.0.smithi019.stdout:6/23: creat f6 x:0 0 0 2024-09-12T22:11:23.470 INFO:tasks.workunit.client.0.smithi019.stdout:5/13: truncate d0/f2 628384 0 2024-09-12T22:11:23.471 INFO:tasks.workunit.client.0.smithi019.stdout:9/6: symlink l1 0 2024-09-12T22:11:23.471 INFO:tasks.workunit.client.0.smithi019.stdout:6/24: symlink l7 0 2024-09-12T22:11:23.472 INFO:tasks.workunit.client.0.smithi019.stdout:0/24: dwrite f2 [0,4194304] 0 2024-09-12T22:11:23.472 INFO:tasks.workunit.client.0.smithi019.stdout:1/17: getdents d1 0 2024-09-12T22:11:23.472 INFO:tasks.workunit.client.0.smithi019.stdout:7/9: unlink c4 0 2024-09-12T22:11:23.473 INFO:tasks.workunit.client.0.smithi019.stdout:7/10: write - no filename 2024-09-12T22:11:23.473 INFO:tasks.workunit.client.0.smithi019.stdout:8/22: dwrite f2 [0,4194304] 0 2024-09-12T22:11:23.473 INFO:tasks.workunit.client.0.smithi019.stdout:5/14: creat d0/f3 x:0 0 0 2024-09-12T22:11:23.474 INFO:tasks.workunit.client.0.smithi019.stdout:6/25: write f6 [912508,108831] 0 2024-09-12T22:11:23.474 INFO:tasks.workunit.client.0.smithi019.stdout:9/7: unlink l1 0 2024-09-12T22:11:23.474 INFO:tasks.workunit.client.0.smithi019.stdout:0/25: mknod c3 0 2024-09-12T22:11:23.474 INFO:tasks.workunit.client.0.smithi019.stdout:7/11: mknod c5 0 2024-09-12T22:11:23.474 INFO:tasks.workunit.client.0.smithi019.stdout:5/15: creat d0/f4 x:0 0 0 2024-09-12T22:11:23.474 INFO:tasks.workunit.client.0.smithi019.stdout:0/26: chown c1 3372 1 2024-09-12T22:11:23.474 INFO:tasks.workunit.client.0.smithi019.stdout:9/8: creat f2 x:0 0 0 2024-09-12T22:11:23.475 INFO:tasks.workunit.client.0.smithi019.stdout:7/12: creat f6 x:0 0 0 2024-09-12T22:11:23.475 INFO:tasks.workunit.client.0.smithi019.stdout:0/27: write f2 [4438275,74494] 0 2024-09-12T22:11:23.475 INFO:tasks.workunit.client.0.smithi019.stdout:5/16: creat d0/f5 x:0 0 0 2024-09-12T22:11:23.475 INFO:tasks.workunit.client.0.smithi019.stdout:7/13: mknod c7 0 2024-09-12T22:11:23.475 INFO:tasks.workunit.client.0.smithi019.stdout:0/28: write f0 [782608,80047] 0 2024-09-12T22:11:23.476 INFO:tasks.workunit.client.0.smithi019.stdout:0/29: creat f4 x:0 0 0 2024-09-12T22:11:23.477 INFO:tasks.workunit.client.0.smithi019.stdout:0/30: fdatasync f4 0 2024-09-12T22:11:23.477 INFO:tasks.workunit.client.0.smithi019.stdout:7/14: fsync f6 0 2024-09-12T22:11:23.478 INFO:tasks.workunit.client.0.smithi019.stdout:0/31: mkdir d5 0 2024-09-12T22:11:23.480 INFO:tasks.workunit.client.0.smithi019.stdout:7/15: getdents . 0 2024-09-12T22:11:23.480 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:23.479+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:23.482 INFO:tasks.workunit.client.0.smithi019.stdout:7/16: write f6 [692163,119241] 0 2024-09-12T22:11:23.482 INFO:tasks.workunit.client.0.smithi019.stdout:5/17: dwrite d0/f5 [0,4194304] 0 2024-09-12T22:11:23.483 INFO:tasks.workunit.client.0.smithi019.stdout:7/17: mknod c8 0 2024-09-12T22:11:23.484 INFO:tasks.workunit.client.0.smithi019.stdout:1/18: dwrite f0 [0,4194304] 0 2024-09-12T22:11:23.484 INFO:tasks.workunit.client.0.smithi019.stdout:7/18: write f6 [352938,29622] 0 2024-09-12T22:11:23.485 INFO:tasks.workunit.client.0.smithi019.stdout:1/19: creat d1/d2/f7 x:0 0 0 2024-09-12T22:11:23.487 INFO:tasks.workunit.client.0.smithi019.stdout:0/32: dwrite f2 [0,4194304] 0 2024-09-12T22:11:23.487 INFO:tasks.workunit.client.0.smithi019.stdout:1/20: chown d1/c5 95606274 1 2024-09-12T22:11:23.488 INFO:tasks.workunit.client.0.smithi019.stdout:7/19: fsync f6 0 2024-09-12T22:11:23.488 INFO:tasks.workunit.client.0.smithi019.stdout:0/33: link f2 d5/f6 0 2024-09-12T22:11:23.489 INFO:tasks.workunit.client.0.smithi019.stdout:7/20: rename c5 to c9 0 2024-09-12T22:11:23.489 INFO:tasks.workunit.client.0.smithi019.stdout:0/34: mkdir d5/d7 0 2024-09-12T22:11:23.489 INFO:tasks.workunit.client.0.smithi019.stdout:7/21: mkdir da 0 2024-09-12T22:11:23.490 INFO:tasks.workunit.client.0.smithi019.stdout:5/18: dwrite d0/f5 [4194304,4194304] 0 2024-09-12T22:11:23.491 INFO:tasks.workunit.client.0.smithi019.stdout:0/35: creat d5/d7/f8 x:0 0 0 2024-09-12T22:11:23.495 INFO:tasks.workunit.client.0.smithi019.stdout:7/22: dread f6 [0,4194304] 0 2024-09-12T22:11:23.497 INFO:tasks.workunit.client.0.smithi019.stdout:7/23: truncate f6 137620 0 2024-09-12T22:11:23.499 INFO:tasks.workunit.client.0.smithi019.stdout:5/19: dwrite d0/f4 [0,4194304] 0 2024-09-12T22:11:23.500 INFO:tasks.workunit.client.0.smithi019.stdout:0/36: dwrite f2 [0,4194304] 0 2024-09-12T22:11:23.500 INFO:tasks.workunit.client.0.smithi019.stdout:5/20: write d0/f4 [1633370,68985] 0 2024-09-12T22:11:23.500 INFO:tasks.workunit.client.0.smithi019.stdout:5/21: fsync d0/f2 0 2024-09-12T22:11:23.501 INFO:tasks.workunit.client.0.smithi019.stdout:0/37: creat d5/f9 x:0 0 0 2024-09-12T22:11:23.501 INFO:tasks.workunit.client.0.smithi019.stdout:0/38: rename d5/f9 to d5/fa 0 2024-09-12T22:11:23.503 INFO:tasks.workunit.client.0.smithi019.stdout:5/22: truncate d0/f1 625228 0 2024-09-12T22:11:23.504 INFO:tasks.workunit.client.0.smithi019.stdout:5/23: chown d0/f3 106 1 2024-09-12T22:11:23.504 INFO:tasks.workunit.client.0.smithi019.stdout:0/39: truncate f2 2515 0 2024-09-12T22:11:23.505 INFO:tasks.workunit.client.0.smithi019.stdout:0/40: symlink d5/lb 0 2024-09-12T22:11:23.506 INFO:tasks.workunit.client.0.smithi019.stdout:7/24: dwrite f6 [0,4194304] 0 2024-09-12T22:11:23.507 INFO:tasks.workunit.client.0.smithi019.stdout:0/41: dread d5/f6 [0,4194304] 0 2024-09-12T22:11:23.507 INFO:tasks.workunit.client.0.smithi019.stdout:7/25: read f6 [214596,55015] 0 2024-09-12T22:11:23.508 INFO:tasks.workunit.client.0.smithi019.stdout:0/42: chown c1 6 1 2024-09-12T22:11:23.508 INFO:tasks.workunit.client.0.smithi019.stdout:7/26: symlink da/lb 0 2024-09-12T22:11:23.510 INFO:tasks.workunit.client.0.smithi019.stdout:7/27: write f6 [3297369,10244] 0 2024-09-12T22:11:23.513 INFO:tasks.workunit.client.0.smithi019.stdout:0/43: dwrite f4 [0,4194304] 0 2024-09-12T22:11:23.515 INFO:tasks.workunit.client.0.smithi019.stdout:0/44: link c3 d5/d7/cc 0 2024-09-12T22:11:23.516 INFO:tasks.workunit.client.0.smithi019.stdout:7/28: dwrite f6 [0,4194304] 0 2024-09-12T22:11:23.516 INFO:tasks.workunit.client.0.smithi019.stdout:0/45: link f0 d5/fd 0 2024-09-12T22:11:23.516 INFO:tasks.workunit.client.0.smithi019.stdout:7/29: write f6 [5009656,48365] 0 2024-09-12T22:11:23.517 INFO:tasks.workunit.client.0.smithi019.stdout:5/24: truncate d0/f1 323038 0 2024-09-12T22:11:23.517 INFO:tasks.workunit.client.0.smithi019.stdout:5/25: creat d0/f6 x:0 0 0 2024-09-12T22:11:23.517 INFO:tasks.workunit.client.0.smithi019.stdout:0/46: write d5/fd [827616,120996] 0 2024-09-12T22:11:23.518 INFO:tasks.workunit.client.0.smithi019.stdout:5/26: truncate d0/f3 253447 0 2024-09-12T22:11:23.519 INFO:tasks.workunit.client.0.smithi019.stdout:0/47: mkdir d5/d7/de 0 2024-09-12T22:11:23.519 INFO:tasks.workunit.client.0.smithi019.stdout:5/27: mknod d0/c7 0 2024-09-12T22:11:23.520 INFO:tasks.workunit.client.0.smithi019.stdout:0/48: write d5/fa [366879,43509] 0 2024-09-12T22:11:23.520 INFO:tasks.workunit.client.0.smithi019.stdout:0/49: symlink d5/lf 0 2024-09-12T22:11:23.521 INFO:tasks.workunit.client.0.smithi019.stdout:0/50: dread d5/f6 [0,4194304] 0 2024-09-12T22:11:23.522 INFO:tasks.workunit.client.0.smithi019.stdout:7/30: dwrite f6 [0,4194304] 0 2024-09-12T22:11:23.522 INFO:tasks.workunit.client.0.smithi019.stdout:0/51: rmdir d5 39 2024-09-12T22:11:23.522 INFO:tasks.workunit.client.0.smithi019.stdout:7/31: symlink da/lc 0 2024-09-12T22:11:23.523 INFO:tasks.workunit.client.0.smithi019.stdout:7/32: creat da/fd x:0 0 0 2024-09-12T22:11:23.523 INFO:tasks.workunit.client.0.smithi019.stdout:5/28: dread d0/f1 [0,4194304] 0 2024-09-12T22:11:23.523 INFO:tasks.workunit.client.0.smithi019.stdout:7/33: rmdir da 39 2024-09-12T22:11:23.523 INFO:tasks.workunit.client.0.smithi019.stdout:5/29: fsync d0/f6 0 2024-09-12T22:11:23.524 INFO:tasks.workunit.client.0.smithi019.stdout:7/34: chown da/lb 1342 1 2024-09-12T22:11:23.525 INFO:tasks.workunit.client.0.smithi019.stdout:7/35: creat da/fe x:0 0 0 2024-09-12T22:11:23.526 INFO:tasks.workunit.client.0.smithi019.stdout:7/36: unlink da/fe 0 2024-09-12T22:11:23.527 INFO:tasks.workunit.client.0.smithi019.stdout:7/37: rename da to da/df 22 2024-09-12T22:11:23.528 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:23.528 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:23.529 INFO:tasks.workunit.client.0.smithi019.stdout:0/52: dwrite d5/fd [0,4194304] 0 2024-09-12T22:11:23.529 INFO:tasks.workunit.client.0.smithi019.stdout:7/38: rename da/lb to da/l10 0 2024-09-12T22:11:23.531 INFO:tasks.workunit.client.0.smithi019.stdout:5/30: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:11:23.532 INFO:tasks.workunit.client.0.smithi019.stdout:5/31: creat d0/f8 x:0 0 0 2024-09-12T22:11:23.533 INFO:tasks.workunit.client.0.smithi019.stdout:5/32: write d0/f6 [1322701,50852] 0 2024-09-12T22:11:23.534 INFO:tasks.workunit.client.0.smithi019.stdout:5/33: rename d0/f8 to d0/f9 0 2024-09-12T22:11:23.535 INFO:tasks.workunit.client.0.smithi019.stdout:5/34: creat d0/fa x:0 0 0 2024-09-12T22:11:23.536 INFO:tasks.workunit.client.0.smithi019.stdout:7/39: dwrite da/fd [0,4194304] 0 2024-09-12T22:11:23.536 INFO:tasks.workunit.client.0.smithi019.stdout:5/35: truncate d0/f3 600427 0 2024-09-12T22:11:23.537 INFO:tasks.workunit.client.0.smithi019.stdout:7/40: rmdir da 39 2024-09-12T22:11:23.538 INFO:tasks.workunit.client.0.smithi019.stdout:5/36: link d0/f6 d0/fb 0 2024-09-12T22:11:23.538 INFO:tasks.workunit.client.0.smithi019.stdout:5/37: fdatasync d0/f3 0 2024-09-12T22:11:23.538 INFO:tasks.workunit.client.0.smithi019.stdout:7/41: write f6 [2530729,127452] 0 2024-09-12T22:11:23.538 INFO:tasks.workunit.client.0.smithi019.stdout:5/38: chown d0 5719 1 2024-09-12T22:11:23.540 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:23.540 INFO:tasks.workunit.client.0.smithi019.stdout:7/42: write da/fd [5151750,118139] 0 2024-09-12T22:11:23.540 INFO:tasks.workunit.client.0.smithi019.stdout:5/39: write d0/f6 [23638,2616] 0 2024-09-12T22:11:23.541 INFO:tasks.workunit.client.0.smithi019.stdout:5/40: readlink - no filename 2024-09-12T22:11:23.541 INFO:tasks.workunit.client.0.smithi019.stdout:5/41: symlink d0/lc 0 2024-09-12T22:11:23.541 INFO:tasks.workunit.client.0.smithi019.stdout:7/43: write da/fd [112191,38428] 0 2024-09-12T22:11:23.541 INFO:tasks.workunit.client.0.smithi019.stdout:5/42: mknod d0/cd 0 2024-09-12T22:11:23.542 INFO:tasks.workunit.client.0.smithi019.stdout:5/43: chown d0/f9 29799939 1 2024-09-12T22:11:23.542 INFO:tasks.workunit.client.0.smithi019.stdout:5/44: chown d0 28481 1 2024-09-12T22:11:23.545 INFO:tasks.workunit.client.0.smithi019.stdout:5/45: dread d0/f2 [0,4194304] 0 2024-09-12T22:11:23.549 INFO:tasks.workunit.client.0.smithi019.stdout:5/46: dwrite d0/f5 [4194304,4194304] 0 2024-09-12T22:11:23.549 INFO:tasks.workunit.client.0.smithi019.stdout:7/44: dread f6 [4194304,4194304] 0 2024-09-12T22:11:23.549 INFO:tasks.workunit.client.0.smithi019.stdout:5/47: chown d0/f4 26 1 2024-09-12T22:11:23.550 INFO:tasks.workunit.client.0.smithi019.stdout:5/48: rename d0/fb to d0/fe 0 2024-09-12T22:11:23.551 INFO:tasks.workunit.client.0.smithi019.stdout:5/49: readlink d0/lc 0 2024-09-12T22:11:23.551 INFO:tasks.workunit.client.0.smithi019.stdout:5/50: read d0/f2 [244829,42011] 0 2024-09-12T22:11:23.554 INFO:tasks.workunit.client.0.smithi019.stdout:0/53: fsync f0 0 2024-09-12T22:11:23.555 INFO:tasks.workunit.client.0.smithi019.stdout:7/45: dread da/fd [0,4194304] 0 2024-09-12T22:11:23.571 INFO:tasks.workunit.client.0.smithi019.stdout:0/54: mkdir d5/d7/d10 0 2024-09-12T22:11:23.571 INFO:tasks.workunit.client.0.smithi019.stdout:5/51: truncate d0/f2 530581 0 2024-09-12T22:11:23.571 INFO:tasks.workunit.client.0.smithi019.stdout:0/55: write d5/fa [1195176,65932] 0 2024-09-12T22:11:23.575 INFO:tasks.workunit.client.0.smithi019.stdout:7/46: dwrite da/fd [0,4194304] 0 2024-09-12T22:11:23.575 INFO:tasks.workunit.client.0.smithi019.stdout:0/56: rename f2 to d5/d7/f11 0 2024-09-12T22:11:23.575 INFO:tasks.workunit.client.0.smithi019.stdout:7/47: chown c7 9483444 1 2024-09-12T22:11:23.576 INFO:tasks.workunit.client.0.smithi019.stdout:0/57: rename d5/fd to d5/d7/f12 0 2024-09-12T22:11:23.576 INFO:tasks.workunit.client.0.smithi019.stdout:7/48: creat da/f11 x:0 0 0 2024-09-12T22:11:23.576 INFO:tasks.workunit.client.0.smithi019.stdout:7/49: write da/f11 [1008444,103112] 0 2024-09-12T22:11:23.577 INFO:tasks.workunit.client.0.smithi019.stdout:0/58: write d5/d7/f11 [106877,27201] 0 2024-09-12T22:11:23.577 INFO:tasks.workunit.client.0.smithi019.stdout:7/50: rename da to da/d12 22 2024-09-12T22:11:23.577 INFO:tasks.workunit.client.0.smithi019.stdout:0/59: write d5/f6 [1172737,122305] 0 2024-09-12T22:11:23.577 INFO:tasks.workunit.client.0.smithi019.stdout:7/51: write f6 [3193517,95719] 0 2024-09-12T22:11:23.578 INFO:tasks.workunit.client.0.smithi019.stdout:7/52: mkdir da/d13 0 2024-09-12T22:11:23.578 INFO:tasks.workunit.client.0.smithi019.stdout:0/60: symlink d5/d7/de/l13 0 2024-09-12T22:11:23.579 INFO:tasks.workunit.client.0.smithi019.stdout:7/53: unlink f6 0 2024-09-12T22:11:23.579 INFO:tasks.workunit.client.0.smithi019.stdout:0/61: mknod d5/c14 0 2024-09-12T22:11:23.579 INFO:tasks.workunit.client.0.smithi019.stdout:7/54: rename c7 to da/c14 0 2024-09-12T22:11:23.579 INFO:tasks.workunit.client.0.smithi019.stdout:7/55: rmdir da 39 2024-09-12T22:11:23.580 INFO:tasks.workunit.client.0.smithi019.stdout:0/62: write d5/d7/f12 [3264867,124748] 0 2024-09-12T22:11:23.580 INFO:tasks.workunit.client.0.smithi019.stdout:7/56: creat da/d13/f15 x:0 0 0 2024-09-12T22:11:23.581 INFO:tasks.workunit.client.0.smithi019.stdout:7/57: write da/f11 [1953693,13974] 0 2024-09-12T22:11:23.581 INFO:tasks.workunit.client.0.smithi019.stdout:0/63: mknod d5/d7/d10/c15 0 2024-09-12T22:11:23.582 INFO:tasks.workunit.client.0.smithi019.stdout:0/64: rmdir d5/d7 39 2024-09-12T22:11:23.583 INFO:tasks.workunit.client.0.smithi019.stdout:0/65: rmdir d5 39 2024-09-12T22:11:23.584 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:23.583+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:23.589 INFO:tasks.workunit.client.0.smithi019.stdout:5/52: write d0/f2 [1467001,98745] 0 2024-09-12T22:11:23.590 INFO:tasks.workunit.client.0.smithi019.stdout:7/58: rename da/c14 to da/d13/c16 0 2024-09-12T22:11:23.590 INFO:tasks.workunit.client.0.smithi019.stdout:7/59: symlink da/l17 0 2024-09-12T22:11:23.591 INFO:tasks.workunit.client.0.smithi019.stdout:7/60: symlink da/d13/l18 0 2024-09-12T22:11:23.591 INFO:tasks.workunit.client.0.smithi019.stdout:7/61: fdatasync da/f11 0 2024-09-12T22:11:23.592 INFO:tasks.workunit.client.0.smithi019.stdout:7/62: dread - da/d13/f15 zero size 2024-09-12T22:11:23.592 INFO:tasks.workunit.client.0.smithi019.stdout:0/66: dread d5/d7/f12 [0,4194304] 0 2024-09-12T22:11:23.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/63: write da/fd [4347303,23288] 0 2024-09-12T22:11:23.593 INFO:tasks.workunit.client.0.smithi019.stdout:0/67: rmdir d5/d7/d10 39 2024-09-12T22:11:23.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/64: rmdir da 39 2024-09-12T22:11:23.594 INFO:tasks.workunit.client.0.smithi019.stdout:0/68: write f0 [483079,17768] 0 2024-09-12T22:11:23.594 INFO:tasks.workunit.client.0.smithi019.stdout:5/53: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:11:23.595 INFO:tasks.workunit.client.0.smithi019.stdout:0/69: creat d5/f16 x:0 0 0 2024-09-12T22:11:23.595 INFO:tasks.workunit.client.0.smithi019.stdout:5/54: getdents d0 0 2024-09-12T22:11:23.596 INFO:tasks.workunit.client.0.smithi019.stdout:5/55: chown d0/f5 485 1 2024-09-12T22:11:23.596 INFO:tasks.workunit.client.0.smithi019.stdout:0/70: rename f0 to d5/d7/d10/f17 0 2024-09-12T22:11:23.597 INFO:tasks.workunit.client.0.smithi019.stdout:5/56: creat d0/ff x:0 0 0 2024-09-12T22:11:23.597 INFO:tasks.workunit.client.0.smithi019.stdout:0/71: write d5/f6 [163142,13372] 0 2024-09-12T22:11:23.597 INFO:tasks.workunit.client.0.smithi019.stdout:5/57: creat d0/f10 x:0 0 0 2024-09-12T22:11:23.597 INFO:tasks.workunit.client.0.smithi019.stdout:0/72: creat d5/d7/f18 x:0 0 0 2024-09-12T22:11:23.599 INFO:tasks.workunit.client.0.smithi019.stdout:5/58: dread d0/f3 [0,4194304] 0 2024-09-12T22:11:23.600 INFO:tasks.workunit.client.0.smithi019.stdout:5/59: creat d0/f11 x:0 0 0 2024-09-12T22:11:23.600 INFO:tasks.workunit.client.0.smithi019.stdout:5/60: symlink d0/l12 0 2024-09-12T22:11:23.601 INFO:tasks.workunit.client.0.smithi019.stdout:5/61: rename d0/l12 to d0/l13 0 2024-09-12T22:11:23.601 INFO:tasks.workunit.client.0.smithi019.stdout:5/62: chown d0/fe 1458027 1 2024-09-12T22:11:23.602 INFO:tasks.workunit.client.0.smithi019.stdout:5/63: mkdir d0/d14 0 2024-09-12T22:11:23.602 INFO:tasks.workunit.client.0.smithi019.stdout:7/65: read da/f11 [430806,23517] 0 2024-09-12T22:11:23.602 INFO:tasks.workunit.client.0.smithi019.stdout:5/64: readlink d0/lc 0 2024-09-12T22:11:23.602 INFO:tasks.workunit.client.0.smithi019.stdout:7/66: dread - da/d13/f15 zero size 2024-09-12T22:11:23.603 INFO:tasks.workunit.client.0.smithi019.stdout:5/65: rename d0/f1 to d0/f15 0 2024-09-12T22:11:23.603 INFO:tasks.workunit.client.0.smithi019.stdout:7/67: write da/d13/f15 [776236,118933] 0 2024-09-12T22:11:23.603 INFO:tasks.workunit.client.0.smithi019.stdout:7/68: rmdir da 39 2024-09-12T22:11:23.604 INFO:tasks.workunit.client.0.smithi019.stdout:5/66: creat d0/d14/f16 x:0 0 0 2024-09-12T22:11:23.604 INFO:tasks.workunit.client.0.smithi019.stdout:7/69: mkdir da/d19 0 2024-09-12T22:11:23.604 INFO:tasks.workunit.client.0.smithi019.stdout:5/67: creat d0/f17 x:0 0 0 2024-09-12T22:11:23.604 INFO:tasks.workunit.client.0.smithi019.stdout:7/70: chown c8 3068151 1 2024-09-12T22:11:23.605 INFO:tasks.workunit.client.0.smithi019.stdout:7/71: rename da to da/d1a 22 2024-09-12T22:11:23.605 INFO:tasks.workunit.client.0.smithi019.stdout:7/72: rename c9 to da/d13/c1b 0 2024-09-12T22:11:23.605 INFO:tasks.workunit.client.0.smithi019.stdout:7/73: write da/fd [5786675,98522] 0 2024-09-12T22:11:23.606 INFO:tasks.workunit.client.0.smithi019.stdout:7/74: mkdir da/d13/d1c 0 2024-09-12T22:11:23.607 INFO:tasks.workunit.client.0.smithi019.stdout:5/68: getdents d0 0 2024-09-12T22:11:23.607 INFO:tasks.workunit.client.0.smithi019.stdout:5/69: creat d0/f18 x:0 0 0 2024-09-12T22:11:23.609 INFO:tasks.workunit.client.0.smithi019.stdout:5/70: dread d0/f6 [0,4194304] 0 2024-09-12T22:11:23.609 INFO:tasks.workunit.client.0.smithi019.stdout:5/71: write d0/d14/f16 [116723,28774] 0 2024-09-12T22:11:23.610 INFO:tasks.workunit.client.0.smithi019.stdout:5/72: creat d0/f19 x:0 0 0 2024-09-12T22:11:23.610 INFO:tasks.workunit.client.0.smithi019.stdout:5/73: chown d0/f4 274 1 2024-09-12T22:11:23.614 INFO:tasks.workunit.client.0.smithi019.stdout:5/74: dwrite d0/fa [0,4194304] 0 2024-09-12T22:11:23.617 INFO:tasks.workunit.client.0.smithi019.stdout:5/75: dread d0/fe [0,4194304] 0 2024-09-12T22:11:23.618 INFO:tasks.workunit.client.0.smithi019.stdout:5/76: stat d0/fe 0 2024-09-12T22:11:23.618 INFO:tasks.workunit.client.0.smithi019.stdout:5/77: creat d0/d14/f1a x:0 0 0 2024-09-12T22:11:23.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/78: dread d0/f3 [0,4194304] 0 2024-09-12T22:11:23.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/79: chown d0/fa 8098589 1 2024-09-12T22:11:23.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/80: creat d0/f1b x:0 0 0 2024-09-12T22:11:23.626 INFO:tasks.workunit.client.0.smithi019.stdout:5/81: dwrite d0/f10 [0,4194304] 0 2024-09-12T22:11:23.626 INFO:tasks.workunit.client.0.smithi019.stdout:5/82: chown d0/f6 28507 1 2024-09-12T22:11:23.656 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:23.656 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:23.665 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:23.682 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:23.681+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:23.782 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:23.781+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:23.808 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:23.808 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:23.816 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:23.883 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:23.883+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:23.919 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:23.919 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:23.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:23.984 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:23.984+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:24.032 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:24.033 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:24.041 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:24.086 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:24.085+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:24.145 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:24.145 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:24.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:24.198 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:24.197+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:24.257 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:24.258 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:24.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:24.308 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:24.307+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:24.387 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:24.386+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:24.409 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:24.409 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:24.417 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:24.488 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:24.487+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:24.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:24.521 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:24.521 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:24.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:11:24.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:24.589 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:24.588+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:24.639 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:24.640 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:24.640 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:24.640 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:24.649 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:24.658 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:24.664 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:24.664 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:24.689 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:24.689+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:24.753 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:24.753 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:24.753 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:24.753 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:24.753 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:24.762 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:24.806 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:24.805+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:24.867 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:24.867 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.90712001, 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016586654999999999, 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957814+0000", 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957815+0000", 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.592e-06 2024-09-12T22:11:24.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957824+0000", 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3399999999999998e-06 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957835+0000", 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1579999999999999e-05 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957847+0000", 2024-09-12T22:11:24.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2149e-05 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957907+0000", 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9886999999999998e-05 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957912+0000", 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5700000000000003e-06 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.962424+0000", 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045124509999999998 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963607+0000", 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001183091 2024-09-12T22:11:24.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.963845+0000", 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000238077 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969985+0000", 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061392620000000004 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974306+0000", 2024-09-12T22:11:24.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043208819999999998 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974346+0000", 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0197999999999997e-05 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974400+0000", 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4576000000000001e-05 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.874 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.907064008999996, 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016684516, 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957870+0000", 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3600000000000003e-07 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957875+0000", 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0220000000000004e-06 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957884+0000", 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957891+0000", 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5440000000000001e-06 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957982+0000", 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0706999999999997e-05 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957986+0000", 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0759999999999996e-06 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965908+0000", 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079219809999999998 2024-09-12T22:11:24.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966829+0000", 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092117399999999997 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967637+0000", 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00080745299999999997 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971327+0000", 2024-09-12T22:11:24.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036906040000000001 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974451+0000", 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031238590000000001 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974511+0000", 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9679000000000002e-05 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974554+0000", 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3142999999999997e-05 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.907031391999993, 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016795793999999999, 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.881 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957902+0000", 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957903+0000", 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3000000000000001e-07 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957906+0000", 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.676e-06 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957915+0000", 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4419999999999998e-06 2024-09-12T22:11:24.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957920+0000", 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4879999999999998e-06 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958008+0000", 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7119000000000004e-05 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958010+0000", 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9989999999999998e-06 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968002+0000", 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099921890000000003 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968133+0000", 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013107900000000001 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968275+0000", 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141757 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971650+0000", 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003375149 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974615+0000", 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029654939999999999 2024-09-12T22:11:24.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974659+0000", 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3770000000000003e-05 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974698+0000", 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9101999999999999e-05 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.907004724000004, 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:24.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:24.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.894 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906935511, 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:24.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:24.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:24.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906888981999998, 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:24.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906859904000001, 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:24.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906833946000006, 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:24.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:24.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:24.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906762692000001, 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.923 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:24.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:24.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:24.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:24.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:24.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:24.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:24.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:24.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:24.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.932 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.932 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.932 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.932 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906725508999997, 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:24.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:24.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906637309999994, 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016259661000000002, 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958296+0000", 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958297+0000", 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7700000000000004e-07 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958310+0000", 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3512e-05 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958330+0000", 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9779000000000002e-05 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958336+0000", 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8279999999999999e-06 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958411+0000", 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5131999999999998e-05 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958415+0000", 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9899999999999999e-06 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965772+0000", 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073564140000000004 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.965912+0000", 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014018799999999999 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966394+0000", 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048206600000000002 2024-09-12T22:11:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970720+0000", 2024-09-12T22:11:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004325845 2024-09-12T22:11:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974455+0000", 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037348540000000001 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974508+0000", 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3526999999999998e-05 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974556+0000", 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7948999999999998e-05 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.947 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906534614999998, 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016270344999999999, 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958399+0000", 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958400+0000", 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7100000000000002e-07 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958405+0000", 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7239999999999997e-06 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958412+0000", 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6139999999999997e-06 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958418+0000", 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9850000000000003e-06 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958462+0000", 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3764999999999999e-05 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958465+0000", 2024-09-12T22:11:24.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.591e-06 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.966874+0000", 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084082949999999997 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967017+0000", 2024-09-12T22:11:24.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014333400000000001 2024-09-12T22:11:24.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.967340+0000", 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032316000000000002 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970727+0000", 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003386975 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974612+0000", 2024-09-12T22:11:24.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038849650000000002 2024-09-12T22:11:24.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974644+0000", 2024-09-12T22:11:24.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2461e-05 2024-09-12T22:11:24.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974669+0000", 2024-09-12T22:11:24.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4905e-05 2024-09-12T22:11:24.956 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.956 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.956 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.957 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:24.957 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:24.957 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 93.906426159000006, 2024-09-12T22:11:24.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016326145, 2024-09-12T22:11:24.958 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.958 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.958 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:24.958 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958507+0000", 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958508+0000", 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958511+0000", 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8119999999999999e-06 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958533+0000", 2024-09-12T22:11:24.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1868000000000001e-05 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958539+0000", 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958591+0000", 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1280999999999999e-05 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958595+0000", 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0980000000000004e-06 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968073+0000", 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0094781899999999992 2024-09-12T22:11:24.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.968204+0000", 2024-09-12T22:11:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013068800000000001 2024-09-12T22:11:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974834+0000", 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066299360000000003 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.964 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:24.965 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:24.965 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1459844710000002, 2024-09-12T22:11:24.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:24.965 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.966 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.966 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:24.966 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:24.966 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:24.966 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:24.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.967 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:24.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:24.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:24.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1339218730000002, 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:24.974 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5101 4.c 4:30c8de84:::100000017cb.00000000:head [write 0~2007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:24.980 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1268934739999992, 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023543338, 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5101 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738041+0000", 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.113e-06 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738048+0000", 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3629999999999999e-06 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738063+0000", 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5557e-05 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738071+0000", 2024-09-12T22:11:24.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2870000000000004e-06 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738109+0000", 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7239e-05 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738186+0000", 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7410000000000006e-05 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738260+0000", 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3590000000000005e-05 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738823+0000", 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056369500000000002 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761536+0000", 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022712663000000001 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761563+0000", 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7056e-05 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761584+0000", 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0364999999999999e-05 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.986 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5102 4.1b 4:d8bd0ea8:::100000017cc.00000000:head [write 0~1672] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1260171880000005, 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024115083999999998, 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5102 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738917+0000", 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738922+0000", 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1139999999999997e-06 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738935+0000", 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2700999999999999e-05 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738944+0000", 2024-09-12T22:11:24.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738994+0000", 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0522000000000002e-05 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739117+0000", 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012277699999999999 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:24.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739243+0000", 2024-09-12T22:11:24.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012553999999999999 2024-09-12T22:11:24.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:24.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741532+0000", 2024-09-12T22:11:24.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022895739999999999 2024-09-12T22:11:24.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:24.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762948+0000", 2024-09-12T22:11:24.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021415500000000001 2024-09-12T22:11:24.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:24.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762994+0000", 2024-09-12T22:11:24.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:11:24.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763032+0000", 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7469000000000003e-05 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.994 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5104 4.c 4:331706eb:::100000017ce.00000000:head [write 0~1330] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1242300020000009, 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022240794000000001, 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5104 2024-09-12T22:11:24.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.996 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:24.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:24.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:24.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740705+0000", 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0400000000000005e-07 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740710+0000", 2024-09-12T22:11:24.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1660000000000002e-06 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740724+0000", 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3869999999999999e-05 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740731+0000", 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7500000000000003e-06 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:24.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740768+0000", 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740863+0000", 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4761999999999998e-05 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740937+0000", 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4228999999999997e-05 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:24.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741834+0000", 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00089672700000000005 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762894+0000", 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021059873999999999 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762922+0000", 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7960999999999999e-05 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762944+0000", 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2583e-05 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5105 4.20 4:054a3248:::100000017cf.00000000:head [write 0~2450] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1232277390000007, 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021353684000000001, 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:25.001 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5105 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741707+0000", 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6300000000000004e-07 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741712+0000", 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2349999999999999e-06 2024-09-12T22:11:25.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741725+0000", 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2529e-05 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741734+0000", 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0589999999999992e-06 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741790+0000", 2024-09-12T22:11:25.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6150999999999998e-05 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741913+0000", 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012315500000000001 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742042+0000", 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012935799999999999 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:25.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742684+0000", 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00064220599999999998 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762976+0000", 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020292039000000001 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763013+0000", 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6634999999999997e-05 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:25.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763060+0000", 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6453999999999999e-05 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5108 4.20 4:05323f20:::100000017d2.00000000:head [write 0~6203] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1204661060000003, 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018849817000000001, 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.007 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5108 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744477+0000", 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6659999999999997e-06 2024-09-12T22:11:25.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744491+0000", 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3658999999999999e-05 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744496+0000", 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4099999999999999e-06 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744539+0000", 2024-09-12T22:11:25.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3409999999999999e-05 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744626+0000", 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6475000000000001e-05 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744707+0000", 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1248999999999994e-05 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:25.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.745240+0000", 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053252799999999999 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763251+0000", 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018011454999999999 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763277+0000", 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5432999999999999e-05 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763317+0000", 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0757000000000003e-05 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:25.013 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:25.014 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:25.015 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:25.014+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:25.115 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:25.114+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:25.118 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:25.119 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:25.119 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:25.119 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:25.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:25.217 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:25.216+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:25.269 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:25.269 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:25.269 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:25.269 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:25.269 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:25.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:25.321 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:25.320+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:25.359 INFO:tasks.workunit.client.0.smithi019.stdout:3/13: sync 2024-09-12T22:11:25.360 INFO:tasks.workunit.client.0.smithi019.stdout:3/14: unlink l0 0 2024-09-12T22:11:25.362 INFO:tasks.workunit.client.0.smithi019.stdout:3/15: dread f1 [0,4194304] 0 2024-09-12T22:11:25.362 INFO:tasks.workunit.client.0.smithi019.stdout:3/16: rename f1 to f2 0 2024-09-12T22:11:25.363 INFO:tasks.workunit.client.0.smithi019.stdout:3/17: write f2 [1108147,6614] 0 2024-09-12T22:11:25.364 INFO:tasks.workunit.client.0.smithi019.stdout:3/18: creat f3 x:0 0 0 2024-09-12T22:11:25.365 INFO:tasks.workunit.client.0.smithi019.stdout:3/19: link f3 f4 0 2024-09-12T22:11:25.365 INFO:tasks.workunit.client.0.smithi019.stdout:3/20: mknod c5 0 2024-09-12T22:11:25.365 INFO:tasks.workunit.client.0.smithi019.stdout:3/21: chown f2 334305303 1 2024-09-12T22:11:25.366 INFO:tasks.workunit.client.0.smithi019.stdout:3/22: dread - f3 zero size 2024-09-12T22:11:25.372 INFO:tasks.workunit.client.0.smithi019.stdout:3/23: dwrite f4 [0,4194304] 0 2024-09-12T22:11:25.376 INFO:tasks.workunit.client.0.smithi019.stdout:3/24: mknod c6 0 2024-09-12T22:11:25.376 INFO:tasks.workunit.client.0.smithi019.stdout:3/25: rmdir - no directory 2024-09-12T22:11:25.376 INFO:tasks.workunit.client.0.smithi019.stdout:3/26: mkdir d7 0 2024-09-12T22:11:25.376 INFO:tasks.workunit.client.0.smithi019.stdout:3/27: rmdir d7 0 2024-09-12T22:11:25.381 INFO:tasks.workunit.client.0.smithi019.stdout:3/28: dwrite f2 [0,4194304] 0 2024-09-12T22:11:25.386 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.665008898, 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6644079640000005, 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6528468390000004, 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 3788828~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.453110584, 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021405258, 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931165+0000", 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931169+0000", 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931172+0000", 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5839999999999999e-06 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931175+0000", 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.57e-06 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.947825+0000", 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016650323000000002 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.947898+0000", 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2898000000000006e-05 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948006+0000", 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108378 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951454+0000", 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034474459999999998 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952528+0000", 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010737660000000001 2024-09-12T22:11:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952552+0000", 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4919999999999999e-05 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952570+0000", 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 3790232~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.453097949, 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021480683, 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931178+0000", 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931179+0000", 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.333e-06 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931182+0000", 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.01e-06 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931185+0000", 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.345e-06 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948285+0000", 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017100317 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948324+0000", 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8936999999999997e-05 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948386+0000", 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2094999999999994e-05 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951457+0000", 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030707849999999999 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952603+0000", 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001146418 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952631+0000", 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7535e-05 2024-09-12T22:11:25.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952658+0000", 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7662999999999999e-05 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 3791637~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4530883240000003, 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021574553, 2024-09-12T22:11:25.413 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931187+0000", 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931188+0000", 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-07 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931189+0000", 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3829999999999999e-06 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931192+0000", 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:11:25.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931194+0000", 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3580000000000001e-06 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948593+0000", 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017398825 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948668+0000", 2024-09-12T22:11:25.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4889999999999996e-05 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.948781+0000", 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011338800000000001 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951460+0000", 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026785770000000001 2024-09-12T22:11:25.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952686+0000", 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012264750000000001 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952729+0000", 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2682999999999998e-05 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952762+0000", 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2872e-05 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 3793036~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4530787939999996, 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021643235, 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.419 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:25.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931197+0000", 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.04e-07 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931200+0000", 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0350000000000002e-06 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931203+0000", 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.021e-06 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931205+0000", 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949280+0000", 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018074702000000002 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949360+0000", 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9987000000000005e-05 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949472+0000", 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111439 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951465+0000", 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019930199999999999 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952793+0000", 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013284219999999999 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952822+0000", 2024-09-12T22:11:25.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558e-05 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952840+0000", 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8454e-05 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 3794435~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4530673490000003, 2024-09-12T22:11:25.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021727666999999999, 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:25.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931208+0000", 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931210+0000", 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4610000000000001e-06 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931213+0000", 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8899999999999999e-06 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931215+0000", 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.447e-06 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949786+0000", 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018570768000000001 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949861+0000", 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5154999999999994e-05 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.949984+0000", 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012320199999999999 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952074+0000", 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020892380000000002 2024-09-12T22:11:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952871+0000", 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00079710999999999996 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952907+0000", 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6049e-05 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952936+0000", 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9130999999999999e-05 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 3795856~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.453057694, 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021812946, 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:25.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0800000000000001e-07 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931221+0000", 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8219999999999998e-06 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931227+0000", 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931229+0000", 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7180000000000001e-06 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950607+0000", 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019377976000000002 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950649+0000", 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1968000000000002e-05 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950719+0000", 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9245000000000005e-05 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952304+0000", 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00158519 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952974+0000", 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00066995900000000003 2024-09-12T22:11:25.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953003+0000", 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9184e-05 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953031+0000", 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8014999999999999e-05 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 3797262~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.453043471, 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021906492999999999, 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931234+0000", 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.404e-06 2024-09-12T22:11:25.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931237+0000", 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931239+0000", 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4260000000000002e-06 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951070+0000", 2024-09-12T22:11:25.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019830711000000001 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951151+0000", 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1200999999999997e-05 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951248+0000", 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6430999999999999e-05 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952498+0000", 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012502710000000001 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953074+0000", 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057586699999999998 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953115+0000", 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1817000000000003e-05 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953139+0000", 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3187999999999999e-05 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 3798667~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4530339630000002, 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021993792000000002, 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931243+0000", 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5820000000000001e-06 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931246+0000", 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9059999999999998e-06 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931249+0000", 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951505+0000", 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020255813000000001 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951578+0000", 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3119000000000002e-05 2024-09-12T22:11:25.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951691+0000", 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113177 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952502+0000", 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00081045499999999996 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953182+0000", 2024-09-12T22:11:25.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068051099999999996 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953216+0000", 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3708999999999999e-05 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953235+0000", 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9497e-05 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 3800068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4530216359999999, 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024017679, 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:25.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-07 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931256+0000", 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7e-06 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931261+0000", 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2179999999999998e-06 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931266+0000", 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953273+0000", 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022006537999999999 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953326+0000", 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3256e-05 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953415+0000", 2024-09-12T22:11:25.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8657000000000002e-05 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954136+0000", 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072149300000000003 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955218+0000", 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010819110000000001 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955249+0000", 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0542e-05 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955272+0000", 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3037999999999999e-05 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.453 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4530033500000004, 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:25.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.452981501, 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.459 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:25.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:25.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4529667110000002, 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.470 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4529568419999999, 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:25.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:25.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4529427559999997, 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:25.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:25.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 3808482~22555 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4429955630000002, 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021352561999999999, 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:25.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941280+0000", 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941281+0000", 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1069999999999999e-06 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941297+0000", 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5633000000000001e-05 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941305+0000", 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2749999999999995e-06 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941310+0000", 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9300000000000002e-06 2024-09-12T22:11:25.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956248+0000", 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014938338000000001 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956286+0000", 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7968e-05 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956348+0000", 2024-09-12T22:11:25.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1486000000000001e-05 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957884+0000", 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015358660000000001 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962581+0000", 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046975039999999999 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962604+0000", 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2938999999999998e-05 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962633+0000", 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8515999999999999e-05 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:117 3.1f 3:f83d65d8:::200.00000004:head [write 3831037~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.4429562369999998, 2024-09-12T22:11:25.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021365658999999999, 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941319+0000", 2024-09-12T22:11:25.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941320+0000", 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-07 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941322+0000", 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941326+0000", 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7479999999999999e-06 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941328+0000", 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7429999999999998e-06 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956691+0000", 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015363086999999999 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956765+0000", 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3054999999999998e-05 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956880+0000", 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115322 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.958314+0000", 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001434446 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962637+0000", 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043228609999999999 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962659+0000", 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1937999999999999e-05 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962685+0000", 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5965999999999998e-05 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.492 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 3832951~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.442943584, 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02140597, 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941332+0000", 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.29e-07 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941336+0000", 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7589999999999999e-06 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941339+0000", 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.32e-06 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.941344+0000", 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3329999999999998e-06 2024-09-12T22:11:25.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957172+0000", 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015828466999999999 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957214+0000", 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2302000000000003e-05 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957284+0000", 2024-09-12T22:11:25.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9183999999999994e-05 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959600+0000", 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002316163 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962689+0000", 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030895430000000002 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:25.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962712+0000", 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2962000000000001e-05 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962738+0000", 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5707999999999998e-05 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:25.498 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:25.500 INFO:tasks.workunit.client.0.smithi019.stdout:3/29: unlink f2 0 2024-09-12T22:11:25.500 INFO:tasks.workunit.client.0.smithi019.stdout:3/30: dread f3 [0,4194304] 0 2024-09-12T22:11:25.500 INFO:tasks.workunit.client.0.smithi019.stdout:3/31: readlink - no filename 2024-09-12T22:11:25.501 INFO:tasks.workunit.client.0.smithi019.stdout:3/32: creat f8 x:0 0 0 2024-09-12T22:11:25.501 INFO:tasks.workunit.client.0.smithi019.stdout:3/33: dread f4 [0,4194304] 0 2024-09-12T22:11:25.501 INFO:tasks.workunit.client.0.smithi019.stdout:3/34: dread f3 [0,4194304] 0 2024-09-12T22:11:25.501 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:25.502 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:25.499+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:25.503 INFO:tasks.workunit.client.0.smithi019.stdout:4/7: sync 2024-09-12T22:11:25.503 INFO:tasks.workunit.client.0.smithi019.stdout:4/8: truncate - no filename 2024-09-12T22:11:25.504 INFO:tasks.workunit.client.0.smithi019.stdout:4/9: creat f3 x:0 0 0 2024-09-12T22:11:25.504 INFO:tasks.workunit.client.0.smithi019.stdout:4/10: truncate f3 134177 0 2024-09-12T22:11:25.505 INFO:tasks.workunit.client.0.smithi019.stdout:4/11: rename f3 to f4 0 2024-09-12T22:11:25.505 INFO:tasks.workunit.client.0.smithi019.stdout:4/12: creat f5 x:0 0 0 2024-09-12T22:11:25.506 INFO:tasks.workunit.client.0.smithi019.stdout:4/13: link f5 f6 0 2024-09-12T22:11:25.506 INFO:tasks.workunit.client.0.smithi019.stdout:4/14: stat c1 0 2024-09-12T22:11:25.513 INFO:tasks.workunit.client.0.smithi019.stdout:4/15: dwrite f6 [0,4194304] 0 2024-09-12T22:11:25.515 INFO:tasks.workunit.client.0.smithi019.stdout:4/16: creat f7 x:0 0 0 2024-09-12T22:11:25.517 INFO:tasks.workunit.client.0.smithi019.stdout:4/17: symlink l8 0 2024-09-12T22:11:25.517 INFO:tasks.workunit.client.0.smithi019.stdout:4/18: truncate f4 934099 0 2024-09-12T22:11:25.518 INFO:tasks.workunit.client.0.smithi019.stdout:4/19: mkdir d9 0 2024-09-12T22:11:25.523 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:11:25.524 INFO:tasks.workunit.client.0.smithi019.stdout:4/20: fsync f7 0 2024-09-12T22:11:25.531 INFO:tasks.workunit.client.0.smithi019.stdout:4/21: dwrite f5 [4194304,4194304] 0 2024-09-12T22:11:25.532 INFO:tasks.workunit.client.0.smithi019.stdout:4/22: symlink d9/la 0 2024-09-12T22:11:25.532 INFO:tasks.workunit.client.0.smithi019.stdout:4/23: dread - f7 zero size 2024-09-12T22:11:25.533 INFO:tasks.workunit.client.0.smithi019.stdout:4/24: chown c1 313675 1 2024-09-12T22:11:25.534 INFO:tasks.workunit.client.0.smithi019.stdout:4/25: mkdir d9/db 0 2024-09-12T22:11:25.534 INFO:tasks.workunit.client.0.smithi019.stdout:4/26: chown l8 1 1 2024-09-12T22:11:25.535 INFO:tasks.workunit.client.0.smithi019.stdout:4/27: creat d9/fc x:0 0 0 2024-09-12T22:11:25.535 INFO:tasks.workunit.client.0.smithi019.stdout:4/28: fdatasync f4 0 2024-09-12T22:11:25.536 INFO:tasks.workunit.client.0.smithi019.stdout:4/29: link d9/fc d9/db/fd 0 2024-09-12T22:11:25.537 INFO:tasks.workunit.client.0.smithi019.stdout:4/30: write d9/fc [920452,14028] 0 2024-09-12T22:11:25.538 INFO:tasks.workunit.client.0.smithi019.stdout:4/31: write d9/db/fd [1257207,35731] 0 2024-09-12T22:11:25.538 INFO:tasks.workunit.client.0.smithi019.stdout:4/32: mknod d9/db/ce 0 2024-09-12T22:11:25.539 INFO:tasks.workunit.client.0.smithi019.stdout:4/33: unlink l8 0 2024-09-12T22:11:25.544 INFO:tasks.workunit.client.0.smithi019.stdout:4/34: truncate f5 7293217 0 2024-09-12T22:11:25.544 INFO:tasks.workunit.client.0.smithi019.stdout:4/35: creat d9/ff x:0 0 0 2024-09-12T22:11:25.544 INFO:tasks.workunit.client.0.smithi019.stdout:4/36: rmdir d9 39 2024-09-12T22:11:25.545 INFO:tasks.workunit.client.0.smithi019.stdout:4/37: chown d9 4 1 2024-09-12T22:11:25.545 INFO:tasks.workunit.client.0.smithi019.stdout:4/38: truncate f4 1250722 0 2024-09-12T22:11:25.546 INFO:tasks.workunit.client.0.smithi019.stdout:4/39: symlink d9/db/l10 0 2024-09-12T22:11:25.548 INFO:tasks.workunit.client.0.smithi019.stdout:4/40: dread f4 [0,4194304] 0 2024-09-12T22:11:25.548 INFO:tasks.workunit.client.0.smithi019.stdout:4/41: creat d9/db/f11 x:0 0 0 2024-09-12T22:11:25.549 INFO:tasks.workunit.client.0.smithi019.stdout:4/42: chown d9/fc 1338208 1 2024-09-12T22:11:25.549 INFO:tasks.workunit.client.0.smithi019.stdout:4/43: mknod d9/db/c12 0 2024-09-12T22:11:25.549 INFO:tasks.workunit.client.0.smithi019.stdout:4/44: mknod d9/db/c13 0 2024-09-12T22:11:25.550 INFO:tasks.workunit.client.0.smithi019.stdout:4/45: unlink d9/db/f11 0 2024-09-12T22:11:25.550 INFO:tasks.workunit.client.0.smithi019.stdout:4/46: mkdir d9/d14 0 2024-09-12T22:11:25.551 INFO:tasks.workunit.client.0.smithi019.stdout:4/47: unlink d9/db/l10 0 2024-09-12T22:11:25.551 INFO:tasks.workunit.client.0.smithi019.stdout:4/48: chown d9/db/c13 5413998 1 2024-09-12T22:11:25.552 INFO:tasks.workunit.client.0.smithi019.stdout:4/49: rmdir d9/db 39 2024-09-12T22:11:25.552 INFO:tasks.workunit.client.0.smithi019.stdout:4/50: chown f5 16428 1 2024-09-12T22:11:25.555 INFO:tasks.workunit.client.0.smithi019.stdout:4/51: getdents d9 0 2024-09-12T22:11:25.555 INFO:tasks.workunit.client.0.smithi019.stdout:4/52: rename c1 to d9/c15 0 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:7/75: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:1/21: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:8/23: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:0/73: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:3/35: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:6/26: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:2/13: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:9/9: sync 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:9/10: rmdir - no directory 2024-09-12T22:11:25.563 INFO:tasks.workunit.client.0.smithi019.stdout:5/83: sync 2024-09-12T22:11:25.564 INFO:tasks.workunit.client.0.smithi019.stdout:6/27: write f6 [1317607,53106] 0 2024-09-12T22:11:25.564 INFO:tasks.workunit.client.0.smithi019.stdout:0/74: write d5/d7/f18 [973552,40575] 0 2024-09-12T22:11:25.565 INFO:tasks.workunit.client.0.smithi019.stdout:7/76: chown da/d13/f15 51167345 1 2024-09-12T22:11:25.570 INFO:tasks.workunit.client.0.smithi019.stdout:3/36: dread f3 [0,4194304] 0 2024-09-12T22:11:25.574 INFO:tasks.workunit.client.0.smithi019.stdout:5/84: dwrite d0/f1b [0,4194304] 0 2024-09-12T22:11:25.576 INFO:tasks.workunit.client.0.smithi019.stdout:2/14: dwrite d0/d3/f5 [0,4194304] 0 2024-09-12T22:11:25.577 INFO:tasks.workunit.client.0.smithi019.stdout:5/85: chown d0/f19 609838798 1 2024-09-12T22:11:25.579 INFO:tasks.workunit.client.0.smithi019.stdout:7/77: dwrite da/d13/f15 [0,4194304] 0 2024-09-12T22:11:25.587 INFO:tasks.workunit.client.0.smithi019.stdout:8/24: symlink l3 0 2024-09-12T22:11:25.587 INFO:tasks.workunit.client.0.smithi019.stdout:1/22: rename f0 to d1/d4/f8 0 2024-09-12T22:11:25.587 INFO:tasks.workunit.client.0.smithi019.stdout:6/28: symlink l8 0 2024-09-12T22:11:25.588 INFO:tasks.workunit.client.0.smithi019.stdout:8/25: chown l3 38694952 1 2024-09-12T22:11:25.588 INFO:tasks.workunit.client.0.smithi019.stdout:3/37: creat f9 x:0 0 0 2024-09-12T22:11:25.588 INFO:tasks.workunit.client.0.smithi019.stdout:2/15: mkdir d0/d6 0 2024-09-12T22:11:25.588 INFO:tasks.workunit.client.0.smithi019.stdout:5/86: creat d0/f1c x:0 0 0 2024-09-12T22:11:25.588 INFO:tasks.workunit.client.0.smithi019.stdout:7/78: creat da/f1d x:0 0 0 2024-09-12T22:11:25.588 INFO:tasks.workunit.client.0.smithi019.stdout:9/11: link f0 f3 0 2024-09-12T22:11:25.589 INFO:tasks.workunit.client.0.smithi019.stdout:0/75: mknod d5/c19 0 2024-09-12T22:11:25.589 INFO:tasks.workunit.client.0.smithi019.stdout:6/29: mkdir d9 0 2024-09-12T22:11:25.589 INFO:tasks.workunit.client.0.smithi019.stdout:9/12: dread - f2 zero size 2024-09-12T22:11:25.589 INFO:tasks.workunit.client.0.smithi019.stdout:1/23: creat d1/f9 x:0 0 0 2024-09-12T22:11:25.590 INFO:tasks.workunit.client.0.smithi019.stdout:3/38: unlink c5 0 2024-09-12T22:11:25.590 INFO:tasks.workunit.client.0.smithi019.stdout:8/26: creat f4 x:0 0 0 2024-09-12T22:11:25.590 INFO:tasks.workunit.client.0.smithi019.stdout:0/76: chown d5/lf 6 1 2024-09-12T22:11:25.591 INFO:tasks.workunit.client.0.smithi019.stdout:0/77: read d5/d7/f18 [372132,28099] 0 2024-09-12T22:11:25.592 INFO:tasks.workunit.client.0.smithi019.stdout:7/79: symlink da/d13/l1e 0 2024-09-12T22:11:25.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/39: rename c6 to ca 0 2024-09-12T22:11:25.593 INFO:tasks.workunit.client.0.smithi019.stdout:2/16: mkdir d0/d2/d4/d7 0 2024-09-12T22:11:25.594 INFO:tasks.workunit.client.0.smithi019.stdout:9/13: dread f0 [0,4194304] 0 2024-09-12T22:11:25.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/80: chown da/f1d 9924 1 2024-09-12T22:11:25.594 INFO:tasks.workunit.client.0.smithi019.stdout:9/14: rmdir - no directory 2024-09-12T22:11:25.594 INFO:tasks.workunit.client.0.smithi019.stdout:0/78: symlink d5/d7/l1a 0 2024-09-12T22:11:25.595 INFO:tasks.workunit.client.0.smithi019.stdout:6/30: dread f6 [0,4194304] 0 2024-09-12T22:11:25.595 INFO:tasks.workunit.client.0.smithi019.stdout:9/15: truncate f2 340622 0 2024-09-12T22:11:25.595 INFO:tasks.workunit.client.0.smithi019.stdout:7/81: write da/f11 [1644194,19150] 0 2024-09-12T22:11:25.595 INFO:tasks.workunit.client.0.smithi019.stdout:7/82: stat da/lc 0 2024-09-12T22:11:25.596 INFO:tasks.workunit.client.0.smithi019.stdout:9/16: write f2 [248640,96532] 0 2024-09-12T22:11:25.596 INFO:tasks.workunit.client.0.smithi019.stdout:7/83: unlink da/fd 0 2024-09-12T22:11:25.598 INFO:tasks.workunit.client.0.smithi019.stdout:3/40: dread f4 [0,4194304] 0 2024-09-12T22:11:25.598 INFO:tasks.workunit.client.0.smithi019.stdout:7/84: write da/f11 [503906,119372] 0 2024-09-12T22:11:25.600 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:25.599+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:25.601 INFO:tasks.workunit.client.0.smithi019.stdout:2/17: dwrite d0/d3/f5 [0,4194304] 0 2024-09-12T22:11:25.601 INFO:tasks.workunit.client.0.smithi019.stdout:9/17: dread f2 [0,4194304] 0 2024-09-12T22:11:25.604 INFO:tasks.workunit.client.0.smithi019.stdout:3/41: creat fb x:0 0 0 2024-09-12T22:11:25.605 INFO:tasks.workunit.client.0.smithi019.stdout:7/85: unlink da/d13/l18 0 2024-09-12T22:11:25.608 INFO:tasks.workunit.client.0.smithi019.stdout:2/18: mknod d0/c8 0 2024-09-12T22:11:25.609 INFO:tasks.workunit.client.0.smithi019.stdout:9/18: rename f2 to f4 0 2024-09-12T22:11:25.610 INFO:tasks.workunit.client.0.smithi019.stdout:8/27: getdents . 0 2024-09-12T22:11:25.610 INFO:tasks.workunit.client.0.smithi019.stdout:5/87: write d0/f15 [1167739,15630] 0 2024-09-12T22:11:25.610 INFO:tasks.workunit.client.0.smithi019.stdout:6/31: truncate f6 280488 0 2024-09-12T22:11:25.611 INFO:tasks.workunit.client.0.smithi019.stdout:0/79: getdents d5/d7 0 2024-09-12T22:11:25.611 INFO:tasks.workunit.client.0.smithi019.stdout:3/42: symlink lc 0 2024-09-12T22:11:25.611 INFO:tasks.workunit.client.0.smithi019.stdout:5/88: readlink d0/l13 0 2024-09-12T22:11:25.612 INFO:tasks.workunit.client.0.smithi019.stdout:3/43: symlink ld 0 2024-09-12T22:11:25.613 INFO:tasks.workunit.client.0.smithi019.stdout:7/86: dwrite da/d13/f15 [0,4194304] 0 2024-09-12T22:11:25.613 INFO:tasks.workunit.client.0.smithi019.stdout:6/32: creat d9/fa x:0 0 0 2024-09-12T22:11:25.613 INFO:tasks.workunit.client.0.smithi019.stdout:0/80: mknod d5/c1b 0 2024-09-12T22:11:25.613 INFO:tasks.workunit.client.0.smithi019.stdout:3/44: truncate f8 735630 0 2024-09-12T22:11:25.613 INFO:tasks.workunit.client.0.smithi019.stdout:5/89: write d0/f2 [1879035,77288] 0 2024-09-12T22:11:25.613 INFO:tasks.workunit.client.0.smithi019.stdout:2/19: getdents d0/d2/d4 0 2024-09-12T22:11:25.614 INFO:tasks.workunit.client.0.smithi019.stdout:0/81: unlink c1 0 2024-09-12T22:11:25.614 INFO:tasks.workunit.client.0.smithi019.stdout:3/45: creat fe x:0 0 0 2024-09-12T22:11:25.614 INFO:tasks.workunit.client.0.smithi019.stdout:7/87: readlink da/d13/l1e 0 2024-09-12T22:11:25.615 INFO:tasks.workunit.client.0.smithi019.stdout:5/90: rmdir d0/d14 39 2024-09-12T22:11:25.615 INFO:tasks.workunit.client.0.smithi019.stdout:6/33: chown l3 1308 1 2024-09-12T22:11:25.615 INFO:tasks.workunit.client.0.smithi019.stdout:2/20: fsync d0/d3/f5 0 2024-09-12T22:11:25.616 INFO:tasks.workunit.client.0.smithi019.stdout:3/46: mknod cf 0 2024-09-12T22:11:25.616 INFO:tasks.workunit.client.0.smithi019.stdout:6/34: fdatasync f4 0 2024-09-12T22:11:25.616 INFO:tasks.workunit.client.0.smithi019.stdout:0/82: write d5/f6 [1032598,81924] 0 2024-09-12T22:11:25.617 INFO:tasks.workunit.client.0.smithi019.stdout:7/88: symlink da/d19/l1f 0 2024-09-12T22:11:25.617 INFO:tasks.workunit.client.0.smithi019.stdout:6/35: dread - f4 zero size 2024-09-12T22:11:25.617 INFO:tasks.workunit.client.0.smithi019.stdout:6/36: write d9/fa [900273,116423] 0 2024-09-12T22:11:25.618 INFO:tasks.workunit.client.0.smithi019.stdout:0/83: fsync d5/d7/f18 0 2024-09-12T22:11:25.620 INFO:tasks.workunit.client.0.smithi019.stdout:4/53: sync 2024-09-12T22:11:25.620 INFO:tasks.workunit.client.0.smithi019.stdout:1/24: sync 2024-09-12T22:11:25.621 INFO:tasks.workunit.client.0.smithi019.stdout:9/19: dwrite f3 [0,4194304] 0 2024-09-12T22:11:25.621 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:25.621 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:25.622 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:25.622 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:25.622 INFO:tasks.workunit.client.0.smithi019.stdout:7/89: fdatasync da/d13/f15 0 2024-09-12T22:11:25.622 INFO:tasks.workunit.client.0.smithi019.stdout:0/84: truncate d5/fa 1380095 0 2024-09-12T22:11:25.622 INFO:tasks.workunit.client.0.smithi019.stdout:1/25: stat d1/c5 0 2024-09-12T22:11:25.623 INFO:tasks.workunit.client.0.smithi019.stdout:4/54: fdatasync f4 0 2024-09-12T22:11:25.623 INFO:tasks.workunit.client.0.smithi019.stdout:6/37: rename f6 to d9/fb 0 2024-09-12T22:11:25.625 INFO:tasks.workunit.client.0.smithi019.stdout:4/55: dread - f7 zero size 2024-09-12T22:11:25.625 INFO:tasks.workunit.client.0.smithi019.stdout:0/85: chown d5/fa 196685678 1 2024-09-12T22:11:25.626 INFO:tasks.workunit.client.0.smithi019.stdout:6/38: mkdir d9/dc 0 2024-09-12T22:11:25.626 INFO:tasks.workunit.client.0.smithi019.stdout:9/20: getdents . 0 2024-09-12T22:11:25.626 INFO:tasks.workunit.client.0.smithi019.stdout:7/90: chown da/d13/c1b 7400819 1 2024-09-12T22:11:25.626 INFO:tasks.workunit.client.0.smithi019.stdout:3/47: dwrite f8 [0,4194304] 0 2024-09-12T22:11:25.627 INFO:tasks.workunit.client.0.smithi019.stdout:5/91: dwrite d0/f1b [4194304,4194304] 0 2024-09-12T22:11:25.628 INFO:tasks.workunit.client.0.smithi019.stdout:0/86: readlink d5/d7/de/l13 0 2024-09-12T22:11:25.628 INFO:tasks.workunit.client.0.smithi019.stdout:9/21: read f4 [267679,92951] 0 2024-09-12T22:11:25.628 INFO:tasks.workunit.client.0.smithi019.stdout:2/21: dwrite d0/d3/f5 [0,4194304] 0 2024-09-12T22:11:25.632 INFO:tasks.workunit.client.0.smithi019.stdout:9/22: creat f5 x:0 0 0 2024-09-12T22:11:25.632 INFO:tasks.workunit.client.0.smithi019.stdout:6/39: link l5 d9/dc/ld 0 2024-09-12T22:11:25.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:25.635 INFO:tasks.workunit.client.0.smithi019.stdout:6/40: chown l7 224079304 1 2024-09-12T22:11:25.635 INFO:tasks.workunit.client.0.smithi019.stdout:9/23: write f3 [871381,91459] 0 2024-09-12T22:11:25.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/87: write d5/d7/f18 [1470807,66854] 0 2024-09-12T22:11:25.638 INFO:tasks.workunit.client.0.smithi019.stdout:9/24: dread - f5 zero size 2024-09-12T22:11:25.638 INFO:tasks.workunit.client.0.smithi019.stdout:4/56: truncate d9/fc 242406 0 2024-09-12T22:11:25.640 INFO:tasks.workunit.client.0.smithi019.stdout:1/26: dwrite d1/d2/f7 [0,4194304] 0 2024-09-12T22:11:25.641 INFO:tasks.workunit.client.0.smithi019.stdout:9/25: creat f6 x:0 0 0 2024-09-12T22:11:25.641 INFO:tasks.workunit.client.0.smithi019.stdout:4/57: chown f6 380 1 2024-09-12T22:11:25.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/27: fsync d1/f9 0 2024-09-12T22:11:25.644 INFO:tasks.workunit.client.0.smithi019.stdout:3/48: dwrite fe [0,4194304] 0 2024-09-12T22:11:25.644 INFO:tasks.workunit.client.0.smithi019.stdout:6/41: truncate d9/fa 488845 0 2024-09-12T22:11:25.645 INFO:tasks.workunit.client.0.smithi019.stdout:7/91: dwrite da/d13/f15 [4194304,4194304] 0 2024-09-12T22:11:25.645 INFO:tasks.workunit.client.0.smithi019.stdout:5/92: dwrite d0/f11 [0,4194304] 0 2024-09-12T22:11:25.646 INFO:tasks.workunit.client.0.smithi019.stdout:2/22: fdatasync d0/d3/f5 0 2024-09-12T22:11:25.647 INFO:tasks.workunit.client.0.smithi019.stdout:7/92: unlink c8 0 2024-09-12T22:11:25.647 INFO:tasks.workunit.client.0.smithi019.stdout:3/49: creat f10 x:0 0 0 2024-09-12T22:11:25.648 INFO:tasks.workunit.client.0.smithi019.stdout:1/28: rename d1/c5 to d1/d2/ca 0 2024-09-12T22:11:25.649 INFO:tasks.workunit.client.0.smithi019.stdout:8/28: sync 2024-09-12T22:11:25.650 INFO:tasks.workunit.client.0.smithi019.stdout:1/29: mknod d1/d4/cb 0 2024-09-12T22:11:25.651 INFO:tasks.workunit.client.0.smithi019.stdout:3/50: write f8 [4317638,85265] 0 2024-09-12T22:11:25.652 INFO:tasks.workunit.client.0.smithi019.stdout:2/23: link d0/d3/f5 d0/f9 0 2024-09-12T22:11:25.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/88: dwrite d5/f16 [0,4194304] 0 2024-09-12T22:11:25.655 INFO:tasks.workunit.client.0.smithi019.stdout:6/42: write d9/fb [894723,79059] 0 2024-09-12T22:11:25.655 INFO:tasks.workunit.client.0.smithi019.stdout:8/29: getdents . 0 2024-09-12T22:11:25.655 INFO:tasks.workunit.client.0.smithi019.stdout:1/30: mkdir d1/d4/dc 0 2024-09-12T22:11:25.655 INFO:tasks.workunit.client.0.smithi019.stdout:9/26: dwrite f0 [0,4194304] 0 2024-09-12T22:11:25.655 INFO:tasks.workunit.client.0.smithi019.stdout:3/51: symlink l11 0 2024-09-12T22:11:25.656 INFO:tasks.workunit.client.0.smithi019.stdout:8/30: fdatasync f4 0 2024-09-12T22:11:25.656 INFO:tasks.workunit.client.0.smithi019.stdout:5/93: truncate d0/f5 5203396 0 2024-09-12T22:11:25.657 INFO:tasks.workunit.client.0.smithi019.stdout:2/24: fsync d0/d3/f5 0 2024-09-12T22:11:25.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/43: write f4 [72060,60942] 0 2024-09-12T22:11:25.657 INFO:tasks.workunit.client.0.smithi019.stdout:4/58: dwrite f6 [0,4194304] 0 2024-09-12T22:11:25.657 INFO:tasks.workunit.client.0.smithi019.stdout:8/31: chown f4 119835021 1 2024-09-12T22:11:25.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/32: rmdir - no directory 2024-09-12T22:11:25.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/33: rmdir - no directory 2024-09-12T22:11:25.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/93: getdents da/d19 0 2024-09-12T22:11:25.658 INFO:tasks.workunit.client.0.smithi019.stdout:1/31: mkdir d1/d4/dd 0 2024-09-12T22:11:25.658 INFO:tasks.workunit.client.0.smithi019.stdout:3/52: dread - f10 zero size 2024-09-12T22:11:25.658 INFO:tasks.workunit.client.0.smithi019.stdout:3/53: dread - f9 zero size 2024-09-12T22:11:25.660 INFO:tasks.workunit.client.0.smithi019.stdout:2/25: creat d0/d2/fa x:0 0 0 2024-09-12T22:11:25.661 INFO:tasks.workunit.client.0.smithi019.stdout:0/89: truncate f4 376024 0 2024-09-12T22:11:25.661 INFO:tasks.workunit.client.0.smithi019.stdout:2/26: chown d0/d3 143 1 2024-09-12T22:11:25.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/94: creat da/d13/d1c/f20 x:0 0 0 2024-09-12T22:11:25.661 INFO:tasks.workunit.client.0.smithi019.stdout:5/94: getdents d0 0 2024-09-12T22:11:25.661 INFO:tasks.workunit.client.0.smithi019.stdout:4/59: chown d9/db/fd 2961130 1 2024-09-12T22:11:25.662 INFO:tasks.workunit.client.0.smithi019.stdout:0/90: mkdir d5/d7/d10/d1c 0 2024-09-12T22:11:25.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/95: chown da/d13/c1b 23474 1 2024-09-12T22:11:25.663 INFO:tasks.workunit.client.0.smithi019.stdout:5/95: mkdir d0/d1d 0 2024-09-12T22:11:25.663 INFO:tasks.workunit.client.0.smithi019.stdout:1/32: dread d1/d4/f8 [0,4194304] 0 2024-09-12T22:11:25.663 INFO:tasks.workunit.client.0.smithi019.stdout:4/60: creat d9/f16 x:0 0 0 2024-09-12T22:11:25.664 INFO:tasks.workunit.client.0.smithi019.stdout:7/96: chown da/d13/c1b 200911 1 2024-09-12T22:11:25.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/91: rename d5/fa to d5/d7/d10/f1d 0 2024-09-12T22:11:25.665 INFO:tasks.workunit.client.0.smithi019.stdout:2/27: link d0/c8 d0/d2/d4/d7/cb 0 2024-09-12T22:11:25.665 INFO:tasks.workunit.client.0.smithi019.stdout:1/33: creat d1/fe x:0 0 0 2024-09-12T22:11:25.665 INFO:tasks.workunit.client.0.smithi019.stdout:3/54: dwrite f10 [0,4194304] 0 2024-09-12T22:11:25.666 INFO:tasks.workunit.client.0.smithi019.stdout:1/34: dread - d1/fe zero size 2024-09-12T22:11:25.666 INFO:tasks.workunit.client.0.smithi019.stdout:1/35: write d1/fe [56754,29213] 0 2024-09-12T22:11:25.667 INFO:tasks.workunit.client.0.smithi019.stdout:7/97: symlink da/d19/l21 0 2024-09-12T22:11:25.668 INFO:tasks.workunit.client.0.smithi019.stdout:6/44: dread f4 [0,4194304] 0 2024-09-12T22:11:25.670 INFO:tasks.workunit.client.0.smithi019.stdout:7/98: mknod da/c22 0 2024-09-12T22:11:25.671 INFO:tasks.workunit.client.0.smithi019.stdout:6/45: write d9/fb [1545913,42003] 0 2024-09-12T22:11:25.671 INFO:tasks.workunit.client.0.smithi019.stdout:0/92: creat d5/f1e x:0 0 0 2024-09-12T22:11:25.671 INFO:tasks.workunit.client.0.smithi019.stdout:3/55: link f9 f12 0 2024-09-12T22:11:25.671 INFO:tasks.workunit.client.0.smithi019.stdout:1/36: mkdir d1/d4/dc/df 0 2024-09-12T22:11:25.672 INFO:tasks.workunit.client.0.smithi019.stdout:5/96: mknod d0/d14/c1e 0 2024-09-12T22:11:25.672 INFO:tasks.workunit.client.0.smithi019.stdout:6/46: mknod d9/ce 0 2024-09-12T22:11:25.673 INFO:tasks.workunit.client.0.smithi019.stdout:3/56: write fe [3870669,14923] 0 2024-09-12T22:11:25.673 INFO:tasks.workunit.client.0.smithi019.stdout:0/93: chown d5/lb 69 1 2024-09-12T22:11:25.673 INFO:tasks.workunit.client.0.smithi019.stdout:1/37: read - d1/f9 zero size 2024-09-12T22:11:25.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/61: dwrite d9/ff [0,4194304] 0 2024-09-12T22:11:25.673 INFO:tasks.workunit.client.0.smithi019.stdout:7/99: truncate da/f1d 847529 0 2024-09-12T22:11:25.675 INFO:tasks.workunit.client.0.smithi019.stdout:2/28: dwrite d0/d2/fa [0,4194304] 0 2024-09-12T22:11:25.675 INFO:tasks.workunit.client.0.smithi019.stdout:4/62: mkdir d9/d17 0 2024-09-12T22:11:25.675 INFO:tasks.workunit.client.0.smithi019.stdout:6/47: creat d9/dc/ff x:0 0 0 2024-09-12T22:11:25.675 INFO:tasks.workunit.client.0.smithi019.stdout:1/38: read - d1/f9 zero size 2024-09-12T22:11:25.677 INFO:tasks.workunit.client.0.smithi019.stdout:1/39: chown d1/d4 4476244 1 2024-09-12T22:11:25.677 INFO:tasks.workunit.client.0.smithi019.stdout:9/27: fsync f0 0 2024-09-12T22:11:25.678 INFO:tasks.workunit.client.0.smithi019.stdout:6/48: mknod d9/c10 0 2024-09-12T22:11:25.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/40: fdatasync d1/fe 0 2024-09-12T22:11:25.679 INFO:tasks.workunit.client.0.smithi019.stdout:2/29: read d0/d3/f5 [941219,83106] 0 2024-09-12T22:11:25.679 INFO:tasks.workunit.client.0.smithi019.stdout:4/63: readlink d9/la 0 2024-09-12T22:11:25.682 INFO:tasks.workunit.client.0.smithi019.stdout:6/49: creat d9/dc/f11 x:0 0 0 2024-09-12T22:11:25.684 INFO:tasks.workunit.client.0.smithi019.stdout:2/30: chown d0/c8 1 1 2024-09-12T22:11:25.685 INFO:tasks.workunit.client.0.smithi019.stdout:2/31: chown d0 5 1 2024-09-12T22:11:25.686 INFO:tasks.workunit.client.0.smithi019.stdout:6/50: chown d9/fb 1 1 2024-09-12T22:11:25.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/64: symlink d9/d14/l18 0 2024-09-12T22:11:25.689 INFO:tasks.workunit.client.0.smithi019.stdout:1/41: symlink d1/d4/dc/df/l10 0 2024-09-12T22:11:25.689 INFO:tasks.workunit.client.0.smithi019.stdout:0/94: dwrite d5/f1e [0,4194304] 0 2024-09-12T22:11:25.692 INFO:tasks.workunit.client.0.smithi019.stdout:6/51: write d9/dc/ff [620859,99513] 0 2024-09-12T22:11:25.692 INFO:tasks.workunit.client.0.smithi019.stdout:2/32: creat d0/d6/fc x:0 0 0 2024-09-12T22:11:25.693 INFO:tasks.workunit.client.0.smithi019.stdout:1/42: dread - d1/f9 zero size 2024-09-12T22:11:25.693 INFO:tasks.workunit.client.0.smithi019.stdout:7/100: dwrite da/f1d [0,4194304] 0 2024-09-12T22:11:25.694 INFO:tasks.workunit.client.0.smithi019.stdout:3/57: dwrite f4 [4194304,4194304] 0 2024-09-12T22:11:25.694 INFO:tasks.workunit.client.0.smithi019.stdout:5/97: dwrite d0/fe [0,4194304] 0 2024-09-12T22:11:25.694 INFO:tasks.workunit.client.0.smithi019.stdout:8/34: sync 2024-09-12T22:11:25.694 INFO:tasks.workunit.client.0.smithi019.stdout:9/28: dwrite f6 [0,4194304] 0 2024-09-12T22:11:25.695 INFO:tasks.workunit.client.0.smithi019.stdout:7/101: fsync da/f11 0 2024-09-12T22:11:25.696 INFO:tasks.workunit.client.0.smithi019.stdout:3/58: creat f13 x:0 0 0 2024-09-12T22:11:25.696 INFO:tasks.workunit.client.0.smithi019.stdout:6/52: dread - d9/dc/f11 zero size 2024-09-12T22:11:25.697 INFO:tasks.workunit.client.0.smithi019.stdout:9/29: creat f7 x:0 0 0 2024-09-12T22:11:25.697 INFO:tasks.workunit.client.0.smithi019.stdout:0/95: fsync d5/f1e 0 2024-09-12T22:11:25.699 INFO:tasks.workunit.client.0.smithi019.stdout:3/59: write fb [586427,25388] 0 2024-09-12T22:11:25.701 INFO:tasks.workunit.client.0.smithi019.stdout:5/98: creat d0/d1d/f1f x:0 0 0 2024-09-12T22:11:25.701 INFO:tasks.workunit.client.0.smithi019.stdout:9/30: symlink l8 0 2024-09-12T22:11:25.703 INFO:tasks.workunit.client.0.smithi019.stdout:7/102: getdents da/d13/d1c 0 2024-09-12T22:11:25.708 INFO:tasks.workunit.client.0.smithi019.stdout:2/33: dwrite d0/f9 [0,4194304] 0 2024-09-12T22:11:25.708 INFO:tasks.workunit.client.0.smithi019.stdout:4/65: dwrite d9/db/fd [0,4194304] 0 2024-09-12T22:11:25.709 INFO:tasks.workunit.client.0.smithi019.stdout:5/99: rename d0/fa to d0/d1d/f20 0 2024-09-12T22:11:25.710 INFO:tasks.workunit.client.0.smithi019.stdout:6/53: read d9/fb [1184940,25654] 0 2024-09-12T22:11:25.710 INFO:tasks.workunit.client.0.smithi019.stdout:8/35: dread f2 [0,4194304] 0 2024-09-12T22:11:25.711 INFO:tasks.workunit.client.0.smithi019.stdout:1/43: dwrite d1/d4/f8 [0,4194304] 0 2024-09-12T22:11:25.711 INFO:tasks.workunit.client.0.smithi019.stdout:4/66: fsync d9/ff 0 2024-09-12T22:11:25.711 INFO:tasks.workunit.client.0.smithi019.stdout:6/54: read f4 [57523,41348] 0 2024-09-12T22:11:25.712 INFO:tasks.workunit.client.0.smithi019.stdout:2/34: rename d0/f9 to d0/d2/d4/fd 0 2024-09-12T22:11:25.714 INFO:tasks.workunit.client.0.smithi019.stdout:6/55: mkdir d9/d12 0 2024-09-12T22:11:25.715 INFO:tasks.workunit.client.0.smithi019.stdout:6/56: readlink l2 0 2024-09-12T22:11:25.715 INFO:tasks.workunit.client.0.smithi019.stdout:2/35: unlink d0/d3/f5 0 2024-09-12T22:11:25.715 INFO:tasks.workunit.client.0.smithi019.stdout:5/100: truncate d0/d1d/f1f 669794 0 2024-09-12T22:11:25.716 INFO:tasks.workunit.client.0.smithi019.stdout:0/96: dwrite d5/f16 [0,4194304] 0 2024-09-12T22:11:25.716 INFO:tasks.workunit.client.0.smithi019.stdout:9/31: dread f6 [0,4194304] 0 2024-09-12T22:11:25.716 INFO:tasks.workunit.client.0.smithi019.stdout:3/60: dwrite fb [0,4194304] 0 2024-09-12T22:11:25.718 INFO:tasks.workunit.client.0.smithi019.stdout:9/32: fsync f3 0 2024-09-12T22:11:25.718 INFO:tasks.workunit.client.0.smithi019.stdout:4/67: link d9/db/ce d9/db/c19 0 2024-09-12T22:11:25.718 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:25.717+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:25.718 INFO:tasks.workunit.client.0.smithi019.stdout:3/61: chown f8 183 1 2024-09-12T22:11:25.719 INFO:tasks.workunit.client.0.smithi019.stdout:2/36: mknod d0/ce 0 2024-09-12T22:11:25.719 INFO:tasks.workunit.client.0.smithi019.stdout:4/68: unlink f6 0 2024-09-12T22:11:25.719 INFO:tasks.workunit.client.0.smithi019.stdout:6/57: write f4 [249169,58197] 0 2024-09-12T22:11:25.721 INFO:tasks.workunit.client.0.smithi019.stdout:4/69: read - f7 zero size 2024-09-12T22:11:25.722 INFO:tasks.workunit.client.0.smithi019.stdout:0/97: rmdir d5/d7/d10/d1c 0 2024-09-12T22:11:25.722 INFO:tasks.workunit.client.0.smithi019.stdout:8/36: dwrite f4 [0,4194304] 0 2024-09-12T22:11:25.723 INFO:tasks.workunit.client.0.smithi019.stdout:2/37: mkdir d0/d3/df 0 2024-09-12T22:11:25.723 INFO:tasks.workunit.client.0.smithi019.stdout:1/44: dread d1/d2/f7 [0,4194304] 0 2024-09-12T22:11:25.724 INFO:tasks.workunit.client.0.smithi019.stdout:6/58: creat d9/dc/f13 x:0 0 0 2024-09-12T22:11:25.726 INFO:tasks.workunit.client.0.smithi019.stdout:8/37: truncate f2 5084435 0 2024-09-12T22:11:25.727 INFO:tasks.workunit.client.0.smithi019.stdout:1/45: link d1/d2/f7 d1/f11 0 2024-09-12T22:11:25.727 INFO:tasks.workunit.client.0.smithi019.stdout:6/59: write f4 [968472,68397] 0 2024-09-12T22:11:25.728 INFO:tasks.workunit.client.0.smithi019.stdout:2/38: read d0/d2/fa [4010588,8920] 0 2024-09-12T22:11:25.728 INFO:tasks.workunit.client.0.smithi019.stdout:4/70: write f5 [477159,95763] 0 2024-09-12T22:11:25.732 INFO:tasks.workunit.client.0.smithi019.stdout:3/62: dwrite f13 [0,4194304] 0 2024-09-12T22:11:25.732 INFO:tasks.workunit.client.0.smithi019.stdout:1/46: mkdir d1/d4/dd/d12 0 2024-09-12T22:11:25.733 INFO:tasks.workunit.client.0.smithi019.stdout:5/101: dread d0/f1b [4194304,4194304] 0 2024-09-12T22:11:25.733 INFO:tasks.workunit.client.0.smithi019.stdout:9/33: dwrite f3 [0,4194304] 0 2024-09-12T22:11:25.735 INFO:tasks.workunit.client.0.smithi019.stdout:9/34: read f6 [3437992,51016] 0 2024-09-12T22:11:25.736 INFO:tasks.workunit.client.0.smithi019.stdout:4/71: rename d9/db/c13 to d9/c1a 0 2024-09-12T22:11:25.736 INFO:tasks.workunit.client.0.smithi019.stdout:5/102: read - d0/f1c zero size 2024-09-12T22:11:25.737 INFO:tasks.workunit.client.0.smithi019.stdout:1/47: creat d1/d4/dc/df/f13 x:0 0 0 2024-09-12T22:11:25.738 INFO:tasks.workunit.client.0.smithi019.stdout:0/98: dwrite d5/d7/f8 [0,4194304] 0 2024-09-12T22:11:25.738 INFO:tasks.workunit.client.0.smithi019.stdout:9/35: creat f9 x:0 0 0 2024-09-12T22:11:25.739 INFO:tasks.workunit.client.0.smithi019.stdout:2/39: rename d0/d2/d4/fd to d0/d6/f10 0 2024-09-12T22:11:25.741 INFO:tasks.workunit.client.0.smithi019.stdout:1/48: getdents d1 0 2024-09-12T22:11:25.742 INFO:tasks.workunit.client.0.smithi019.stdout:5/103: dread - d0/d14/f1a zero size 2024-09-12T22:11:25.742 INFO:tasks.workunit.client.0.smithi019.stdout:9/36: dread f4 [0,4194304] 0 2024-09-12T22:11:25.743 INFO:tasks.workunit.client.0.smithi019.stdout:0/99: unlink d5/d7/d10/f1d 0 2024-09-12T22:11:25.744 INFO:tasks.workunit.client.0.smithi019.stdout:8/38: dwrite f4 [4194304,4194304] 0 2024-09-12T22:11:25.745 INFO:tasks.workunit.client.0.smithi019.stdout:6/60: dread d9/dc/ff [0,4194304] 0 2024-09-12T22:11:25.745 INFO:tasks.workunit.client.0.smithi019.stdout:2/40: chown d0/d2/fa 425528 1 2024-09-12T22:11:25.748 INFO:tasks.workunit.client.0.smithi019.stdout:9/37: chown l8 0 1 2024-09-12T22:11:25.750 INFO:tasks.workunit.client.0.smithi019.stdout:1/49: readlink d1/d4/dc/df/l10 0 2024-09-12T22:11:25.750 INFO:tasks.workunit.client.0.smithi019.stdout:5/104: mknod d0/c21 0 2024-09-12T22:11:25.751 INFO:tasks.workunit.client.0.smithi019.stdout:9/38: creat fa x:0 0 0 2024-09-12T22:11:25.752 INFO:tasks.workunit.client.0.smithi019.stdout:2/41: write d0/d6/fc [41281,10393] 0 2024-09-12T22:11:25.753 INFO:tasks.workunit.client.0.smithi019.stdout:3/63: dwrite fe [4194304,4194304] 0 2024-09-12T22:11:25.753 INFO:tasks.workunit.client.0.smithi019.stdout:1/50: rename d1/f9 to d1/f14 0 2024-09-12T22:11:25.753 INFO:tasks.workunit.client.0.smithi019.stdout:6/61: dread d9/dc/ff [0,4194304] 0 2024-09-12T22:11:25.754 INFO:tasks.workunit.client.0.smithi019.stdout:9/39: creat fb x:0 0 0 2024-09-12T22:11:25.754 INFO:tasks.workunit.client.0.smithi019.stdout:7/103: dread da/f11 [0,4194304] 0 2024-09-12T22:11:25.754 INFO:tasks.workunit.client.0.smithi019.stdout:5/105: creat d0/d1d/f22 x:0 0 0 2024-09-12T22:11:25.757 INFO:tasks.workunit.client.0.smithi019.stdout:9/40: chown f4 411194 1 2024-09-12T22:11:25.757 INFO:tasks.workunit.client.0.smithi019.stdout:3/64: write fe [1585398,114434] 0 2024-09-12T22:11:25.757 INFO:tasks.workunit.client.0.smithi019.stdout:4/72: dwrite d9/fc [0,4194304] 0 2024-09-12T22:11:25.758 INFO:tasks.workunit.client.0.smithi019.stdout:1/51: symlink d1/d4/l15 0 2024-09-12T22:11:25.758 INFO:tasks.workunit.client.0.smithi019.stdout:9/41: rename f3 to fc 0 2024-09-12T22:11:25.760 INFO:tasks.workunit.client.0.smithi019.stdout:6/62: getdents d9/d12 0 2024-09-12T22:11:25.762 INFO:tasks.workunit.client.0.smithi019.stdout:9/42: fdatasync f6 0 2024-09-12T22:11:25.763 INFO:tasks.workunit.client.0.smithi019.stdout:6/63: chown l8 61241306 1 2024-09-12T22:11:25.763 INFO:tasks.workunit.client.0.smithi019.stdout:8/39: dwrite f2 [0,4194304] 0 2024-09-12T22:11:25.764 INFO:tasks.workunit.client.0.smithi019.stdout:0/100: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:25.765 INFO:tasks.workunit.client.0.smithi019.stdout:9/43: creat fd x:0 0 0 2024-09-12T22:11:25.766 INFO:tasks.workunit.client.0.smithi019.stdout:6/64: creat d9/d12/f14 x:0 0 0 2024-09-12T22:11:25.767 INFO:tasks.workunit.client.0.smithi019.stdout:8/40: chown l3 192 1 2024-09-12T22:11:25.767 INFO:tasks.workunit.client.0.smithi019.stdout:7/104: truncate da/f1d 2360818 0 2024-09-12T22:11:25.768 INFO:tasks.workunit.client.0.smithi019.stdout:3/65: truncate f4 1136244 0 2024-09-12T22:11:25.768 INFO:tasks.workunit.client.0.smithi019.stdout:0/101: dread f4 [0,4194304] 0 2024-09-12T22:11:25.768 INFO:tasks.workunit.client.0.smithi019.stdout:6/65: sync 2024-09-12T22:11:25.768 INFO:tasks.workunit.client.0.smithi019.stdout:8/41: mkdir d5 0 2024-09-12T22:11:25.770 INFO:tasks.workunit.client.0.smithi019.stdout:2/42: dwrite d0/d6/fc [0,4194304] 0 2024-09-12T22:11:25.770 INFO:tasks.workunit.client.0.smithi019.stdout:9/44: link f7 fe 0 2024-09-12T22:11:25.771 INFO:tasks.workunit.client.0.smithi019.stdout:9/45: readlink l8 0 2024-09-12T22:11:25.771 INFO:tasks.workunit.client.0.smithi019.stdout:5/106: dwrite d0/f11 [0,4194304] 0 2024-09-12T22:11:25.773 INFO:tasks.workunit.client.0.smithi019.stdout:2/43: write d0/d6/fc [3162049,77901] 0 2024-09-12T22:11:25.773 INFO:tasks.workunit.client.0.smithi019.stdout:8/42: link f4 d5/f6 0 2024-09-12T22:11:25.773 INFO:tasks.workunit.client.0.smithi019.stdout:4/73: dread d9/db/fd [0,4194304] 0 2024-09-12T22:11:25.773 INFO:tasks.workunit.client.0.smithi019.stdout:9/46: creat ff x:0 0 0 2024-09-12T22:11:25.773 INFO:tasks.workunit.client.0.smithi019.stdout:0/102: write d5/d7/f12 [2612837,32625] 0 2024-09-12T22:11:25.775 INFO:tasks.workunit.client.0.smithi019.stdout:0/103: stat d5/f6 0 2024-09-12T22:11:25.775 INFO:tasks.workunit.client.0.smithi019.stdout:5/107: unlink d0/d1d/f1f 0 2024-09-12T22:11:25.775 INFO:tasks.workunit.client.0.smithi019.stdout:9/47: mknod c10 0 2024-09-12T22:11:25.776 INFO:tasks.workunit.client.0.smithi019.stdout:1/52: dwrite d1/f11 [0,4194304] 0 2024-09-12T22:11:25.777 INFO:tasks.workunit.client.0.smithi019.stdout:9/48: dread - ff zero size 2024-09-12T22:11:25.778 INFO:tasks.workunit.client.0.smithi019.stdout:7/105: truncate da/f1d 1590444 0 2024-09-12T22:11:25.778 INFO:tasks.workunit.client.0.smithi019.stdout:3/66: dread fe [4194304,4194304] 0 2024-09-12T22:11:25.779 INFO:tasks.workunit.client.0.smithi019.stdout:6/66: dwrite f4 [0,4194304] 0 2024-09-12T22:11:25.780 INFO:tasks.workunit.client.0.smithi019.stdout:1/53: symlink d1/d2/l16 0 2024-09-12T22:11:25.781 INFO:tasks.workunit.client.0.smithi019.stdout:5/108: fsync d0/fe 0 2024-09-12T22:11:25.782 INFO:tasks.workunit.client.0.smithi019.stdout:7/106: creat da/d13/d1c/f23 x:0 0 0 2024-09-12T22:11:25.782 INFO:tasks.workunit.client.0.smithi019.stdout:9/49: link fd f11 0 2024-09-12T22:11:25.783 INFO:tasks.workunit.client.0.smithi019.stdout:1/54: rmdir d1/d4/dc/df 39 2024-09-12T22:11:25.783 INFO:tasks.workunit.client.0.smithi019.stdout:9/50: stat fa 0 2024-09-12T22:11:25.784 INFO:tasks.workunit.client.0.smithi019.stdout:6/67: write d9/d12/f14 [789590,16410] 0 2024-09-12T22:11:25.784 INFO:tasks.workunit.client.0.smithi019.stdout:2/44: dread d0/d6/fc [0,4194304] 0 2024-09-12T22:11:25.784 INFO:tasks.workunit.client.0.smithi019.stdout:4/74: dwrite d9/f16 [0,4194304] 0 2024-09-12T22:11:25.784 INFO:tasks.workunit.client.0.smithi019.stdout:3/67: link cf c14 0 2024-09-12T22:11:25.784 INFO:tasks.workunit.client.0.smithi019.stdout:7/107: mkdir da/d24 0 2024-09-12T22:11:25.785 INFO:tasks.workunit.client.0.smithi019.stdout:5/109: mknod d0/c23 0 2024-09-12T22:11:25.785 INFO:tasks.workunit.client.0.smithi019.stdout:1/55: chown d1/fe 25573 1 2024-09-12T22:11:25.785 INFO:tasks.workunit.client.0.smithi019.stdout:9/51: mkdir d12 0 2024-09-12T22:11:25.786 INFO:tasks.workunit.client.0.smithi019.stdout:0/104: dread d5/d7/f12 [0,4194304] 0 2024-09-12T22:11:25.786 INFO:tasks.workunit.client.0.smithi019.stdout:4/75: read d9/db/fd [1950063,127730] 0 2024-09-12T22:11:25.787 INFO:tasks.workunit.client.0.smithi019.stdout:7/108: mkdir da/d19/d25 0 2024-09-12T22:11:25.787 INFO:tasks.workunit.client.0.smithi019.stdout:8/43: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:25.787 INFO:tasks.workunit.client.0.smithi019.stdout:5/110: mkdir d0/d24 0 2024-09-12T22:11:25.788 INFO:tasks.workunit.client.0.smithi019.stdout:2/45: rename d0/d6 to d0/d3/d11 0 2024-09-12T22:11:25.788 INFO:tasks.workunit.client.0.smithi019.stdout:0/105: chown d5/d7/d10/f17 15368 1 2024-09-12T22:11:25.788 INFO:tasks.workunit.client.0.smithi019.stdout:4/76: read d9/db/fd [1854549,41087] 0 2024-09-12T22:11:25.789 INFO:tasks.workunit.client.0.smithi019.stdout:8/44: symlink d5/l7 0 2024-09-12T22:11:25.789 INFO:tasks.workunit.client.0.smithi019.stdout:1/56: chown d1/d4/dc/df/f13 2029103403 1 2024-09-12T22:11:25.789 INFO:tasks.workunit.client.0.smithi019.stdout:3/68: dread f3 [0,4194304] 0 2024-09-12T22:11:25.789 INFO:tasks.workunit.client.0.smithi019.stdout:7/109: write da/f11 [1788510,113163] 0 2024-09-12T22:11:25.789 INFO:tasks.workunit.client.0.smithi019.stdout:9/52: rename l8 to d12/l13 0 2024-09-12T22:11:25.789 INFO:tasks.workunit.client.0.smithi019.stdout:6/68: write d9/fa [85161,116110] 0 2024-09-12T22:11:25.789 INFO:tasks.workunit.client.0.smithi019.stdout:5/111: symlink d0/d14/l25 0 2024-09-12T22:11:25.790 INFO:tasks.workunit.client.0.smithi019.stdout:7/110: readlink da/l17 0 2024-09-12T22:11:25.790 INFO:tasks.workunit.client.0.smithi019.stdout:4/77: creat d9/d14/f1b x:0 0 0 2024-09-12T22:11:25.790 INFO:tasks.workunit.client.0.smithi019.stdout:3/69: creat f15 x:0 0 0 2024-09-12T22:11:25.790 INFO:tasks.workunit.client.0.smithi019.stdout:6/69: dread - d9/dc/f11 zero size 2024-09-12T22:11:25.791 INFO:tasks.workunit.client.0.smithi019.stdout:5/112: mkdir d0/d26 0 2024-09-12T22:11:25.791 INFO:tasks.workunit.client.0.smithi019.stdout:9/53: write f0 [4792640,127824] 0 2024-09-12T22:11:25.791 INFO:tasks.workunit.client.0.smithi019.stdout:3/70: creat f16 x:0 0 0 2024-09-12T22:11:25.792 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:25.792 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:25.792 INFO:tasks.workunit.client.0.smithi019.stdout:0/106: link d5/f16 d5/f1f 0 2024-09-12T22:11:25.793 INFO:tasks.workunit.client.0.smithi019.stdout:6/70: read - d9/dc/f13 zero size 2024-09-12T22:11:25.793 INFO:tasks.workunit.client.0.smithi019.stdout:7/111: rename da/l10 to da/d24/l26 0 2024-09-12T22:11:25.794 INFO:tasks.workunit.client.0.smithi019.stdout:1/57: creat d1/d4/dc/f17 x:0 0 0 2024-09-12T22:11:25.794 INFO:tasks.workunit.client.0.smithi019.stdout:5/113: symlink d0/d14/l27 0 2024-09-12T22:11:25.795 INFO:tasks.workunit.client.0.smithi019.stdout:3/71: truncate f12 1002969 0 2024-09-12T22:11:25.795 INFO:tasks.workunit.client.0.smithi019.stdout:7/112: creat da/d13/f27 x:0 0 0 2024-09-12T22:11:25.796 INFO:tasks.workunit.client.0.smithi019.stdout:0/107: creat d5/d7/de/f20 x:0 0 0 2024-09-12T22:11:25.797 INFO:tasks.workunit.client.0.smithi019.stdout:1/58: fdatasync d1/f14 0 2024-09-12T22:11:25.798 INFO:tasks.workunit.client.0.smithi019.stdout:5/114: symlink d0/d24/l28 0 2024-09-12T22:11:25.798 INFO:tasks.workunit.client.0.smithi019.stdout:3/72: truncate f13 4932278 0 2024-09-12T22:11:25.802 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:25.801+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:25.803 INFO:tasks.workunit.client.0.smithi019.stdout:3/73: chown f4 164 1 2024-09-12T22:11:25.804 INFO:tasks.workunit.client.0.smithi019.stdout:8/45: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:25.807 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:25.809 INFO:tasks.workunit.client.0.smithi019.stdout:2/46: dwrite d0/d3/d11/f10 [4194304,4194304] 0 2024-09-12T22:11:25.811 INFO:tasks.workunit.client.0.smithi019.stdout:4/78: dwrite d9/d14/f1b [0,4194304] 0 2024-09-12T22:11:25.812 INFO:tasks.workunit.client.0.smithi019.stdout:9/54: dwrite f0 [4194304,4194304] 0 2024-09-12T22:11:25.812 INFO:tasks.workunit.client.0.smithi019.stdout:6/71: link d9/d12/f14 d9/dc/f15 0 2024-09-12T22:11:25.812 INFO:tasks.workunit.client.0.smithi019.stdout:8/46: mknod d5/c8 0 2024-09-12T22:11:25.813 INFO:tasks.workunit.client.0.smithi019.stdout:0/108: rename d5/c1b to d5/c21 0 2024-09-12T22:11:25.813 INFO:tasks.workunit.client.0.smithi019.stdout:7/113: getdents da/d13 0 2024-09-12T22:11:25.814 INFO:tasks.workunit.client.0.smithi019.stdout:8/47: write f2 [5923405,7935] 0 2024-09-12T22:11:25.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/72: write d9/dc/f13 [126085,1640] 0 2024-09-12T22:11:25.815 INFO:tasks.workunit.client.0.smithi019.stdout:5/115: getdents d0/d14 0 2024-09-12T22:11:25.815 INFO:tasks.workunit.client.0.smithi019.stdout:4/79: write d9/fc [3986128,114456] 0 2024-09-12T22:11:25.815 INFO:tasks.workunit.client.0.smithi019.stdout:3/74: getdents . 0 2024-09-12T22:11:25.816 INFO:tasks.workunit.client.0.smithi019.stdout:9/55: getdents d12 0 2024-09-12T22:11:25.816 INFO:tasks.workunit.client.0.smithi019.stdout:9/56: readlink d12/l13 0 2024-09-12T22:11:25.816 INFO:tasks.workunit.client.0.smithi019.stdout:7/114: rename da/d13 to da/d24/d28 0 2024-09-12T22:11:25.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/59: dwrite d1/d4/f8 [0,4194304] 0 2024-09-12T22:11:25.817 INFO:tasks.workunit.client.0.smithi019.stdout:6/73: symlink d9/d12/l16 0 2024-09-12T22:11:25.817 INFO:tasks.workunit.client.0.smithi019.stdout:9/57: dread - f5 zero size 2024-09-12T22:11:25.818 INFO:tasks.workunit.client.0.smithi019.stdout:3/75: creat f17 x:0 0 0 2024-09-12T22:11:25.818 INFO:tasks.workunit.client.0.smithi019.stdout:4/80: creat d9/d14/f1c x:0 0 0 2024-09-12T22:11:25.819 INFO:tasks.workunit.client.0.smithi019.stdout:7/115: dread - da/d24/d28/d1c/f23 zero size 2024-09-12T22:11:25.819 INFO:tasks.workunit.client.0.smithi019.stdout:3/76: mkdir d18 0 2024-09-12T22:11:25.819 INFO:tasks.workunit.client.0.smithi019.stdout:8/48: getdents d5 0 2024-09-12T22:11:25.820 INFO:tasks.workunit.client.0.smithi019.stdout:1/60: mkdir d1/d2/d18 0 2024-09-12T22:11:25.820 INFO:tasks.workunit.client.0.smithi019.stdout:9/58: truncate f5 613637 0 2024-09-12T22:11:25.820 INFO:tasks.workunit.client.0.smithi019.stdout:6/74: mknod d9/c17 0 2024-09-12T22:11:25.820 INFO:tasks.workunit.client.0.smithi019.stdout:4/81: write d9/d14/f1b [291664,48973] 0 2024-09-12T22:11:25.821 INFO:tasks.workunit.client.0.smithi019.stdout:3/77: creat d18/f19 x:0 0 0 2024-09-12T22:11:25.821 INFO:tasks.workunit.client.0.smithi019.stdout:0/109: dread d5/d7/f8 [0,4194304] 0 2024-09-12T22:11:25.822 INFO:tasks.workunit.client.0.smithi019.stdout:6/75: mknod d9/dc/c18 0 2024-09-12T22:11:25.822 INFO:tasks.workunit.client.0.smithi019.stdout:7/116: creat da/d24/d28/d1c/f29 x:0 0 0 2024-09-12T22:11:25.822 INFO:tasks.workunit.client.0.smithi019.stdout:1/61: creat d1/d4/dc/f19 x:0 0 0 2024-09-12T22:11:25.823 INFO:tasks.workunit.client.0.smithi019.stdout:9/59: link c10 d12/c14 0 2024-09-12T22:11:25.823 INFO:tasks.workunit.client.0.smithi019.stdout:4/82: creat d9/d17/f1d x:0 0 0 2024-09-12T22:11:25.823 INFO:tasks.workunit.client.0.smithi019.stdout:5/116: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:11:25.824 INFO:tasks.workunit.client.0.smithi019.stdout:9/60: creat d12/f15 x:0 0 0 2024-09-12T22:11:25.824 INFO:tasks.workunit.client.0.smithi019.stdout:4/83: mknod d9/c1e 0 2024-09-12T22:11:25.824 INFO:tasks.workunit.client.0.smithi019.stdout:6/76: truncate d9/dc/f13 202572 0 2024-09-12T22:11:25.825 INFO:tasks.workunit.client.0.smithi019.stdout:1/62: mknod d1/d4/dc/df/c1a 0 2024-09-12T22:11:25.825 INFO:tasks.workunit.client.0.smithi019.stdout:7/117: creat da/d19/d25/f2a x:0 0 0 2024-09-12T22:11:25.825 INFO:tasks.workunit.client.0.smithi019.stdout:9/61: fdatasync f4 0 2024-09-12T22:11:25.825 INFO:tasks.workunit.client.0.smithi019.stdout:4/84: chown d9/d17/f1d 240849 1 2024-09-12T22:11:25.825 INFO:tasks.workunit.client.0.smithi019.stdout:8/49: dread f2 [0,4194304] 0 2024-09-12T22:11:25.826 INFO:tasks.workunit.client.0.smithi019.stdout:8/50: read f4 [4305630,41031] 0 2024-09-12T22:11:25.826 INFO:tasks.workunit.client.0.smithi019.stdout:4/85: unlink d9/f16 0 2024-09-12T22:11:25.826 INFO:tasks.workunit.client.0.smithi019.stdout:5/117: truncate d0/d1d/f22 515216 0 2024-09-12T22:11:25.826 INFO:tasks.workunit.client.0.smithi019.stdout:7/118: mknod da/c2b 0 2024-09-12T22:11:25.826 INFO:tasks.workunit.client.0.smithi019.stdout:9/62: mknod d12/c16 0 2024-09-12T22:11:25.827 INFO:tasks.workunit.client.0.smithi019.stdout:1/63: creat d1/d4/dd/d12/f1b x:0 0 0 2024-09-12T22:11:25.827 INFO:tasks.workunit.client.0.smithi019.stdout:5/118: chown d0/d1d/f22 243 1 2024-09-12T22:11:25.827 INFO:tasks.workunit.client.0.smithi019.stdout:9/63: write fa [281325,41127] 0 2024-09-12T22:11:25.827 INFO:tasks.workunit.client.0.smithi019.stdout:4/86: write d9/ff [4920066,31038] 0 2024-09-12T22:11:25.828 INFO:tasks.workunit.client.0.smithi019.stdout:0/110: write d5/f16 [4257242,29292] 0 2024-09-12T22:11:25.828 INFO:tasks.workunit.client.0.smithi019.stdout:3/78: truncate f13 3299237 0 2024-09-12T22:11:25.828 INFO:tasks.workunit.client.0.smithi019.stdout:7/119: dread - da/d24/d28/d1c/f29 zero size 2024-09-12T22:11:25.829 INFO:tasks.workunit.client.0.smithi019.stdout:5/119: read d0/f6 [3391265,102826] 0 2024-09-12T22:11:25.829 INFO:tasks.workunit.client.0.smithi019.stdout:9/64: rmdir d12 39 2024-09-12T22:11:25.829 INFO:tasks.workunit.client.0.smithi019.stdout:1/64: write d1/d2/f7 [1653126,10891] 0 2024-09-12T22:11:25.829 INFO:tasks.workunit.client.0.smithi019.stdout:0/111: chown c3 1135756605 1 2024-09-12T22:11:25.831 INFO:tasks.workunit.client.0.smithi019.stdout:3/79: write d18/f19 [449365,73559] 0 2024-09-12T22:11:25.831 INFO:tasks.workunit.client.0.smithi019.stdout:5/120: chown d0/d1d/f22 460706349 1 2024-09-12T22:11:25.831 INFO:tasks.workunit.client.0.smithi019.stdout:9/65: creat d12/f17 x:0 0 0 2024-09-12T22:11:25.832 INFO:tasks.workunit.client.0.smithi019.stdout:8/51: dread f2 [0,4194304] 0 2024-09-12T22:11:25.832 INFO:tasks.workunit.client.0.smithi019.stdout:1/65: creat d1/d2/d18/f1c x:0 0 0 2024-09-12T22:11:25.832 INFO:tasks.workunit.client.0.smithi019.stdout:9/66: chown fa 1703 1 2024-09-12T22:11:25.833 INFO:tasks.workunit.client.0.smithi019.stdout:3/80: truncate d18/f19 1441989 0 2024-09-12T22:11:25.833 INFO:tasks.workunit.client.0.smithi019.stdout:9/67: chown f7 63 1 2024-09-12T22:11:25.835 INFO:tasks.workunit.client.0.smithi019.stdout:5/121: write d0/d1d/f20 [1905898,54899] 0 2024-09-12T22:11:25.835 INFO:tasks.workunit.client.0.smithi019.stdout:3/81: fsync f10 0 2024-09-12T22:11:25.835 INFO:tasks.workunit.client.0.smithi019.stdout:4/87: fdatasync d9/d14/f1b 0 2024-09-12T22:11:25.835 INFO:tasks.workunit.client.0.smithi019.stdout:6/77: dwrite d9/d12/f14 [0,4194304] 0 2024-09-12T22:11:25.835 INFO:tasks.workunit.client.0.smithi019.stdout:1/66: truncate d1/f11 4608342 0 2024-09-12T22:11:25.836 INFO:tasks.workunit.client.0.smithi019.stdout:2/47: sync 2024-09-12T22:11:25.836 INFO:tasks.workunit.client.0.smithi019.stdout:9/68: symlink d12/l18 0 2024-09-12T22:11:25.837 INFO:tasks.workunit.client.0.smithi019.stdout:3/82: chown f8 27 1 2024-09-12T22:11:25.838 INFO:tasks.workunit.client.0.smithi019.stdout:5/122: write d0/fe [532574,73798] 0 2024-09-12T22:11:25.839 INFO:tasks.workunit.client.0.smithi019.stdout:4/88: creat d9/d17/f1f x:0 0 0 2024-09-12T22:11:25.839 INFO:tasks.workunit.client.0.smithi019.stdout:1/67: chown d1/d4/dc/df/f13 30549 1 2024-09-12T22:11:25.839 INFO:tasks.workunit.client.0.smithi019.stdout:6/78: chown d9/d12/l16 214157 1 2024-09-12T22:11:25.839 INFO:tasks.workunit.client.0.smithi019.stdout:0/112: dread d5/f16 [0,4194304] 0 2024-09-12T22:11:25.841 INFO:tasks.workunit.client.0.smithi019.stdout:7/120: dread da/d24/d28/f15 [0,4194304] 0 2024-09-12T22:11:25.841 INFO:tasks.workunit.client.0.smithi019.stdout:3/83: mknod d18/c1a 0 2024-09-12T22:11:25.842 INFO:tasks.workunit.client.0.smithi019.stdout:1/68: dread - d1/d4/dc/f19 zero size 2024-09-12T22:11:25.842 INFO:tasks.workunit.client.0.smithi019.stdout:8/52: dwrite f2 [4194304,4194304] 0 2024-09-12T22:11:25.843 INFO:tasks.workunit.client.0.smithi019.stdout:5/123: fdatasync d0/ff 0 2024-09-12T22:11:25.843 INFO:tasks.workunit.client.0.smithi019.stdout:2/48: write d0/d3/d11/fc [382910,46515] 0 2024-09-12T22:11:25.843 INFO:tasks.workunit.client.0.smithi019.stdout:6/79: unlink d9/dc/f11 0 2024-09-12T22:11:25.844 INFO:tasks.workunit.client.0.smithi019.stdout:1/69: chown d1/d4/f8 0 1 2024-09-12T22:11:25.844 INFO:tasks.workunit.client.0.smithi019.stdout:4/89: chown d9/db/ce 0 1 2024-09-12T22:11:25.845 INFO:tasks.workunit.client.0.smithi019.stdout:7/121: write da/d24/d28/f27 [319394,58112] 0 2024-09-12T22:11:25.845 INFO:tasks.workunit.client.0.smithi019.stdout:3/84: creat d18/f1b x:0 0 0 2024-09-12T22:11:25.848 INFO:tasks.workunit.client.0.smithi019.stdout:4/90: chown f4 0 1 2024-09-12T22:11:25.848 INFO:tasks.workunit.client.0.smithi019.stdout:1/70: chown d1/d4/dc/df 516676 1 2024-09-12T22:11:25.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/49: mkdir d0/d2/d12 0 2024-09-12T22:11:25.850 INFO:tasks.workunit.client.0.smithi019.stdout:6/80: creat d9/dc/f19 x:0 0 0 2024-09-12T22:11:25.850 INFO:tasks.workunit.client.0.smithi019.stdout:9/69: dwrite f5 [0,4194304] 0 2024-09-12T22:11:25.851 INFO:tasks.workunit.client.0.smithi019.stdout:2/50: chown d0/d3/df 3216924 1 2024-09-12T22:11:25.852 INFO:tasks.workunit.client.0.smithi019.stdout:9/70: write fb [553145,30550] 0 2024-09-12T22:11:25.852 INFO:tasks.workunit.client.0.smithi019.stdout:7/122: truncate da/d19/d25/f2a 464435 0 2024-09-12T22:11:25.853 INFO:tasks.workunit.client.0.smithi019.stdout:6/81: write d9/dc/ff [1679310,23905] 0 2024-09-12T22:11:25.853 INFO:tasks.workunit.client.0.smithi019.stdout:2/51: stat d0/d3 0 2024-09-12T22:11:25.853 INFO:tasks.workunit.client.0.smithi019.stdout:2/52: readlink - no filename 2024-09-12T22:11:25.854 INFO:tasks.workunit.client.0.smithi019.stdout:7/123: rmdir da/d19 39 2024-09-12T22:11:25.855 INFO:tasks.workunit.client.0.smithi019.stdout:0/113: dwrite d5/f1f [0,4194304] 0 2024-09-12T22:11:25.856 INFO:tasks.workunit.client.0.smithi019.stdout:6/82: read d9/fb [600062,49198] 0 2024-09-12T22:11:25.857 INFO:tasks.workunit.client.0.smithi019.stdout:8/53: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:25.860 INFO:tasks.workunit.client.0.smithi019.stdout:6/83: creat d9/d12/f1a x:0 0 0 2024-09-12T22:11:25.860 INFO:tasks.workunit.client.0.smithi019.stdout:1/71: dread d1/d2/f7 [0,4194304] 0 2024-09-12T22:11:25.861 INFO:tasks.workunit.client.0.smithi019.stdout:4/91: dwrite f7 [0,4194304] 0 2024-09-12T22:11:25.861 INFO:tasks.workunit.client.0.smithi019.stdout:7/124: link da/d24/d28/d1c/f23 da/d24/f2c 0 2024-09-12T22:11:25.862 INFO:tasks.workunit.client.0.smithi019.stdout:0/114: rename d5/d7/de/f20 to d5/f22 0 2024-09-12T22:11:25.863 INFO:tasks.workunit.client.0.smithi019.stdout:4/92: creat d9/db/f20 x:0 0 0 2024-09-12T22:11:25.864 INFO:tasks.workunit.client.0.smithi019.stdout:1/72: symlink d1/d4/l1d 0 2024-09-12T22:11:25.864 INFO:tasks.workunit.client.0.smithi019.stdout:2/53: dwrite d0/d3/d11/fc [0,4194304] 0 2024-09-12T22:11:25.864 INFO:tasks.workunit.client.0.smithi019.stdout:7/125: rename da/c2b to da/d24/d28/d1c/c2d 0 2024-09-12T22:11:25.865 INFO:tasks.workunit.client.0.smithi019.stdout:0/115: creat d5/d7/d10/f23 x:0 0 0 2024-09-12T22:11:25.865 INFO:tasks.workunit.client.0.smithi019.stdout:1/73: chown d1/d4/dc/f19 724213 1 2024-09-12T22:11:25.865 INFO:tasks.workunit.client.0.smithi019.stdout:0/116: chown d5 11504116 1 2024-09-12T22:11:25.867 INFO:tasks.workunit.client.0.smithi019.stdout:0/117: dread - d5/f22 zero size 2024-09-12T22:11:25.867 INFO:tasks.workunit.client.0.smithi019.stdout:8/54: dread f2 [4194304,4194304] 0 2024-09-12T22:11:25.868 INFO:tasks.workunit.client.0.smithi019.stdout:7/126: dread da/f1d [0,4194304] 0 2024-09-12T22:11:25.868 INFO:tasks.workunit.client.0.smithi019.stdout:8/55: rmdir d5 39 2024-09-12T22:11:25.868 INFO:tasks.workunit.client.0.smithi019.stdout:1/74: creat d1/d4/dd/d12/f1e x:0 0 0 2024-09-12T22:11:25.869 INFO:tasks.workunit.client.0.smithi019.stdout:5/124: dread d0/f15 [0,4194304] 0 2024-09-12T22:11:25.869 INFO:tasks.workunit.client.0.smithi019.stdout:1/75: rmdir d1 39 2024-09-12T22:11:25.869 INFO:tasks.workunit.client.0.smithi019.stdout:6/84: dread d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:25.870 INFO:tasks.workunit.client.0.smithi019.stdout:7/127: creat da/d19/d25/f2e x:0 0 0 2024-09-12T22:11:25.871 INFO:tasks.workunit.client.0.smithi019.stdout:6/85: chown d9/dc/c18 911 1 2024-09-12T22:11:25.873 INFO:tasks.workunit.client.0.smithi019.stdout:1/76: creat d1/d4/f1f x:0 0 0 2024-09-12T22:11:25.876 INFO:tasks.workunit.client.0.smithi019.stdout:6/86: write d9/dc/f15 [2120536,11038] 0 2024-09-12T22:11:25.878 INFO:tasks.workunit.client.0.smithi019.stdout:2/54: dwrite d0/d2/fa [0,4194304] 0 2024-09-12T22:11:25.879 INFO:tasks.workunit.client.0.smithi019.stdout:0/118: dwrite d5/d7/d10/f17 [4194304,4194304] 0 2024-09-12T22:11:25.879 INFO:tasks.workunit.client.0.smithi019.stdout:1/77: mknod d1/d2/c20 0 2024-09-12T22:11:25.882 INFO:tasks.workunit.client.0.smithi019.stdout:5/125: dwrite d0/d14/f1a [0,4194304] 0 2024-09-12T22:11:25.882 INFO:tasks.workunit.client.0.smithi019.stdout:0/119: unlink d5/d7/d10/f23 0 2024-09-12T22:11:25.883 INFO:tasks.workunit.client.0.smithi019.stdout:1/78: write d1/d4/dc/f17 [321109,20076] 0 2024-09-12T22:11:25.884 INFO:tasks.workunit.client.0.smithi019.stdout:5/126: stat d0/d14/f16 0 2024-09-12T22:11:25.886 INFO:tasks.workunit.client.0.smithi019.stdout:7/128: dwrite da/d24/d28/f15 [4194304,4194304] 0 2024-09-12T22:11:25.886 INFO:tasks.workunit.client.0.smithi019.stdout:1/79: chown d1/d2 18 1 2024-09-12T22:11:25.886 INFO:tasks.workunit.client.0.smithi019.stdout:1/80: dread - d1/d2/d18/f1c zero size 2024-09-12T22:11:25.888 INFO:tasks.workunit.client.0.smithi019.stdout:6/87: dwrite d9/dc/ff [0,4194304] 0 2024-09-12T22:11:25.888 INFO:tasks.workunit.client.0.smithi019.stdout:1/81: fdatasync d1/d4/dd/d12/f1e 0 2024-09-12T22:11:25.888 INFO:tasks.workunit.client.0.smithi019.stdout:7/129: symlink da/d24/d28/d1c/l2f 0 2024-09-12T22:11:25.888 INFO:tasks.workunit.client.0.smithi019.stdout:2/55: fdatasync d0/d2/fa 0 2024-09-12T22:11:25.889 INFO:tasks.workunit.client.0.smithi019.stdout:5/127: creat d0/f29 x:0 0 0 2024-09-12T22:11:25.889 INFO:tasks.workunit.client.0.smithi019.stdout:1/82: write d1/d4/dc/f19 [831480,68990] 0 2024-09-12T22:11:25.890 INFO:tasks.workunit.client.0.smithi019.stdout:6/88: write f4 [986205,120359] 0 2024-09-12T22:11:25.890 INFO:tasks.workunit.client.0.smithi019.stdout:7/130: mkdir da/d30 0 2024-09-12T22:11:25.891 INFO:tasks.workunit.client.0.smithi019.stdout:0/120: dread d5/d7/f8 [0,4194304] 0 2024-09-12T22:11:25.891 INFO:tasks.workunit.client.0.smithi019.stdout:5/128: fsync d0/f4 0 2024-09-12T22:11:25.891 INFO:tasks.workunit.client.0.smithi019.stdout:2/56: getdents d0/d3/df 0 2024-09-12T22:11:25.891 INFO:tasks.workunit.client.0.smithi019.stdout:7/131: fdatasync da/d19/d25/f2e 0 2024-09-12T22:11:25.892 INFO:tasks.workunit.client.0.smithi019.stdout:6/89: symlink d9/d12/l1b 0 2024-09-12T22:11:25.892 INFO:tasks.workunit.client.0.smithi019.stdout:0/121: creat d5/d7/d10/f24 x:0 0 0 2024-09-12T22:11:25.892 INFO:tasks.workunit.client.0.smithi019.stdout:1/83: symlink d1/d4/dc/df/l21 0 2024-09-12T22:11:25.892 INFO:tasks.workunit.client.0.smithi019.stdout:6/90: mknod d9/d12/c1c 0 2024-09-12T22:11:25.892 INFO:tasks.workunit.client.0.smithi019.stdout:7/132: symlink da/l31 0 2024-09-12T22:11:25.893 INFO:tasks.workunit.client.0.smithi019.stdout:5/129: link d0/c23 d0/d1d/c2a 0 2024-09-12T22:11:25.895 INFO:tasks.workunit.client.0.smithi019.stdout:0/122: write d5/d7/f8 [228297,3076] 0 2024-09-12T22:11:25.895 INFO:tasks.workunit.client.0.smithi019.stdout:1/84: link d1/f11 d1/d4/dc/df/f22 0 2024-09-12T22:11:25.895 INFO:tasks.workunit.client.0.smithi019.stdout:7/133: mkdir da/d24/d28/d1c/d32 0 2024-09-12T22:11:25.895 INFO:tasks.workunit.client.0.smithi019.stdout:6/91: write d9/d12/f14 [628223,87727] 0 2024-09-12T22:11:25.895 INFO:tasks.workunit.client.0.smithi019.stdout:5/130: creat d0/d14/f2b x:0 0 0 2024-09-12T22:11:25.896 INFO:tasks.workunit.client.0.smithi019.stdout:1/85: rmdir d1/d4 39 2024-09-12T22:11:25.896 INFO:tasks.workunit.client.0.smithi019.stdout:0/123: fdatasync d5/d7/d10/f17 0 2024-09-12T22:11:25.897 INFO:tasks.workunit.client.0.smithi019.stdout:5/131: write d0/f10 [5069694,29151] 0 2024-09-12T22:11:25.897 INFO:tasks.workunit.client.0.smithi019.stdout:0/124: rmdir d5/d7/de 39 2024-09-12T22:11:25.898 INFO:tasks.workunit.client.0.smithi019.stdout:5/132: symlink d0/l2c 0 2024-09-12T22:11:25.898 INFO:tasks.workunit.client.0.smithi019.stdout:2/57: dwrite d0/d3/d11/f10 [4194304,4194304] 0 2024-09-12T22:11:25.898 INFO:tasks.workunit.client.0.smithi019.stdout:7/134: dread da/f11 [0,4194304] 0 2024-09-12T22:11:25.899 INFO:tasks.workunit.client.0.smithi019.stdout:1/86: rename d1/d4/dd/d12/f1e to d1/d4/dd/f23 0 2024-09-12T22:11:25.899 INFO:tasks.workunit.client.0.smithi019.stdout:1/87: dread - d1/f14 zero size 2024-09-12T22:11:25.899 INFO:tasks.workunit.client.0.smithi019.stdout:1/88: stat d1 0 2024-09-12T22:11:25.900 INFO:tasks.workunit.client.0.smithi019.stdout:0/125: mkdir d5/d7/d25 0 2024-09-12T22:11:25.900 INFO:tasks.workunit.client.0.smithi019.stdout:2/58: rename d0 to d0/d2/d4/d13 22 2024-09-12T22:11:25.900 INFO:tasks.workunit.client.0.smithi019.stdout:1/89: dread - d1/d4/dc/df/f13 zero size 2024-09-12T22:11:25.901 INFO:tasks.workunit.client.0.smithi019.stdout:5/133: creat d0/d26/f2d x:0 0 0 2024-09-12T22:11:25.903 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:25.902+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:25.903 INFO:tasks.workunit.client.0.smithi019.stdout:5/134: write d0/d14/f16 [1165159,78434] 0 2024-09-12T22:11:25.904 INFO:tasks.workunit.client.0.smithi019.stdout:2/59: getdents d0/d2/d4 0 2024-09-12T22:11:25.904 INFO:tasks.workunit.client.0.smithi019.stdout:1/90: link d1/d2/f7 d1/d2/f24 0 2024-09-12T22:11:25.905 INFO:tasks.workunit.client.0.smithi019.stdout:0/126: mkdir d5/d7/d10/d26 0 2024-09-12T22:11:25.906 INFO:tasks.workunit.client.0.smithi019.stdout:1/91: mkdir d1/d2/d18/d25 0 2024-09-12T22:11:25.907 INFO:tasks.workunit.client.0.smithi019.stdout:2/60: mknod d0/d2/d4/c14 0 2024-09-12T22:11:25.908 INFO:tasks.workunit.client.0.smithi019.stdout:3/85: sync 2024-09-12T22:11:25.908 INFO:tasks.workunit.client.0.smithi019.stdout:4/93: sync 2024-09-12T22:11:25.908 INFO:tasks.workunit.client.0.smithi019.stdout:7/135: dwrite da/d19/d25/f2e [0,4194304] 0 2024-09-12T22:11:25.911 INFO:tasks.workunit.client.0.smithi019.stdout:6/92: dwrite d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:25.911 INFO:tasks.workunit.client.0.smithi019.stdout:7/136: stat da/d24/d28/f15 0 2024-09-12T22:11:25.911 INFO:tasks.workunit.client.0.smithi019.stdout:4/94: symlink d9/d14/l21 0 2024-09-12T22:11:25.911 INFO:tasks.workunit.client.0.smithi019.stdout:1/92: unlink d1/d4/dc/df/c1a 0 2024-09-12T22:11:25.911 INFO:tasks.workunit.client.0.smithi019.stdout:2/61: mkdir d0/d2/d12/d15 0 2024-09-12T22:11:25.912 INFO:tasks.workunit.client.0.smithi019.stdout:6/93: fdatasync f4 0 2024-09-12T22:11:25.914 INFO:tasks.workunit.client.0.smithi019.stdout:1/93: readlink d1/d4/dc/df/l21 0 2024-09-12T22:11:25.917 INFO:tasks.workunit.client.0.smithi019.stdout:5/135: dwrite d0/f29 [0,4194304] 0 2024-09-12T22:11:25.917 INFO:tasks.workunit.client.0.smithi019.stdout:2/62: link d0/d3/d11/f10 d0/d2/d4/f16 0 2024-09-12T22:11:25.917 INFO:tasks.workunit.client.0.smithi019.stdout:7/137: dread da/d24/d28/f27 [0,4194304] 0 2024-09-12T22:11:25.919 INFO:tasks.workunit.client.0.smithi019.stdout:0/127: dwrite d5/f1f [4194304,4194304] 0 2024-09-12T22:11:25.919 INFO:tasks.workunit.client.0.smithi019.stdout:1/94: link d1/d2/l16 d1/l26 0 2024-09-12T22:11:25.920 INFO:tasks.workunit.client.0.smithi019.stdout:6/94: truncate d9/d12/f14 1285126 0 2024-09-12T22:11:25.921 INFO:tasks.workunit.client.0.smithi019.stdout:3/86: dwrite f12 [0,4194304] 0 2024-09-12T22:11:25.922 INFO:tasks.workunit.client.0.smithi019.stdout:2/63: truncate d0/d3/d11/f10 8598250 0 2024-09-12T22:11:25.922 INFO:tasks.workunit.client.0.smithi019.stdout:4/95: dwrite d9/ff [0,4194304] 0 2024-09-12T22:11:25.922 INFO:tasks.workunit.client.0.smithi019.stdout:6/95: write d9/d12/f1a [448215,51758] 0 2024-09-12T22:11:25.923 INFO:tasks.workunit.client.0.smithi019.stdout:4/96: write d9/db/f20 [250731,69312] 0 2024-09-12T22:11:25.924 INFO:tasks.workunit.client.0.smithi019.stdout:2/64: link d0/d2/fa d0/d2/d12/f17 0 2024-09-12T22:11:25.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/71: sync 2024-09-12T22:11:25.925 INFO:tasks.workunit.client.0.smithi019.stdout:8/56: sync 2024-09-12T22:11:25.925 INFO:tasks.workunit.client.0.smithi019.stdout:1/95: write d1/f11 [1968530,50437] 0 2024-09-12T22:11:25.925 INFO:tasks.workunit.client.0.smithi019.stdout:7/138: truncate da/d19/d25/f2a 459193 0 2024-09-12T22:11:25.927 INFO:tasks.workunit.client.0.smithi019.stdout:1/96: read - d1/d4/dd/f23 zero size 2024-09-12T22:11:25.927 INFO:tasks.workunit.client.0.smithi019.stdout:0/128: dread d5/f6 [0,4194304] 0 2024-09-12T22:11:25.928 INFO:tasks.workunit.client.0.smithi019.stdout:8/57: link d5/c8 d5/c9 0 2024-09-12T22:11:25.928 INFO:tasks.workunit.client.0.smithi019.stdout:7/139: write da/d19/d25/f2e [1281675,36417] 0 2024-09-12T22:11:25.929 INFO:tasks.workunit.client.0.smithi019.stdout:8/58: rename f2 to d5/fa 0 2024-09-12T22:11:25.929 INFO:tasks.workunit.client.0.smithi019.stdout:1/97: dread - d1/d4/dd/f23 zero size 2024-09-12T22:11:25.931 INFO:tasks.workunit.client.0.smithi019.stdout:0/129: write d5/d7/f11 [4796699,107243] 0 2024-09-12T22:11:25.931 INFO:tasks.workunit.client.0.smithi019.stdout:8/59: mknod d5/cb 0 2024-09-12T22:11:25.932 INFO:tasks.workunit.client.0.smithi019.stdout:3/87: dwrite fe [0,4194304] 0 2024-09-12T22:11:25.932 INFO:tasks.workunit.client.0.smithi019.stdout:6/96: truncate d9/dc/ff 3818163 0 2024-09-12T22:11:25.932 INFO:tasks.workunit.client.0.smithi019.stdout:9/72: dread fc [0,4194304] 0 2024-09-12T22:11:25.933 INFO:tasks.workunit.client.0.smithi019.stdout:2/65: fsync d0/d3/d11/f10 0 2024-09-12T22:11:25.933 INFO:tasks.workunit.client.0.smithi019.stdout:7/140: dread da/d24/d28/f27 [0,4194304] 0 2024-09-12T22:11:25.933 INFO:tasks.workunit.client.0.smithi019.stdout:4/97: dread d9/db/fd [0,4194304] 0 2024-09-12T22:11:25.934 INFO:tasks.workunit.client.0.smithi019.stdout:7/141: fdatasync da/d24/d28/f15 0 2024-09-12T22:11:25.934 INFO:tasks.workunit.client.0.smithi019.stdout:1/98: rename d1/d4/dd to d1/d2/d18/d25/d27 0 2024-09-12T22:11:25.935 INFO:tasks.workunit.client.0.smithi019.stdout:4/98: fdatasync d9/d14/f1b 0 2024-09-12T22:11:25.935 INFO:tasks.workunit.client.0.smithi019.stdout:6/97: symlink d9/d12/l1d 0 2024-09-12T22:11:25.935 INFO:tasks.workunit.client.0.smithi019.stdout:9/73: mknod d12/c19 0 2024-09-12T22:11:25.936 INFO:tasks.workunit.client.0.smithi019.stdout:2/66: mkdir d0/d3/df/d18 0 2024-09-12T22:11:25.937 INFO:tasks.workunit.client.0.smithi019.stdout:6/98: rename d9 to d9/d12/d1e 22 2024-09-12T22:11:25.937 INFO:tasks.workunit.client.0.smithi019.stdout:7/142: creat da/d19/f33 x:0 0 0 2024-09-12T22:11:25.938 INFO:tasks.workunit.client.0.smithi019.stdout:8/60: getdents d5 0 2024-09-12T22:11:25.940 INFO:tasks.workunit.client.0.smithi019.stdout:1/99: creat d1/d4/dc/f28 x:0 0 0 2024-09-12T22:11:25.940 INFO:tasks.workunit.client.0.smithi019.stdout:7/143: truncate da/d24/d28/d1c/f20 518797 0 2024-09-12T22:11:25.941 INFO:tasks.workunit.client.0.smithi019.stdout:6/99: read d9/fa [24601,38039] 0 2024-09-12T22:11:25.941 INFO:tasks.workunit.client.0.smithi019.stdout:8/61: mkdir d5/dc 0 2024-09-12T22:11:25.942 INFO:tasks.workunit.client.0.smithi019.stdout:6/100: stat d9 0 2024-09-12T22:11:25.942 INFO:tasks.workunit.client.0.smithi019.stdout:3/88: dwrite f16 [0,4194304] 0 2024-09-12T22:11:25.942 INFO:tasks.workunit.client.0.smithi019.stdout:9/74: write fe [731274,27399] 0 2024-09-12T22:11:25.943 INFO:tasks.workunit.client.0.smithi019.stdout:7/144: write da/d24/d28/f15 [5194216,14945] 0 2024-09-12T22:11:25.943 INFO:tasks.workunit.client.0.smithi019.stdout:4/99: dread d9/fc [0,4194304] 0 2024-09-12T22:11:25.944 INFO:tasks.workunit.client.0.smithi019.stdout:6/101: truncate d9/dc/f19 921762 0 2024-09-12T22:11:25.944 INFO:tasks.workunit.client.0.smithi019.stdout:8/62: link d5/fa d5/fd 0 2024-09-12T22:11:25.944 INFO:tasks.workunit.client.0.smithi019.stdout:1/100: rename d1/d2/d18/d25 to d1/d2/d18/d29 0 2024-09-12T22:11:25.944 INFO:tasks.workunit.client.0.smithi019.stdout:9/75: chown fa 38910213 1 2024-09-12T22:11:25.944 INFO:tasks.workunit.client.0.smithi019.stdout:4/100: fsync f7 0 2024-09-12T22:11:25.945 INFO:tasks.workunit.client.0.smithi019.stdout:6/102: rename l1 to d9/l1f 0 2024-09-12T22:11:25.945 INFO:tasks.workunit.client.0.smithi019.stdout:7/145: unlink da/d19/d25/f2a 0 2024-09-12T22:11:25.945 INFO:tasks.workunit.client.0.smithi019.stdout:1/101: readlink d1/l26 0 2024-09-12T22:11:25.945 INFO:tasks.workunit.client.0.smithi019.stdout:5/136: sync 2024-09-12T22:11:25.946 INFO:tasks.workunit.client.0.smithi019.stdout:4/101: sync 2024-09-12T22:11:25.946 INFO:tasks.workunit.client.0.smithi019.stdout:0/130: dread d5/d7/f18 [0,4194304] 0 2024-09-12T22:11:25.946 INFO:tasks.workunit.client.0.smithi019.stdout:8/63: fdatasync d5/fa 0 2024-09-12T22:11:25.946 INFO:tasks.workunit.client.0.smithi019.stdout:9/76: truncate fb 722910 0 2024-09-12T22:11:25.946 INFO:tasks.workunit.client.0.smithi019.stdout:2/67: dwrite d0/d3/d11/f10 [4194304,4194304] 0 2024-09-12T22:11:25.947 INFO:tasks.workunit.client.0.smithi019.stdout:4/102: stat d9/db 0 2024-09-12T22:11:25.947 INFO:tasks.workunit.client.0.smithi019.stdout:9/77: readlink d12/l18 0 2024-09-12T22:11:25.947 INFO:tasks.workunit.client.0.smithi019.stdout:6/103: chown d9/d12/c1c 2 1 2024-09-12T22:11:25.948 INFO:tasks.workunit.client.0.smithi019.stdout:7/146: unlink da/d19/f33 0 2024-09-12T22:11:25.948 INFO:tasks.workunit.client.0.smithi019.stdout:6/104: chown d9/dc 1 1 2024-09-12T22:11:25.949 INFO:tasks.workunit.client.0.smithi019.stdout:5/137: mknod d0/d24/c2e 0 2024-09-12T22:11:25.949 INFO:tasks.workunit.client.0.smithi019.stdout:9/78: creat d12/f1a x:0 0 0 2024-09-12T22:11:25.950 INFO:tasks.workunit.client.0.smithi019.stdout:7/147: rename da/d24 to da/d24/d34 22 2024-09-12T22:11:25.950 INFO:tasks.workunit.client.0.smithi019.stdout:2/68: creat d0/d3/d11/f19 x:0 0 0 2024-09-12T22:11:25.950 INFO:tasks.workunit.client.0.smithi019.stdout:1/102: symlink d1/d2/d18/d29/d27/d12/l2a 0 2024-09-12T22:11:25.950 INFO:tasks.workunit.client.0.smithi019.stdout:9/79: mkdir d12/d1b 0 2024-09-12T22:11:25.951 INFO:tasks.workunit.client.0.smithi019.stdout:0/131: truncate d5/d7/d10/f24 87168 0 2024-09-12T22:11:25.951 INFO:tasks.workunit.client.0.smithi019.stdout:3/89: dwrite fb [0,4194304] 0 2024-09-12T22:11:25.951 INFO:tasks.workunit.client.0.smithi019.stdout:5/138: readlink d0/l13 0 2024-09-12T22:11:25.952 INFO:tasks.workunit.client.0.smithi019.stdout:4/103: link d9/d14/l21 d9/d14/l22 0 2024-09-12T22:11:25.952 INFO:tasks.workunit.client.0.smithi019.stdout:6/105: rename d9/d12 to d9/dc/d20 0 2024-09-12T22:11:25.953 INFO:tasks.workunit.client.0.smithi019.stdout:2/69: write d0/d3/d11/f10 [3509185,125820] 0 2024-09-12T22:11:25.953 INFO:tasks.workunit.client.0.smithi019.stdout:7/148: link da/d24/d28/c16 da/d24/c35 0 2024-09-12T22:11:25.954 INFO:tasks.workunit.client.0.smithi019.stdout:1/103: dread d1/fe [0,4194304] 0 2024-09-12T22:11:25.954 INFO:tasks.workunit.client.0.smithi019.stdout:6/106: creat d9/dc/d20/f21 x:0 0 0 2024-09-12T22:11:25.954 INFO:tasks.workunit.client.0.smithi019.stdout:5/139: mknod d0/d26/c2f 0 2024-09-12T22:11:25.956 INFO:tasks.workunit.client.0.smithi019.stdout:3/90: write f4 [2167309,127576] 0 2024-09-12T22:11:25.956 INFO:tasks.workunit.client.0.smithi019.stdout:1/104: fdatasync d1/d4/dc/f19 0 2024-09-12T22:11:25.957 INFO:tasks.workunit.client.0.smithi019.stdout:5/140: stat d0/f19 0 2024-09-12T22:11:25.957 INFO:tasks.workunit.client.0.smithi019.stdout:8/64: dwrite d5/fa [0,4194304] 0 2024-09-12T22:11:25.957 INFO:tasks.workunit.client.0.smithi019.stdout:7/149: dread da/f1d [0,4194304] 0 2024-09-12T22:11:25.957 INFO:tasks.workunit.client.0.smithi019.stdout:2/70: unlink d0/d2/d4/d7/cb 0 2024-09-12T22:11:25.957 INFO:tasks.workunit.client.0.smithi019.stdout:0/132: link d5/d7/l1a d5/d7/d25/l27 0 2024-09-12T22:11:25.957 INFO:tasks.workunit.client.0.smithi019.stdout:3/91: write f15 [902724,75824] 0 2024-09-12T22:11:25.958 INFO:tasks.workunit.client.0.smithi019.stdout:0/133: write d5/f16 [408840,38831] 0 2024-09-12T22:11:25.958 INFO:tasks.workunit.client.0.smithi019.stdout:2/71: mkdir d0/d2/d1a 0 2024-09-12T22:11:25.959 INFO:tasks.workunit.client.0.smithi019.stdout:5/141: mknod d0/d26/c30 0 2024-09-12T22:11:25.959 INFO:tasks.workunit.client.0.smithi019.stdout:4/104: truncate d9/ff 3903710 0 2024-09-12T22:11:25.959 INFO:tasks.workunit.client.0.smithi019.stdout:7/150: rename da/lc to da/d19/l36 0 2024-09-12T22:11:25.959 INFO:tasks.workunit.client.0.smithi019.stdout:3/92: creat d18/f1c x:0 0 0 2024-09-12T22:11:25.960 INFO:tasks.workunit.client.0.smithi019.stdout:8/65: link l3 d5/dc/le 0 2024-09-12T22:11:25.960 INFO:tasks.workunit.client.0.smithi019.stdout:0/134: dread f4 [0,4194304] 0 2024-09-12T22:11:25.960 INFO:tasks.workunit.client.0.smithi019.stdout:4/105: read d9/fc [2759272,76154] 0 2024-09-12T22:11:25.961 INFO:tasks.workunit.client.0.smithi019.stdout:2/72: write d0/d3/d11/f19 [319289,101390] 0 2024-09-12T22:11:25.961 INFO:tasks.workunit.client.0.smithi019.stdout:3/93: fsync d18/f1b 0 2024-09-12T22:11:25.961 INFO:tasks.workunit.client.0.smithi019.stdout:1/105: truncate d1/d2/d18/d29/d27/f23 1040256 0 2024-09-12T22:11:25.961 INFO:tasks.workunit.client.0.smithi019.stdout:7/151: symlink da/d19/d25/l37 0 2024-09-12T22:11:25.962 INFO:tasks.workunit.client.0.smithi019.stdout:8/66: write d5/fd [2763258,93569] 0 2024-09-12T22:11:25.963 INFO:tasks.workunit.client.0.smithi019.stdout:3/94: chown ca 1 1 2024-09-12T22:11:25.963 INFO:tasks.workunit.client.0.smithi019.stdout:5/142: link d0/f2 d0/d1d/f31 0 2024-09-12T22:11:25.963 INFO:tasks.workunit.client.0.smithi019.stdout:7/152: fdatasync da/f1d 0 2024-09-12T22:11:25.963 INFO:tasks.workunit.client.0.smithi019.stdout:6/107: dwrite d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:25.963 INFO:tasks.workunit.client.0.smithi019.stdout:3/95: readlink ld 0 2024-09-12T22:11:25.963 INFO:tasks.workunit.client.0.smithi019.stdout:0/135: mknod d5/c28 0 2024-09-12T22:11:25.965 INFO:tasks.workunit.client.0.smithi019.stdout:1/106: creat d1/d2/d18/d29/d27/d12/f2b x:0 0 0 2024-09-12T22:11:25.965 INFO:tasks.workunit.client.0.smithi019.stdout:0/136: chown d5/f22 3 1 2024-09-12T22:11:25.965 INFO:tasks.workunit.client.0.smithi019.stdout:6/108: creat d9/f22 x:0 0 0 2024-09-12T22:11:25.966 INFO:tasks.workunit.client.0.smithi019.stdout:4/106: dread f7 [0,4194304] 0 2024-09-12T22:11:25.967 INFO:tasks.workunit.client.0.smithi019.stdout:7/153: getdents da/d24/d28 0 2024-09-12T22:11:25.967 INFO:tasks.workunit.client.0.smithi019.stdout:3/96: getdents d18 0 2024-09-12T22:11:25.968 INFO:tasks.workunit.client.0.smithi019.stdout:0/137: mknod d5/d7/d25/c29 0 2024-09-12T22:11:25.968 INFO:tasks.workunit.client.0.smithi019.stdout:6/109: rename d9/dc/f19 to d9/dc/f23 0 2024-09-12T22:11:25.969 INFO:tasks.workunit.client.0.smithi019.stdout:8/67: truncate d5/fd 1946338 0 2024-09-12T22:11:25.969 INFO:tasks.workunit.client.0.smithi019.stdout:5/143: dread d0/f29 [0,4194304] 0 2024-09-12T22:11:25.970 INFO:tasks.workunit.client.0.smithi019.stdout:7/154: write da/d19/d25/f2e [4437,78244] 0 2024-09-12T22:11:25.970 INFO:tasks.workunit.client.0.smithi019.stdout:6/110: chown d9/dc/f15 13494 1 2024-09-12T22:11:25.971 INFO:tasks.workunit.client.0.smithi019.stdout:4/107: getdents d9 0 2024-09-12T22:11:25.971 INFO:tasks.workunit.client.0.smithi019.stdout:2/73: dwrite d0/d3/d11/f19 [0,4194304] 0 2024-09-12T22:11:25.972 INFO:tasks.workunit.client.0.smithi019.stdout:4/108: write d9/fc [1662073,77576] 0 2024-09-12T22:11:25.972 INFO:tasks.workunit.client.0.smithi019.stdout:2/74: write d0/d3/d11/f10 [3462797,20062] 0 2024-09-12T22:11:25.973 INFO:tasks.workunit.client.0.smithi019.stdout:7/155: dread da/f11 [0,4194304] 0 2024-09-12T22:11:25.973 INFO:tasks.workunit.client.0.smithi019.stdout:4/109: write d9/d17/f1f [1001961,65597] 0 2024-09-12T22:11:25.974 INFO:tasks.workunit.client.0.smithi019.stdout:1/107: truncate d1/d2/f24 3767713 0 2024-09-12T22:11:25.974 INFO:tasks.workunit.client.0.smithi019.stdout:2/75: creat d0/d2/d12/f1b x:0 0 0 2024-09-12T22:11:25.974 INFO:tasks.workunit.client.0.smithi019.stdout:3/97: dwrite f9 [0,4194304] 0 2024-09-12T22:11:25.975 INFO:tasks.workunit.client.0.smithi019.stdout:0/138: write f4 [375406,64629] 0 2024-09-12T22:11:25.976 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.015499457000004, 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016936731, 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:25.977 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957929+0000", 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2399999999999999e-07 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957942+0000", 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3089e-05 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957971+0000", 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8198999999999999e-05 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957980+0000", 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5249999999999994e-06 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958031+0000", 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0735000000000001e-05 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958034+0000", 2024-09-12T22:11:25.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2380000000000002e-06 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969108+0000", 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01107415 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969191+0000", 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2575000000000001e-05 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969594+0000", 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040277800000000001 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971654+0000", 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002060433 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974763+0000", 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031087659999999998 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974820+0000", 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7593000000000002e-05 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974866+0000", 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5325999999999999e-05 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.015430244000001, 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016990023, 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957998+0000", 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.957999+0000", 2024-09-12T22:11:25.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0900000000000001e-07 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958014+0000", 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4664999999999999e-05 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958023+0000", 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5540000000000003e-06 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958030+0000", 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.686e-06 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958060+0000", 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0521999999999997e-05 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2120000000000002e-06 2024-09-12T22:11:25.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970606+0000", 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012543818999999999 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970681+0000", 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4418000000000005e-05 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970772+0000", 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1248000000000005e-05 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971991+0000", 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012193810000000001 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974928+0000", 2024-09-12T22:11:25.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029365889999999999 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974963+0000", 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4644000000000002e-05 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.974988+0000", 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5576e-05 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.990 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.015383714999999, 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017070426, 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:25.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958045+0000", 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958048+0000", 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2590000000000001e-06 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958056+0000", 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2570000000000001e-06 2024-09-12T22:11:25.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958062+0000", 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8409999999999996e-06 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958097+0000", 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5287000000000003e-05 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958101+0000", 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4989999999999996e-06 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971000+0000", 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012898626999999999 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971062+0000", 2024-09-12T22:11:25.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2475000000000001e-05 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971139+0000", 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7027000000000006e-05 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971996+0000", 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000856593 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975039+0000", 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030432509999999999 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975077+0000", 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7812999999999999e-05 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975115+0000", 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7938000000000002e-05 2024-09-12T22:11:25.997 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.015354637000002, 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017143934, 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:25.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958074+0000", 2024-09-12T22:11:25.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958078+0000", 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3699999999999999e-06 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958085+0000", 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3119999999999996e-06 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958092+0000", 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958122+0000", 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0462000000000001e-05 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958126+0000", 2024-09-12T22:11:26.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7890000000000001e-06 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971360+0000", 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013234246999999999 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971433+0000", 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2707999999999996e-05 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971501+0000", 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7959000000000004e-05 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.972099+0000", 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059809100000000003 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975169+0000", 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030699439999999998 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975198+0000", 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8858000000000001e-05 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975218+0000", 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9972000000000001e-05 2024-09-12T22:11:26.004 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.015328679000007, 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017222013000000001, 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958100+0000", 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4699999999999998e-07 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958103+0000", 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6350000000000002e-06 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958114+0000", 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1379000000000001e-05 2024-09-12T22:11:26.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958118+0000", 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2989999999999998e-06 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958162+0000", 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4138999999999999e-05 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958166+0000", 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3100000000000001e-06 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971667+0000", 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013501192 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971714+0000", 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7014000000000001e-05 2024-09-12T22:11:26.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971803+0000", 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518000000000006e-05 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.973029+0000", 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012254119999999999 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975257+0000", 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022277909999999998 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975287+0000", 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0824000000000002e-05 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975322+0000", 2024-09-12T22:11:26.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4252999999999999e-05 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.015257425000001, 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017540088999999998, 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.012 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958171+0000", 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9299999999999999e-07 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958176+0000", 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5870000000000003e-06 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958183+0000", 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3259999999999998e-06 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958188+0000", 2024-09-12T22:11:26.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8799999999999999e-06 2024-09-12T22:11:26.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958248+0000", 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0062999999999997e-05 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op must wait for map", 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958253+0000", 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1839999999999998e-06 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969042+0000", 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010788443999999999 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969170+0000", 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000128217 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.969289+0000", 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011849399999999999 2024-09-12T22:11:26.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970878+0000", 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001589638 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975623+0000", 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047446099999999998 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975677+0000", 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4517e-05 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975711+0000", 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3735999999999997e-05 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.019 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 95.015220241999998, 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017610404999999999, 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958208+0000", 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958209+0000", 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1799999999999995e-07 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958220+0000", 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1442e-05 2024-09-12T22:11:26.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958227+0000", 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1629999999999999e-06 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958233+0000", 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6590000000000004e-06 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958290+0000", 2024-09-12T22:11:26.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7083999999999998e-05 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.958294+0000", 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970101+0000", 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011806987 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970210+0000", 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010912399999999999 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.970359+0000", 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000149405 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.971323+0000", 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00096308699999999995 2024-09-12T22:11:26.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975747+0000", 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044248430000000004 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975780+0000", 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2231999999999999e-05 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:09:50.975819+0000", 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8927000000000002e-05 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:26.026 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2544792040000008, 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:26.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:26.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.032 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2424166060000008, 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:26.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:26.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:26.038 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5101 4.c 4:30c8de84:::100000017cb.00000000:head [write 0~2007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2353882069999997, 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023543338, 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.039 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5101 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738040+0000", 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738041+0000", 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.113e-06 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738048+0000", 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3629999999999999e-06 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738063+0000", 2024-09-12T22:11:26.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5557e-05 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738071+0000", 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2870000000000004e-06 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738109+0000", 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7239e-05 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738186+0000", 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7410000000000006e-05 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738260+0000", 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3590000000000005e-05 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738823+0000", 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056369500000000002 2024-09-12T22:11:26.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761536+0000", 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022712663000000001 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761563+0000", 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7056e-05 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761584+0000", 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0364999999999999e-05 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5102 4.1b 4:d8bd0ea8:::100000017cc.00000000:head [write 0~1672] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2345119209999993, 2024-09-12T22:11:26.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024115083999999998, 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5102 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738917+0000", 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738922+0000", 2024-09-12T22:11:26.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1139999999999997e-06 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738935+0000", 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2700999999999999e-05 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738944+0000", 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738994+0000", 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0522000000000002e-05 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739117+0000", 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012277699999999999 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739243+0000", 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012553999999999999 2024-09-12T22:11:26.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741532+0000", 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022895739999999999 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762948+0000", 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021415500000000001 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762994+0000", 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763032+0000", 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7469000000000003e-05 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5104 4.c 4:331706eb:::100000017ce.00000000:head [write 0~1330] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2327247349999997, 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022240794000000001, 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5104 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.052 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740704+0000", 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740705+0000", 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0400000000000005e-07 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740710+0000", 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1660000000000002e-06 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740724+0000", 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3869999999999999e-05 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740731+0000", 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7500000000000003e-06 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740768+0000", 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:11:26.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740863+0000", 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4761999999999998e-05 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.740937+0000", 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4228999999999997e-05 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741834+0000", 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00089672700000000005 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762894+0000", 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021059873999999999 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762922+0000", 2024-09-12T22:11:26.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7960999999999999e-05 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762944+0000", 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2583e-05 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.058 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5105 4.20 4:054a3248:::100000017cf.00000000:head [write 0~2450] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2317224719999995, 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021353684000000001, 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5105 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.059 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741706+0000", 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741707+0000", 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6300000000000004e-07 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741712+0000", 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2349999999999999e-06 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741725+0000", 2024-09-12T22:11:26.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2529e-05 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741734+0000", 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0589999999999992e-06 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741790+0000", 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6150999999999998e-05 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741913+0000", 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012315500000000001 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742042+0000", 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012935799999999999 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.742684+0000", 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00064220599999999998 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762976+0000", 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020292039000000001 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763013+0000", 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6634999999999997e-05 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763060+0000", 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6453999999999999e-05 2024-09-12T22:11:26.064 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5108 4.20 4:05323f20:::100000017d2.00000000:head [write 0~6203] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2289608390000009, 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018849817000000001, 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.065 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5108 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744468+0000", 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7499999999999999e-07 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744477+0000", 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6659999999999997e-06 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744491+0000", 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3658999999999999e-05 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744496+0000", 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4099999999999999e-06 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744539+0000", 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3409999999999999e-05 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744626+0000", 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6475000000000001e-05 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.744707+0000", 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1248999999999994e-05 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.745240+0000", 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053252799999999999 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763251+0000", 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018011454999999999 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763277+0000", 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5432999999999999e-05 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763317+0000", 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0757000000000003e-05 2024-09-12T22:11:26.070 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:10827 4.a 4:5357c130:::10000003141.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:25.785243+0000", 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.188185404, 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019314873, 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.071 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10827 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.785243+0000", 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.785243+0000", 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.785244+0000", 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.029e-06 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.793568+0000", 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083242170000000001 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.793584+0000", 2024-09-12T22:11:26.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5804e-05 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.793591+0000", 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9949999999999999e-06 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.793721+0000", 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000129951 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.793837+0000", 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011602199999999999 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.793931+0000", 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3799000000000001e-05 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.797801+0000", 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00387033 2024-09-12T22:11:26.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.804497+0000", 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006695632 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.804531+0000", 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4715999999999998e-05 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.804558+0000", 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6378000000000001e-05 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:10838 4.3a 4:5ea9d1a5:::100000030c8.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:25.813543+0000", 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.159885263, 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020549345, 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.077 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10838 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.813543+0000", 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.813543+0000", 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.813544+0000", 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0550000000000001e-06 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.817792+0000", 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004247743 2024-09-12T22:11:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.817804+0000", 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1776999999999999e-05 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.817811+0000", 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7260000000000002e-06 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.817861+0000", 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9555999999999998e-05 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.817916+0000", 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4688000000000002e-05 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.818003+0000", 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7798000000000002e-05 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.821045+0000", 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030418189999999999 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.833931+0000", 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012885232 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.834005+0000", 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4969999999999995e-05 2024-09-12T22:11:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.834092+0000", 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6981e-05 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:10844 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:25.824483+0000", 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.14894507800000001, 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018712594999999999, 2024-09-12T22:11:26.083 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10844 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.824483+0000", 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.824483+0000", 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.824485+0000", 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6530000000000001e-06 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.830491+0000", 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060064769999999996 2024-09-12T22:11:26.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.830508+0000", 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6986e-05 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.830518+0000", 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3419999999999997e-06 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.830602+0000", 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3829e-05 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.830671+0000", 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9219000000000003e-05 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.830755+0000", 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4322999999999999e-05 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.843054+0000", 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012299137999999999 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.843083+0000", 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9135000000000001e-05 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.843131+0000", 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7481000000000002e-05 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.843196+0000", 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5011999999999994e-05 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4487.0:10842 4.17 e52/17 4:e9364d23:::100000030ac.00000000:head v 52'163, mlcod=51'161)", 2024-09-12T22:11:26.089 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:25.826127+0000", 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.14730172999999999, 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018060861000000001, 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.826127+0000", 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.826127+0000", 2024-09-12T22:11:26.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.826127+0000", 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6899999999999997e-07 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.833601+0000", 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0074738699999999996 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.833613+0000", 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2208000000000001e-05 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.833622+0000", 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0059999999999998e-06 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.833700+0000", 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7583000000000006e-05 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.833722+0000", 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1968e-05 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.844148+0000", 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010426260999999999 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.844188+0000", 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9396e-05 2024-09-12T22:11:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:10852 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:25.836093+0000", 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.13733584200000001, 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018619507, 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:26.094 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10852 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.836093+0000", 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.836093+0000", 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.836094+0000", 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3939999999999999e-06 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.840036+0000", 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039424999999999998 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.840044+0000", 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9810000000000003e-06 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.840049+0000", 2024-09-12T22:11:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.69e-06 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.840144+0000", 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4871999999999996e-05 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.840207+0000", 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000006e-05 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:26.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.840305+0000", 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8284999999999998e-05 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.844417+0000", 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041121680000000002 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.854616+0000", 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010198168000000001 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.854664+0000", 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7889000000000002e-05 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.854712+0000", 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8520000000000003e-05 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4487.0:10890 4.26 e52/17 4:643f89d3:::10000003197.00000000:head v 52'195, mlcod=52'193)", 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:25.913684+0000", 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.059744820999999997, 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016886755999999999, 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.913684+0000", 2024-09-12T22:11:26.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.913684+0000", 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.913684+0000", 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0100000000000005e-07 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.922153+0000", 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084693319999999996 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.922169+0000", 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5359e-05 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.922179+0000", 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.057e-05 2024-09-12T22:11:26.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.922253+0000", 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3996000000000001e-05 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.922279+0000", 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5176000000000001e-05 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:26.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.930524+0000", 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0082450949999999992 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:25.930570+0000", 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6626999999999999e-05 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.105 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.106 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.106 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:26.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:26.115 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:26.107+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:4/110: mknod d9/d17/c23 0 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:3/98: fsync f15 0 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:0/139: chown d5/d7/d10 32487 1 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:7/156: getdents da/d19 0 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:4/111: rename d9/d14/f1b to d9/db/f24 0 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:3/99: getdents d18 0 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:1/108: getdents d1/d2/d18/d29/d27 0 2024-09-12T22:11:26.138 INFO:tasks.workunit.client.0.smithi019.stdout:0/140: mkdir d5/d7/d10/d26/d2a 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:4/112: mkdir d9/d25 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:1/109: chown d1/l3 7138 1 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:3/100: mkdir d18/d1d 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:3/101: readlink l11 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:7/157: link da/f11 da/d24/f38 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:1/110: chown d1/d2/d18/d29 6 1 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:7/158: dread - da/d24/f2c zero size 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:2/76: dread d0/d2/d12/f17 [0,4194304] 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:0/141: truncate d5/d7/d10/f17 1560177 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:7/159: write da/d24/d28/d1c/f20 [1043330,51281] 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:8/68: truncate f4 4894088 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:0/142: write d5/f22 [859640,15802] 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:2/77: write d0/d3/d11/fc [1907866,29084] 0 2024-09-12T22:11:26.139 INFO:tasks.workunit.client.0.smithi019.stdout:8/69: write d5/fa [2416250,84398] 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:0/143: chown d5/d7/d10/f17 46594324 1 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:2/78: write d0/d3/d11/fc [4319082,67640] 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:3/102: dwrite f4 [0,4194304] 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:7/160: fsync da/d24/f38 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:1/111: dwrite d1/d4/f1f [0,4194304] 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:3/103: write f16 [707777,67238] 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:7/161: mkdir da/d19/d25/d39 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:2/79: mknod d0/d2/d1a/c1c 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:0/144: link d5/f1e d5/d7/d10/d26/d2a/f2b 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:3/104: stat f4 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:3/105: write d18/f19 [871548,75376] 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:4/113: link d9/c1e d9/db/c26 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:7/162: truncate da/d19/d25/f2e 4770283 0 2024-09-12T22:11:26.140 INFO:tasks.workunit.client.0.smithi019.stdout:3/106: mknod d18/d1d/c1e 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:4/114: truncate d9/db/f20 1276237 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:3/107: unlink ld 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:3/108: stat f12 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:9/80: sync 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:0/145: dread d5/f16 [0,4194304] 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:5/144: sync 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:6/111: sync 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:8/70: sync 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:2/80: dwrite d0/d3/d11/f10 [4194304,4194304] 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:3/109: rename f10 to d18/f1f 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:3/110: write f16 [4954136,4601] 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:3/111: stat d18 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:0/146: write d5/d7/f8 [4256428,111298] 0 2024-09-12T22:11:26.141 INFO:tasks.workunit.client.0.smithi019.stdout:7/163: dwrite da/d24/f2c [0,4194304] 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:8/71: write d5/f6 [2773458,73952] 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:4/115: dwrite d9/d17/f1d [0,4194304] 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:2/81: truncate d0/d3/d11/f10 6272726 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:1/112: dread d1/d2/f24 [0,4194304] 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:7/164: symlink da/d24/l3a 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:0/147: mkdir d5/d7/d2c 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:1/113: chown d1/d2/d18/f1c 2911034 1 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:2/82: rename d0/d2/d1a/c1c to d0/d3/df/c1d 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:2/83: sync 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:4/116: creat d9/f27 x:0 0 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:6/112: dwrite d9/fb [0,4194304] 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:2/84: stat d0 0 2024-09-12T22:11:26.142 INFO:tasks.workunit.client.0.smithi019.stdout:4/117: chown d9/f27 86 1 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:2/85: chown d0/d2/d4/d7 4 1 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:7/165: dread da/d24/d28/f27 [0,4194304] 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:5/145: dwrite d0/f5 [4194304,4194304] 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:8/72: dread f4 [0,4194304] 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:1/114: mkdir d1/d4/dc/df/d2c 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:6/113: mkdir d9/dc/d20/d24 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:7/166: write da/d19/d25/f2e [2622511,1006] 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:5/146: creat d0/d26/f32 x:0 0 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:0/148: dread d5/f16 [0,4194304] 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:6/114: mkdir d9/dc/d25 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:8/73: creat d5/dc/ff x:0 0 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:4/118: rename d9/d14/l22 to d9/db/l28 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:1/115: rename d1/d2/d18/d29/d27/d12/f2b to d1/d2/d18/d29/d27/d12/f2d 0 2024-09-12T22:11:26.143 INFO:tasks.workunit.client.0.smithi019.stdout:4/119: sync 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:0/149: write d5/d7/d10/f24 [592320,4862] 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:8/74: dread - d5/dc/ff zero size 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:3/112: truncate d18/f19 929620 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:6/115: mknod d9/c26 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:2/86: dread d0/d3/d11/fc [0,4194304] 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:6/116: dread - d9/dc/d20/f21 zero size 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:0/150: symlink d5/d7/l2d 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:8/75: creat d5/f10 x:0 0 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:3/113: write d18/f1f [4004561,82967] 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:2/87: symlink d0/l1e 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:1/116: mknod d1/d4/dc/df/d2c/c2e 0 2024-09-12T22:11:26.144 INFO:tasks.workunit.client.0.smithi019.stdout:6/117: write d9/fa [577189,19507] 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:3/114: mknod d18/c20 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:8/76: dread - d5/dc/ff zero size 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:1/117: chown d1/d4/dc/df/f22 117 1 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:9/81: dread fb [0,4194304] 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:8/77: unlink d5/l7 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:3/115: write f15 [1648197,29942] 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:7/167: dwrite da/d24/d28/d1c/f23 [0,4194304] 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:8/78: write f4 [1042169,94438] 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:6/118: symlink d9/dc/d20/d24/l27 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:4/120: dread d9/db/f24 [0,4194304] 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:7/168: symlink da/d24/d28/d1c/l3b 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:1/118: write d1/d4/dc/df/f13 [806065,65945] 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:5/147: truncate d0/f3 2728329 0 2024-09-12T22:11:26.145 INFO:tasks.workunit.client.0.smithi019.stdout:0/151: dwrite d5/f16 [0,4194304] 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:6/119: dread d9/fa [0,4194304] 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:9/82: dread f0 [4194304,4194304] 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:2/88: truncate d0/d3/d11/f19 215652 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:7/169: chown da/d24/c35 751 1 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:6/120: chown l0 17284233 1 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:3/116: dread f12 [0,4194304] 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:1/119: truncate d1/f11 3570634 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:4/121: unlink d9/d17/f1f 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:5/148: creat d0/d1d/f33 x:0 0 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:8/79: truncate d5/f6 1544825 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:0/152: mkdir d5/d7/d10/d26/d2a/d2e 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:6/121: creat d9/dc/d20/d24/f28 x:0 0 0 2024-09-12T22:11:26.146 INFO:tasks.workunit.client.0.smithi019.stdout:1/120: write d1/d4/dc/df/f13 [345315,42230] 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:9/83: creat d12/d1b/f1c x:0 0 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:9/84: fsync fe 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:5/149: rename d0/f6 to d0/f34 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:1/121: chown d1/d4/c6 54149449 1 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:5/150: stat d0/f11 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:6/122: write d9/dc/d20/f1a [1547036,53771] 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:5/151: symlink d0/d24/l35 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:6/123: chown d9/dc/d20/l1b 32048467 1 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:1/122: read - d1/d2/d18/d29/d27/d12/f2d zero size 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:3/117: dwrite f16 [4194304,4194304] 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:4/122: dread d9/fc [0,4194304] 0 2024-09-12T22:11:26.147 INFO:tasks.workunit.client.0.smithi019.stdout:6/124: mknod d9/dc/d20/c29 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:3/118: stat lc 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:5/152: write d0/d26/f32 [413095,90019] 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:3/119: chown d18/d1d/c1e 1 1 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:4/123: fdatasync d9/db/fd 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:2/89: truncate d0/d3/d11/fc 3400276 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:8/80: dread f4 [0,4194304] 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:5/153: chown d0/d1d 122226517 1 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:0/153: write d5/d7/d10/d26/d2a/f2b [2226771,105785] 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:9/85: dwrite f0 [0,4194304] 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:2/90: creat d0/d3/df/f1f x:0 0 0 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:5/154: dread - d0/d26/f2d zero size 2024-09-12T22:11:26.148 INFO:tasks.workunit.client.0.smithi019.stdout:8/81: mknod d5/dc/c11 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:1/123: truncate d1/d4/dc/df/f13 290726 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:9/86: fsync f4 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:7/170: dwrite da/f11 [0,4194304] 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:6/125: write d9/dc/ff [763482,39096] 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:0/154: read d5/d7/d10/f17 [684098,42649] 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:8/82: symlink d5/dc/l12 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:1/124: chown d1/d2/d18/f1c 1821 1 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:2/91: chown d0/d3/df/f1f 1246 1 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:9/87: mknod d12/d1b/c1d 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:1/125: chown d1/d4 1 1 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:3/120: dwrite fe [0,4194304] 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:0/155: mknod d5/d7/d10/c2f 0 2024-09-12T22:11:26.149 INFO:tasks.workunit.client.0.smithi019.stdout:4/124: dread d9/d17/f1d [0,4194304] 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:8/83: write d5/fd [3487766,113834] 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:9/88: write d12/f17 [265234,970] 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:7/171: creat da/d24/d28/d1c/d32/f3c x:0 0 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:4/125: chown d9/db/l28 54067496 1 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:1/126: unlink d1/d2/ca 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:2/92: truncate d0/d2/d12/f17 3520628 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:7/172: dread - da/d24/d28/d1c/d32/f3c zero size 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:8/84: rename d5/cb to d5/c13 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:0/156: creat d5/d7/f30 x:0 0 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:5/155: dwrite d0/f11 [0,4194304] 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:0/157: fdatasync f4 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:5/156: dread - d0/d14/f2b zero size 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:1/127: mknod d1/d2/d18/c2f 0 2024-09-12T22:11:26.150 INFO:tasks.workunit.client.0.smithi019.stdout:6/126: dwrite d9/dc/d20/f14 [0,4194304] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:2/93: symlink d0/d2/d12/l20 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:3/121: dwrite f3 [4194304,4194304] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:8/85: unlink d5/c9 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:0/158: write d5/d7/d10/d26/d2a/f2b [411321,106096] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:5/157: creat d0/d24/f36 x:0 0 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:8/86: readlink d5/dc/l12 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:9/89: dwrite d12/f1a [0,4194304] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:1/128: dread - d1/d2/d18/d29/d27/d12/f1b zero size 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:4/126: dwrite d9/f27 [0,4194304] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:7/173: dread da/d24/d28/d1c/f23 [0,4194304] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:8/87: dread f4 [0,4194304] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:4/127: chown d9/f27 80 1 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:2/94: mkdir d0/d3/d21 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:8/88: read d5/fa [994186,102153] 0 2024-09-12T22:11:26.151 INFO:tasks.workunit.client.0.smithi019.stdout:6/127: creat d9/dc/d20/f2a x:0 0 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:3/122: symlink d18/l21 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:2/95: dread - d0/d2/d12/f1b zero size 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:1/129: mknod d1/d2/d18/d29/d27/c30 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:5/158: write d0/f29 [709606,131060] 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:8/89: creat d5/f14 x:0 0 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:7/174: rename da/l17 to da/d24/d28/l3d 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:1/130: write d1/fe [191926,125033] 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:9/90: write fd [504680,30953] 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:4/128: rename d9 to d9/d25/d29 22 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:5/159: write d0/f10 [2992332,9509] 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:8/90: fdatasync d5/fa 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:9/91: write fd [1368871,28016] 0 2024-09-12T22:11:26.152 INFO:tasks.workunit.client.0.smithi019.stdout:3/123: rename lc to d18/d1d/l22 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:6/128: rename d9/dc/d20 to d9/dc/d20/d2b 22 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:4/129: fsync d9/db/fd 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:2/96: dread d0/d3/d11/f19 [0,4194304] 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:8/91: write d5/f14 [913313,103473] 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:7/175: mknod da/d24/d28/d1c/c3e 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:1/131: creat d1/d4/f31 x:0 0 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:0/159: dread d5/d7/f11 [0,4194304] 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:7/176: chown da/d24/d28/d1c/d32/f3c 50 1 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:1/132: chown d1/d4/dc/f28 35883 1 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:3/124: link ca d18/d1d/c23 0 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:1/133: chown d1/d2 40 1 2024-09-12T22:11:26.153 INFO:tasks.workunit.client.0.smithi019.stdout:2/97: creat d0/d2/d4/f22 x:0 0 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:2/98: readlink d0/l1e 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:9/92: dwrite d12/f1a [0,4194304] 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:4/130: dread d9/fc [0,4194304] 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:9/93: creat d12/f1e x:0 0 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:4/131: readlink d9/la 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:1/134: dread d1/d4/dc/f17 [0,4194304] 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:6/129: dwrite d9/dc/ff [0,4194304] 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:3/125: truncate f9 2805517 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:8/92: dwrite d5/fa [0,4194304] 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:9/94: fdatasync d12/f1e 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:2/99: fdatasync d0/d2/fa 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:5/160: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:9/95: chown f0 1519 1 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:8/93: creat d5/f15 x:0 0 0 2024-09-12T22:11:26.154 INFO:tasks.workunit.client.0.smithi019.stdout:4/132: rmdir d9/d25 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:7/177: dwrite da/d24/d28/d1c/f23 [0,4194304] 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:6/130: truncate d9/dc/d20/f1a 2259244 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:4/133: stat d9/d17/f1d 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:5/161: truncate d0/f17 492139 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:8/94: dread - d5/f15 zero size 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:1/135: truncate d1/f11 35298 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:2/100: chown d0/d2/d12/f17 0 1 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:5/162: dread - d0/ff zero size 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:4/134: chown d9/c1a 1276460509 1 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:1/136: readlink d1/d4/dc/df/l21 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:5/163: stat d0/d14/l25 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:9/96: link fa d12/f1f 0 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:4/135: chown d9/f27 3360 1 2024-09-12T22:11:26.155 INFO:tasks.workunit.client.0.smithi019.stdout:8/95: mkdir d5/d16 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:6/131: creat d9/dc/d20/d24/f2c x:0 0 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:1/137: write d1/fe [903009,51853] 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:7/178: rename da/d19/d25/l37 to da/d30/l3f 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:9/97: mkdir d12/d1b/d20 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:0/160: dread d5/d7/d10/f24 [0,4194304] 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:3/126: dwrite d18/f1c [0,4194304] 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:5/164: creat d0/f37 x:0 0 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:8/96: mkdir d5/dc/d17 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:7/179: symlink da/d24/d28/d1c/d32/l40 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:3/127: mknod d18/c24 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:0/161: rmdir d5/d7/d10/d26/d2a 39 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:8/97: symlink d5/dc/d17/l18 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:6/132: link d9/dc/ff d9/dc/d20/d24/f2d 0 2024-09-12T22:11:26.156 INFO:tasks.workunit.client.0.smithi019.stdout:7/180: write da/d24/f38 [5181098,4150] 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:1/138: rename d1/d4/dc/f17 to d1/d4/dc/f32 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:6/133: stat l8 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:8/98: stat d5/f15 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:8/99: mkdir d5/d16/d19 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:1/139: dread d1/d4/dc/f32 [0,4194304] 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:4/136: dwrite d9/fc [4194304,4194304] 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:0/162: dread d5/d7/f18 [0,4194304] 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:9/98: write f4 [401324,5736] 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:8/100: unlink d5/f14 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:5/165: read d0/d1d/f31 [1587532,126913] 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:2/101: sync 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:3/128: dread f13 [0,4194304] 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:9/99: symlink d12/l21 0 2024-09-12T22:11:26.157 INFO:tasks.workunit.client.0.smithi019.stdout:4/137: symlink d9/l2a 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:0/163: dread d5/d7/f18 [0,4194304] 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:9/100: symlink d12/d1b/l22 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:8/101: chown d5/dc/le 12730 1 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:7/181: dwrite da/d24/d28/f27 [0,4194304] 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:1/140: rename d1/d4/f8 to d1/f33 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:6/134: dwrite d9/dc/d20/d24/f2d [0,4194304] 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:5/166: truncate d0/d24/f36 707447 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:4/138: mkdir d9/db/d2b 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:3/129: truncate d18/f1b 838277 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:8/102: dread - d5/dc/ff zero size 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:5/167: dread - d0/f37 zero size 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:0/164: creat d5/d7/de/f31 x:0 0 0 2024-09-12T22:11:26.158 INFO:tasks.workunit.client.0.smithi019.stdout:7/182: creat da/d19/f41 x:0 0 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:1/141: rmdir d1/d4/dc/df 39 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:3/130: readlink d18/d1d/l22 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:4/139: creat d9/d17/f2c x:0 0 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:6/135: write d9/fa [899483,124299] 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:0/165: chown d5/f16 32 1 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:8/103: symlink d5/dc/d17/l1a 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:7/183: symlink da/d30/l42 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:2/102: dread d0/d3/d11/fc [0,4194304] 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:5/168: rename d0/cd to d0/d24/c38 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:3/131: creat d18/f25 x:0 0 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:2/103: readlink d0/d2/d12/l20 0 2024-09-12T22:11:26.159 INFO:tasks.workunit.client.0.smithi019.stdout:9/101: dread f6 [0,4194304] 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:3/132: fsync d18/f1f 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:8/104: symlink d5/dc/d17/l1b 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:7/184: chown da/d30/l3f 986564986 1 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:1/142: creat d1/d2/d18/d29/d27/d12/f34 x:0 0 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:2/104: fdatasync d0/d2/d4/f22 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:9/102: creat d12/f23 x:0 0 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:8/105: truncate d5/fa 5037623 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:7/185: write da/d19/d25/f2e [996887,126779] 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:0/166: rename d5/d7/d10/d26/d2a/d2e to d5/d7/d2c/d32 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:9/103: write d12/f23 [427168,6558] 0 2024-09-12T22:11:26.160 INFO:tasks.workunit.client.0.smithi019.stdout:5/169: creat d0/f39 x:0 0 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:9/104: stat d12/f15 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:4/140: dwrite f5 [0,4194304] 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:2/105: creat d0/d2/d12/d15/f23 x:0 0 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:9/105: fdatasync d12/f1a 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:6/136: dwrite d9/dc/f15 [0,4194304] 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:9/106: truncate f0 8564125 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:3/133: dread fb [0,4194304] 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:7/186: rename da/d30/l3f to da/d24/d28/l43 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:4/141: unlink d9/d14/l21 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:2/106: fdatasync d0/d2/d4/f16 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:5/170: write d0/f1b [8569694,93784] 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:6/137: creat d9/dc/d20/f2e x:0 0 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:4/142: chown f4 17393930 1 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:8/106: truncate d5/fa 4635015 0 2024-09-12T22:11:26.161 INFO:tasks.workunit.client.0.smithi019.stdout:9/107: mknod d12/d1b/c24 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:1/143: dwrite d1/f33 [4194304,4194304] 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:3/134: mkdir d18/d26 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:0/167: truncate d5/f6 4317926 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:7/187: symlink da/d19/l44 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:9/108: chown fa 5570 1 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:4/143: getdents d9/db/d2b 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:7/188: creat da/d19/d25/d39/f45 x:0 0 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:1/144: write d1/d2/d18/d29/d27/f23 [1281554,113151] 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:0/168: rmdir d5/d7/d2c/d32 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:6/138: getdents d9 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:9/109: getdents d12/d1b/d20 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:0/169: write f4 [808747,21621] 0 2024-09-12T22:11:26.162 INFO:tasks.workunit.client.0.smithi019.stdout:1/145: mkdir d1/d2/d18/d35 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:3/135: dread f13 [0,4194304] 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:2/107: dwrite d0/d2/d12/f1b [0,4194304] 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:6/139: creat d9/dc/d25/f2f x:0 0 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:0/170: creat d5/d7/d10/d26/d2a/f33 x:0 0 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:2/108: chown d0/d2/d12/l20 32 1 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:5/171: truncate d0/f34 872808 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:4/144: chown d9/db 4483 1 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:5/172: stat d0/f15 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:6/140: truncate d9/dc/d20/f2e 560923 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:1/146: write d1/d2/d18/d29/d27/d12/f2d [740115,108374] 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:7/189: getdents da/d19/d25/d39 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:4/145: creat d9/d14/f2d x:0 0 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:0/171: symlink d5/d7/d10/d26/l34 0 2024-09-12T22:11:26.163 INFO:tasks.workunit.client.0.smithi019.stdout:1/147: stat d1/d4/dc/f32 0 2024-09-12T22:11:26.164 INFO:tasks.workunit.client.0.smithi019.stdout:5/173: chown d0/lc 15 1 2024-09-12T22:11:26.164 INFO:tasks.workunit.client.0.smithi019.stdout:2/109: rename d0/d2/fa to d0/d2/d4/f24 0 2024-09-12T22:11:26.164 INFO:tasks.workunit.client.0.smithi019.stdout:9/110: dwrite d12/f1a [0,4194304] 0 2024-09-12T22:11:26.164 INFO:tasks.workunit.client.0.smithi019.stdout:8/107: sync 2024-09-12T22:11:26.164 INFO:tasks.workunit.client.0.smithi019.stdout:3/136: dread f16 [4194304,4194304] 0 2024-09-12T22:11:26.164 INFO:tasks.workunit.client.0.smithi019.stdout:5/174: read d0/d1d/f22 [148526,32043] 0 2024-09-12T22:11:26.171 INFO:tasks.workunit.client.0.smithi019.stdout:3/137: stat d18/d1d/l22 0 2024-09-12T22:11:26.171 INFO:tasks.workunit.client.0.smithi019.stdout:4/146: mknod d9/c2e 0 2024-09-12T22:11:26.171 INFO:tasks.workunit.client.0.smithi019.stdout:1/148: mknod d1/d4/dc/df/c36 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:8/108: creat d5/dc/f1c x:0 0 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:2/110: rename d0/d2/d1a to d0/d3/df/d18/d25 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:5/175: chown d0/d1d/c2a 506267 1 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:9/111: mkdir d12/d1b/d20/d25 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:8/109: readlink d5/dc/l12 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:7/190: dread da/d24/f38 [4194304,4194304] 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:6/141: dwrite f4 [0,4194304] 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:1/149: fsync d1/d2/d18/d29/d27/d12/f1b 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:2/111: mknod d0/d2/d12/c26 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:0/172: dwrite f4 [0,4194304] 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:4/147: link d9/d14/f2d d9/f2f 0 2024-09-12T22:11:26.172 INFO:tasks.workunit.client.0.smithi019.stdout:8/110: mknod d5/c1d 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:3/138: getdents d18/d1d 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:1/150: dread - d1/f14 zero size 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:7/191: chown da/d24/l26 14885422 1 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:1/151: dread - d1/d2/d18/d29/d27/d12/f34 zero size 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:8/111: link d5/dc/d17/l1a d5/dc/l1e 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:0/173: truncate d5/d7/f12 1416454 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:1/152: mkdir d1/d37 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:5/176: dwrite d0/d14/f2b [0,4194304] 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:3/139: dread f13 [0,4194304] 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:4/148: dread d9/ff [0,4194304] 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:9/112: truncate fb 589868 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:6/142: dwrite d9/dc/d20/d24/f2d [4194304,4194304] 0 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:3/140: chown fe 370 1 2024-09-12T22:11:26.173 INFO:tasks.workunit.client.0.smithi019.stdout:5/177: write d0/d24/f36 [1621995,15518] 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:1/153: rmdir d1/d4/dc/df/d2c 39 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:2/112: truncate d0/d2/d4/f24 4412580 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:3/141: dread - f17 zero size 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:6/143: fdatasync d9/dc/d25/f2f 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:9/113: creat d12/f26 x:0 0 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:7/192: dwrite da/d19/d25/d39/f45 [0,4194304] 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:3/142: truncate f4 8874545 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:6/144: stat d9/dc/d25 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:8/112: link d5/c13 d5/d16/d19/c1f 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:5/178: mkdir d0/d26/d3a 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:6/145: chown f4 825 1 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:4/149: creat d9/db/d2b/f30 x:0 0 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:2/113: mknod d0/d3/d21/c27 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:7/193: creat da/d19/f46 x:0 0 0 2024-09-12T22:11:26.174 INFO:tasks.workunit.client.0.smithi019.stdout:3/143: symlink d18/d1d/l27 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:5/179: chown d0/f39 1 1 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:6/146: fdatasync d9/fa 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:8/113: truncate d5/f15 626533 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:0/174: dwrite d5/d7/f18 [0,4194304] 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:2/114: read d0/d3/d11/fc [355094,127899] 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:3/144: write fe [8598107,121457] 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:1/154: dread d1/d4/dc/f19 [0,4194304] 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:8/114: symlink d5/d16/l20 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:7/194: write da/d24/d28/d1c/f29 [395403,65934] 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:5/180: getdents d0/d26/d3a 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:2/115: mknod d0/d2/c28 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:5/181: fdatasync d0/d1d/f20 0 2024-09-12T22:11:26.175 INFO:tasks.workunit.client.0.smithi019.stdout:6/147: truncate d9/dc/d20/f2a 502225 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:8/115: write d5/f6 [2195469,9105] 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:9/114: dread f0 [4194304,4194304] 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:0/175: write d5/d7/d10/d26/d2a/f2b [3509253,5175] 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:2/116: fdatasync d0/d2/d4/f16 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:9/115: fsync d12/f26 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:3/145: rename d18/f1c to d18/f28 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:5/182: mknod d0/d1d/c3b 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:7/195: creat da/f47 x:0 0 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:6/148: mkdir d9/dc/d20/d30 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:3/146: fsync f4 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:9/116: fdatasync ff 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:4/150: truncate d9/db/f20 1260051 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:1/155: truncate d1/d4/dc/df/f13 1317872 0 2024-09-12T22:11:26.176 INFO:tasks.workunit.client.0.smithi019.stdout:0/176: rename d5/lb to d5/d7/d10/d26/d2a/l35 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:7/196: fsync da/f11 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:6/149: chown d9 308 1 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:0/177: sync 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:3/147: mknod d18/d1d/c29 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:4/151: mkdir d9/d14/d31 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:6/150: symlink d9/l31 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:5/183: symlink d0/d26/d3a/l3c 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:6/151: fsync f4 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:0/178: write d5/f16 [1397183,38490] 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:3/148: fsync d18/f28 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:3/149: chown d18/f25 3 1 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:7/197: link da/d24/c35 da/d19/d25/d39/c48 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:6/152: creat d9/dc/d20/f32 x:0 0 0 2024-09-12T22:11:26.177 INFO:tasks.workunit.client.0.smithi019.stdout:9/117: dread f6 [0,4194304] 0 2024-09-12T22:11:26.179 INFO:tasks.workunit.client.0.smithi019.stdout:3/150: creat d18/d1d/f2a x:0 0 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:9/118: symlink d12/d1b/l27 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:7/198: creat da/d19/d25/d39/f49 x:0 0 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:3/151: creat d18/d1d/f2b x:0 0 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:2/117: dwrite d0/d2/d4/f22 [0,4194304] 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:6/153: rename l5 to d9/dc/d20/d30/l33 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:7/199: stat da/d24/f38 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:7/200: creat da/d19/f4a x:0 0 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:4/152: dread d9/db/fd [4194304,4194304] 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:2/118: rename d0/d3/d21/c27 to d0/d3/d21/c29 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:0/179: getdents d5/d7/d10/d26/d2a 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:4/153: rmdir d9 39 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:1/156: write d1/d2/f7 [658984,9336] 0 2024-09-12T22:11:26.180 INFO:tasks.workunit.client.0.smithi019.stdout:7/201: symlink da/d24/d28/d1c/d32/l4b 0 2024-09-12T22:11:26.181 INFO:tasks.workunit.client.0.smithi019.stdout:6/154: getdents d9/dc/d25 0 2024-09-12T22:11:26.181 INFO:tasks.workunit.client.0.smithi019.stdout:8/116: link d5/dc/le d5/l21 0 2024-09-12T22:11:26.181 INFO:tasks.workunit.client.0.smithi019.stdout:1/157: mkdir d1/d2/d38 0 2024-09-12T22:11:26.181 INFO:tasks.workunit.client.0.smithi019.stdout:7/202: readlink da/d19/l44 0 2024-09-12T22:11:26.181 INFO:tasks.workunit.client.0.smithi019.stdout:0/180: creat d5/f36 x:0 0 0 2024-09-12T22:11:26.181 INFO:tasks.workunit.client.0.smithi019.stdout:4/154: fsync d9/db/fd 0 2024-09-12T22:11:26.181 INFO:tasks.workunit.client.0.smithi019.stdout:6/155: creat d9/dc/d20/d30/f34 x:0 0 0 2024-09-12T22:11:26.182 INFO:tasks.workunit.client.0.smithi019.stdout:3/152: write f9 [640709,15543] 0 2024-09-12T22:11:26.182 INFO:tasks.workunit.client.0.smithi019.stdout:9/119: truncate f0 1970491 0 2024-09-12T22:11:26.182 INFO:tasks.workunit.client.0.smithi019.stdout:8/117: mknod d5/d16/c22 0 2024-09-12T22:11:26.182 INFO:tasks.workunit.client.0.smithi019.stdout:4/155: dread - d9/d17/f2c zero size 2024-09-12T22:11:26.182 INFO:tasks.workunit.client.0.smithi019.stdout:9/120: stat f6 0 2024-09-12T22:11:26.182 INFO:tasks.workunit.client.0.smithi019.stdout:5/184: dwrite d0/fe [0,4194304] 0 2024-09-12T22:11:26.182 INFO:tasks.workunit.client.0.smithi019.stdout:0/181: rename f4 to d5/d7/d10/d26/d2a/f37 0 2024-09-12T22:11:26.183 INFO:tasks.workunit.client.0.smithi019.stdout:8/118: creat d5/f23 x:0 0 0 2024-09-12T22:11:26.183 INFO:tasks.workunit.client.0.smithi019.stdout:3/153: symlink d18/d1d/l2c 0 2024-09-12T22:11:26.185 INFO:tasks.workunit.client.0.smithi019.stdout:2/119: dwrite d0/d3/df/f1f [0,4194304] 0 2024-09-12T22:11:26.185 INFO:tasks.workunit.client.0.smithi019.stdout:9/121: write d12/d1b/f1c [909702,95529] 0 2024-09-12T22:11:26.185 INFO:tasks.workunit.client.0.smithi019.stdout:8/119: read d5/f6 [967215,25809] 0 2024-09-12T22:11:26.186 INFO:tasks.workunit.client.0.smithi019.stdout:3/154: read f13 [3140329,66412] 0 2024-09-12T22:11:26.186 INFO:tasks.workunit.client.0.smithi019.stdout:4/156: rename d9/db/l28 to d9/d14/l32 0 2024-09-12T22:11:26.187 INFO:tasks.workunit.client.0.smithi019.stdout:9/122: readlink d12/d1b/l22 0 2024-09-12T22:11:26.187 INFO:tasks.workunit.client.0.smithi019.stdout:5/185: mkdir d0/d1d/d3d 0 2024-09-12T22:11:26.187 INFO:tasks.workunit.client.0.smithi019.stdout:8/120: write d5/dc/ff [914388,126182] 0 2024-09-12T22:11:26.188 INFO:tasks.workunit.client.0.smithi019.stdout:0/182: mkdir d5/d38 0 2024-09-12T22:11:26.188 INFO:tasks.workunit.client.0.smithi019.stdout:3/155: dread - d18/d1d/f2a zero size 2024-09-12T22:11:26.188 INFO:tasks.workunit.client.0.smithi019.stdout:2/120: creat d0/d3/df/f2a x:0 0 0 2024-09-12T22:11:26.188 INFO:tasks.workunit.client.0.smithi019.stdout:7/203: dread da/d24/f38 [0,4194304] 0 2024-09-12T22:11:26.188 INFO:tasks.workunit.client.0.smithi019.stdout:9/123: readlink d12/d1b/l27 0 2024-09-12T22:11:26.189 INFO:tasks.workunit.client.0.smithi019.stdout:8/121: stat d5/fd 0 2024-09-12T22:11:26.189 INFO:tasks.workunit.client.0.smithi019.stdout:9/124: dread - f9 zero size 2024-09-12T22:11:26.190 INFO:tasks.workunit.client.0.smithi019.stdout:1/158: dwrite d1/d2/f24 [0,4194304] 0 2024-09-12T22:11:26.191 INFO:tasks.workunit.client.0.smithi019.stdout:5/186: truncate d0/d1d/f22 290415 0 2024-09-12T22:11:26.191 INFO:tasks.workunit.client.0.smithi019.stdout:7/204: write da/d24/f2c [610969,77687] 0 2024-09-12T22:11:26.191 INFO:tasks.workunit.client.0.smithi019.stdout:6/156: dwrite d9/dc/d20/f2a [0,4194304] 0 2024-09-12T22:11:26.193 INFO:tasks.workunit.client.0.smithi019.stdout:5/187: chown d0/ff 5465 1 2024-09-12T22:11:26.193 INFO:tasks.workunit.client.0.smithi019.stdout:3/156: symlink d18/d26/l2d 0 2024-09-12T22:11:26.193 INFO:tasks.workunit.client.0.smithi019.stdout:7/205: chown da/d24 143619 1 2024-09-12T22:11:26.194 INFO:tasks.workunit.client.0.smithi019.stdout:6/157: unlink d9/dc/d20/f2a 0 2024-09-12T22:11:26.195 INFO:tasks.workunit.client.0.smithi019.stdout:8/122: rename d5/dc/d17/l1a to d5/d16/l24 0 2024-09-12T22:11:26.195 INFO:tasks.workunit.client.0.smithi019.stdout:3/157: creat d18/f2e x:0 0 0 2024-09-12T22:11:26.196 INFO:tasks.workunit.client.0.smithi019.stdout:5/188: creat d0/d1d/d3d/f3e x:0 0 0 2024-09-12T22:11:26.197 INFO:tasks.workunit.client.0.smithi019.stdout:9/125: rename fd to d12/d1b/d20/d25/f28 0 2024-09-12T22:11:26.197 INFO:tasks.workunit.client.0.smithi019.stdout:8/123: rmdir d5/dc/d17 39 2024-09-12T22:11:26.199 INFO:tasks.workunit.client.0.smithi019.stdout:3/158: truncate d18/f25 938791 0 2024-09-12T22:11:26.199 INFO:tasks.workunit.client.0.smithi019.stdout:9/126: chown fa 13571 1 2024-09-12T22:11:26.199 INFO:tasks.workunit.client.0.smithi019.stdout:2/121: dwrite d0/d2/d12/d15/f23 [0,4194304] 0 2024-09-12T22:11:26.200 INFO:tasks.workunit.client.0.smithi019.stdout:0/183: dwrite d5/f36 [0,4194304] 0 2024-09-12T22:11:26.201 INFO:tasks.workunit.client.0.smithi019.stdout:3/159: read f9 [924208,85404] 0 2024-09-12T22:11:26.201 INFO:tasks.workunit.client.0.smithi019.stdout:1/159: rename d1/f33 to d1/d2/d18/d29/d27/f39 0 2024-09-12T22:11:26.202 INFO:tasks.workunit.client.0.smithi019.stdout:5/189: creat d0/d26/f3f x:0 0 0 2024-09-12T22:11:26.202 INFO:tasks.workunit.client.0.smithi019.stdout:7/206: read da/d19/d25/f2e [2949250,111054] 0 2024-09-12T22:11:26.203 INFO:tasks.workunit.client.0.smithi019.stdout:9/127: mkdir d12/d1b/d20/d29 0 2024-09-12T22:11:26.204 INFO:tasks.workunit.client.0.smithi019.stdout:4/157: dwrite d9/db/d2b/f30 [0,4194304] 0 2024-09-12T22:11:26.204 INFO:tasks.workunit.client.0.smithi019.stdout:2/122: write d0/d2/d12/f1b [4333877,54356] 0 2024-09-12T22:11:26.204 INFO:tasks.workunit.client.0.smithi019.stdout:5/190: symlink d0/d24/l40 0 2024-09-12T22:11:26.206 INFO:tasks.workunit.client.0.smithi019.stdout:0/184: creat d5/d7/de/f39 x:0 0 0 2024-09-12T22:11:26.206 INFO:tasks.workunit.client.0.smithi019.stdout:7/207: mknod da/d24/c4c 0 2024-09-12T22:11:26.207 INFO:tasks.workunit.client.0.smithi019.stdout:9/128: creat d12/d1b/d20/f2a x:0 0 0 2024-09-12T22:11:26.208 INFO:tasks.workunit.client.0.smithi019.stdout:4/158: write d9/db/d2b/f30 [2986043,40873] 0 2024-09-12T22:11:26.209 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:26.208+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:26.209 INFO:tasks.workunit.client.0.smithi019.stdout:1/160: link d1/d4/dc/f19 d1/d2/d18/d35/f3a 0 2024-09-12T22:11:26.210 INFO:tasks.workunit.client.0.smithi019.stdout:2/123: symlink d0/d2/d4/l2b 0 2024-09-12T22:11:26.210 INFO:tasks.workunit.client.0.smithi019.stdout:6/158: dwrite d9/dc/d20/d24/f2d [4194304,4194304] 0 2024-09-12T22:11:26.211 INFO:tasks.workunit.client.0.smithi019.stdout:9/129: chown d12/d1b/l27 45 1 2024-09-12T22:11:26.211 INFO:tasks.workunit.client.0.smithi019.stdout:8/124: dwrite d5/f15 [0,4194304] 0 2024-09-12T22:11:26.211 INFO:tasks.workunit.client.0.smithi019.stdout:2/124: stat d0/d3/df 0 2024-09-12T22:11:26.211 INFO:tasks.workunit.client.0.smithi019.stdout:7/208: mknod da/d30/c4d 0 2024-09-12T22:11:26.213 INFO:tasks.workunit.client.0.smithi019.stdout:6/159: mknod d9/dc/d20/c35 0 2024-09-12T22:11:26.214 INFO:tasks.workunit.client.0.smithi019.stdout:1/161: rmdir d1/d4/dc/df/d2c 39 2024-09-12T22:11:26.215 INFO:tasks.workunit.client.0.smithi019.stdout:4/159: getdents d9/d14/d31 0 2024-09-12T22:11:26.215 INFO:tasks.workunit.client.0.smithi019.stdout:3/160: write d18/f19 [766266,110593] 0 2024-09-12T22:11:26.216 INFO:tasks.workunit.client.0.smithi019.stdout:5/191: dread d0/f11 [0,4194304] 0 2024-09-12T22:11:26.216 INFO:tasks.workunit.client.0.smithi019.stdout:4/160: dread - d9/d17/f2c zero size 2024-09-12T22:11:26.216 INFO:tasks.workunit.client.0.smithi019.stdout:6/160: rename d9/fb to d9/dc/f36 0 2024-09-12T22:11:26.216 INFO:tasks.workunit.client.0.smithi019.stdout:8/125: link d5/dc/d17/l18 d5/d16/d19/l25 0 2024-09-12T22:11:26.217 INFO:tasks.workunit.client.0.smithi019.stdout:5/192: symlink d0/l41 0 2024-09-12T22:11:26.217 INFO:tasks.workunit.client.0.smithi019.stdout:3/161: truncate d18/d1d/f2b 1037421 0 2024-09-12T22:11:26.217 INFO:tasks.workunit.client.0.smithi019.stdout:4/161: mkdir d9/d14/d33 0 2024-09-12T22:11:26.221 INFO:tasks.workunit.client.0.smithi019.stdout:1/162: write d1/d2/d18/d29/d27/d12/f2d [171275,90131] 0 2024-09-12T22:11:26.221 INFO:tasks.workunit.client.0.smithi019.stdout:0/185: dwrite d5/d7/d10/d26/d2a/f33 [0,4194304] 0 2024-09-12T22:11:26.221 INFO:tasks.workunit.client.0.smithi019.stdout:4/162: readlink d9/d14/l32 0 2024-09-12T22:11:26.221 INFO:tasks.workunit.client.0.smithi019.stdout:6/161: link f4 d9/dc/d20/d30/f37 0 2024-09-12T22:11:26.221 INFO:tasks.workunit.client.0.smithi019.stdout:4/163: stat d9/ff 0 2024-09-12T22:11:26.221 INFO:tasks.workunit.client.0.smithi019.stdout:3/162: creat d18/d1d/f2f x:0 0 0 2024-09-12T22:11:26.221 INFO:tasks.workunit.client.0.smithi019.stdout:2/125: dwrite d0/d3/d11/f10 [0,4194304] 0 2024-09-12T22:11:26.222 INFO:tasks.workunit.client.0.smithi019.stdout:7/209: read da/d24/d28/f15 [2075252,125719] 0 2024-09-12T22:11:26.222 INFO:tasks.workunit.client.0.smithi019.stdout:4/164: fsync d9/fc 0 2024-09-12T22:11:26.222 INFO:tasks.workunit.client.0.smithi019.stdout:3/163: truncate f16 8825065 0 2024-09-12T22:11:26.222 INFO:tasks.workunit.client.0.smithi019.stdout:6/162: read - d9/dc/d20/d30/f34 zero size 2024-09-12T22:11:26.223 INFO:tasks.workunit.client.0.smithi019.stdout:2/126: fsync d0/d3/d11/f19 0 2024-09-12T22:11:26.223 INFO:tasks.workunit.client.0.smithi019.stdout:3/164: mkdir d18/d26/d30 0 2024-09-12T22:11:26.223 INFO:tasks.workunit.client.0.smithi019.stdout:0/186: write d5/d7/d10/d26/d2a/f37 [4529336,120915] 0 2024-09-12T22:11:26.223 INFO:tasks.workunit.client.0.smithi019.stdout:1/163: symlink d1/d2/d18/d35/l3b 0 2024-09-12T22:11:26.223 INFO:tasks.workunit.client.0.smithi019.stdout:4/165: read d9/db/f24 [886858,95703] 0 2024-09-12T22:11:26.224 INFO:tasks.workunit.client.0.smithi019.stdout:9/130: truncate f11 163573 0 2024-09-12T22:11:26.224 INFO:tasks.workunit.client.0.smithi019.stdout:1/164: read - d1/f14 zero size 2024-09-12T22:11:26.224 INFO:tasks.workunit.client.0.smithi019.stdout:3/165: fdatasync f16 0 2024-09-12T22:11:26.224 INFO:tasks.workunit.client.0.smithi019.stdout:4/166: creat d9/d14/f34 x:0 0 0 2024-09-12T22:11:26.224 INFO:tasks.workunit.client.0.smithi019.stdout:4/167: symlink d9/db/l35 0 2024-09-12T22:11:26.225 INFO:tasks.workunit.client.0.smithi019.stdout:2/127: rename d0/d3/df/d18/d25 to d0/d3/df/d18/d2c 0 2024-09-12T22:11:26.225 INFO:tasks.workunit.client.0.smithi019.stdout:1/165: rename d1/d2/d18/d35/l3b to d1/l3c 0 2024-09-12T22:11:26.226 INFO:tasks.workunit.client.0.smithi019.stdout:0/187: link d5/d7/d10/d26/d2a/l35 d5/d7/d2c/l3a 0 2024-09-12T22:11:26.227 INFO:tasks.workunit.client.0.smithi019.stdout:1/166: unlink d1/d4/dc/df/f22 0 2024-09-12T22:11:26.227 INFO:tasks.workunit.client.0.smithi019.stdout:0/188: fsync d5/d7/d10/d26/d2a/f2b 0 2024-09-12T22:11:26.228 INFO:tasks.workunit.client.0.smithi019.stdout:6/163: dread d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:26.229 INFO:tasks.workunit.client.0.smithi019.stdout:8/126: dread d5/dc/ff [0,4194304] 0 2024-09-12T22:11:26.230 INFO:tasks.workunit.client.0.smithi019.stdout:5/193: truncate d0/fe 848846 0 2024-09-12T22:11:26.230 INFO:tasks.workunit.client.0.smithi019.stdout:3/166: dwrite d18/f19 [0,4194304] 0 2024-09-12T22:11:26.231 INFO:tasks.workunit.client.0.smithi019.stdout:3/167: stat f8 0 2024-09-12T22:11:26.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/128: dread d0/d3/d11/f10 [0,4194304] 0 2024-09-12T22:11:26.231 INFO:tasks.workunit.client.0.smithi019.stdout:8/127: truncate d5/dc/ff 1506623 0 2024-09-12T22:11:26.233 INFO:tasks.workunit.client.0.smithi019.stdout:6/164: link d9/dc/d20/f21 d9/dc/d20/d30/f38 0 2024-09-12T22:11:26.233 INFO:tasks.workunit.client.0.smithi019.stdout:0/189: dread d5/d7/f11 [0,4194304] 0 2024-09-12T22:11:26.233 INFO:tasks.workunit.client.0.smithi019.stdout:9/131: rename d12/d1b/d20/d25/f28 to d12/d1b/d20/f2b 0 2024-09-12T22:11:26.234 INFO:tasks.workunit.client.0.smithi019.stdout:4/168: getdents d9/db 0 2024-09-12T22:11:26.235 INFO:tasks.workunit.client.0.smithi019.stdout:9/132: sync 2024-09-12T22:11:26.235 INFO:tasks.workunit.client.0.smithi019.stdout:0/190: write d5/f16 [9154036,42867] 0 2024-09-12T22:11:26.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/128: mkdir d5/dc/d26 0 2024-09-12T22:11:26.238 INFO:tasks.workunit.client.0.smithi019.stdout:4/169: symlink d9/d14/d31/l36 0 2024-09-12T22:11:26.239 INFO:tasks.workunit.client.0.smithi019.stdout:8/129: truncate d5/fa 4904309 0 2024-09-12T22:11:26.239 INFO:tasks.workunit.client.0.smithi019.stdout:5/194: dwrite d0/f4 [0,4194304] 0 2024-09-12T22:11:26.241 INFO:tasks.workunit.client.0.smithi019.stdout:3/168: dwrite d18/d1d/f2a [0,4194304] 0 2024-09-12T22:11:26.241 INFO:tasks.workunit.client.0.smithi019.stdout:2/129: truncate d0/d2/d12/d15/f23 4010929 0 2024-09-12T22:11:26.241 INFO:tasks.workunit.client.0.smithi019.stdout:8/130: symlink d5/l27 0 2024-09-12T22:11:26.242 INFO:tasks.workunit.client.0.smithi019.stdout:5/195: mkdir d0/d26/d42 0 2024-09-12T22:11:26.242 INFO:tasks.workunit.client.0.smithi019.stdout:3/169: rmdir d18 39 2024-09-12T22:11:26.242 INFO:tasks.workunit.client.0.smithi019.stdout:0/191: rename d5/d7/d10/f17 to d5/d7/f3b 0 2024-09-12T22:11:26.244 INFO:tasks.workunit.client.0.smithi019.stdout:8/131: creat d5/d16/f28 x:0 0 0 2024-09-12T22:11:26.244 INFO:tasks.workunit.client.0.smithi019.stdout:6/165: dwrite d9/dc/f36 [0,4194304] 0 2024-09-12T22:11:26.245 INFO:tasks.workunit.client.0.smithi019.stdout:4/170: rename d9/db/f20 to d9/db/d2b/f37 0 2024-09-12T22:11:26.246 INFO:tasks.workunit.client.0.smithi019.stdout:3/170: mknod d18/d26/c31 0 2024-09-12T22:11:26.246 INFO:tasks.workunit.client.0.smithi019.stdout:6/166: stat d9/fa 0 2024-09-12T22:11:26.246 INFO:tasks.workunit.client.0.smithi019.stdout:0/192: rmdir d5/d38 0 2024-09-12T22:11:26.248 INFO:tasks.workunit.client.0.smithi019.stdout:9/133: dwrite fc [0,4194304] 0 2024-09-12T22:11:26.249 INFO:tasks.workunit.client.0.smithi019.stdout:1/167: dwrite d1/d2/f24 [0,4194304] 0 2024-09-12T22:11:26.249 INFO:tasks.workunit.client.0.smithi019.stdout:4/171: rename d9/d14/f2d to d9/d14/f38 0 2024-09-12T22:11:26.250 INFO:tasks.workunit.client.0.smithi019.stdout:6/167: write d9/dc/f13 [1201037,62058] 0 2024-09-12T22:11:26.251 INFO:tasks.workunit.client.0.smithi019.stdout:9/134: chown ff 1 1 2024-09-12T22:11:26.253 INFO:tasks.workunit.client.0.smithi019.stdout:8/132: getdents d5/d16 0 2024-09-12T22:11:26.253 INFO:tasks.workunit.client.0.smithi019.stdout:5/196: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:11:26.253 INFO:tasks.workunit.client.0.smithi019.stdout:7/210: dread da/f1d [0,4194304] 0 2024-09-12T22:11:26.254 INFO:tasks.workunit.client.0.smithi019.stdout:1/168: symlink d1/d2/d18/d29/d27/l3d 0 2024-09-12T22:11:26.254 INFO:tasks.workunit.client.0.smithi019.stdout:0/193: chown d5/d7/f12 2542371 1 2024-09-12T22:11:26.254 INFO:tasks.workunit.client.0.smithi019.stdout:6/168: fsync d9/dc/d20/f2e 0 2024-09-12T22:11:26.254 INFO:tasks.workunit.client.0.smithi019.stdout:2/130: dwrite d0/d2/d4/f16 [4194304,4194304] 0 2024-09-12T22:11:26.254 INFO:tasks.workunit.client.0.smithi019.stdout:8/133: dread - d5/dc/f1c zero size 2024-09-12T22:11:26.255 INFO:tasks.workunit.client.0.smithi019.stdout:2/131: chown d0/ce 808 1 2024-09-12T22:11:26.255 INFO:tasks.workunit.client.0.smithi019.stdout:5/197: write d0/d14/f16 [1124411,81779] 0 2024-09-12T22:11:26.256 INFO:tasks.workunit.client.0.smithi019.stdout:0/194: write d5/d7/d10/d26/d2a/f33 [1365614,12838] 0 2024-09-12T22:11:26.257 INFO:tasks.workunit.client.0.smithi019.stdout:3/171: link d18/d26/l2d d18/d26/l32 0 2024-09-12T22:11:26.257 INFO:tasks.workunit.client.0.smithi019.stdout:6/169: unlink l8 0 2024-09-12T22:11:26.257 INFO:tasks.workunit.client.0.smithi019.stdout:1/169: creat d1/d2/d18/d29/f3e x:0 0 0 2024-09-12T22:11:26.257 INFO:tasks.workunit.client.0.smithi019.stdout:3/172: stat f16 0 2024-09-12T22:11:26.257 INFO:tasks.workunit.client.0.smithi019.stdout:7/211: unlink da/d24/d28/d1c/d32/l40 0 2024-09-12T22:11:26.257 INFO:tasks.workunit.client.0.smithi019.stdout:2/132: mkdir d0/d3/df/d18/d2c/d2d 0 2024-09-12T22:11:26.258 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11097 4.33 4:cf068428:::100000030d3.00000000:head [write 0~4194304 [2@280488] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.247926+0000", 2024-09-12T22:11:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0087322770000000001, 2024-09-12T22:11:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087525950000000002, 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11097 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.247926+0000", 2024-09-12T22:11:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.247926+0000", 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.247926+0000", 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000005e-07 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.254302+0000", 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063761770000000002 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.254316+0000", 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3546999999999999e-05 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.254323+0000", 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2339999999999997e-06 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.254395+0000", 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1445000000000005e-05 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.254445+0000", 2024-09-12T22:11:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0730999999999999e-05 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:661 3.2 3:4272d415:::200.0000000b:head [write 3551254~19098 [fadvise_dontneed] in=19098b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.256014+0000", 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00064454200000000001, 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000706611, 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256014+0000", 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256014+0000", 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256015+0000", 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2449999999999999e-06 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256093+0000", 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8484000000000003e-05 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256105+0000", 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1851000000000001e-05 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256113+0000", 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1000000000000004e-06 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256163+0000", 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0272999999999998e-05 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256217+0000", 2024-09-12T22:11:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3693999999999998e-05 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:662 3.2 3.a82b4e42 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.256312+0000", 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00034595900000000001, 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046738200000000002, 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "queued for pg", 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256312+0000", 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256312+0000", 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256313+0000", 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4799999999999997e-07 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256332+0000", 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8972000000000001e-05 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256343+0000", 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0893999999999999e-05 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.256350+0000", 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8499999999999996e-06 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 3 2024-09-12T22:11:26.270 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:26.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:26.274 INFO:tasks.workunit.client.0.smithi019.stdout:4/172: read f4 [938000,478] 0 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:1/170: chown d1/f14 8447859 1 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:6/170: dread - d9/dc/d20/d30/f38 zero size 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:7/212: dread - da/d24/d28/d1c/d32/f3c zero size 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:7/213: sync 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:4/173: symlink d9/d17/l39 0 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:6/171: mknod d9/dc/d25/c39 0 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:7/214: fsync da/f1d 0 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:6/172: dread - d9/f22 zero size 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:4/174: dread - d9/f2f zero size 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:9/135: truncate d12/d1b/f1c 544977 0 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:1/171: symlink d1/d2/d18/d29/d27/l3f 0 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:1/172: chown d1/d2 1 1 2024-09-12T22:11:26.275 INFO:tasks.workunit.client.0.smithi019.stdout:4/175: mknod d9/d14/c3a 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:7/215: dread - da/d19/d25/d39/f49 zero size 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:8/134: dwrite d5/dc/ff [0,4194304] 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:0/195: dwrite d5/d7/de/f31 [0,4194304] 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:6/173: rename d9/dc/d20/d24/l27 to d9/dc/d20/d24/l3a 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:1/173: fdatasync d1/d4/dc/df/f13 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:8/135: chown d5/f6 599051 1 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:4/176: creat d9/f3b x:0 0 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:7/216: chown da/d24/d28/d1c/c2d 1 1 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:3/173: read d18/f1f [2084679,9896] 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:5/198: dwrite d0/fe [0,4194304] 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:3/174: sync 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:6/174: rename d9/c26 to d9/dc/c3b 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:3/175: unlink fe 0 2024-09-12T22:11:26.276 INFO:tasks.workunit.client.0.smithi019.stdout:9/136: dwrite f7 [0,4194304] 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:8/136: mkdir d5/d16/d19/d29 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:7/217: write da/d24/d28/f15 [5742406,118469] 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:4/177: fdatasync d9/db/d2b/f30 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:6/175: creat d9/dc/d25/f3c x:0 0 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:0/196: rename d5/d7/f8 to d5/d7/de/f3c 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:3/176: symlink d18/l33 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:1/174: getdents d1/d4 0 2024-09-12T22:11:26.277 INFO:tasks.workunit.client.0.smithi019.stdout:7/218: write da/f47 [708489,96240] 0 2024-09-12T22:11:26.278 INFO:tasks.workunit.client.0.smithi019.stdout:9/137: rename c10 to d12/d1b/c2c 0 2024-09-12T22:11:26.278 INFO:tasks.workunit.client.0.smithi019.stdout:7/219: read da/d24/f38 [3490388,83055] 0 2024-09-12T22:11:26.279 INFO:tasks.workunit.client.0.smithi019.stdout:3/177: write f4 [1679562,56925] 0 2024-09-12T22:11:26.279 INFO:tasks.workunit.client.0.smithi019.stdout:6/176: dread - d9/dc/d20/d24/f28 zero size 2024-09-12T22:11:26.279 INFO:tasks.workunit.client.0.smithi019.stdout:9/138: dread - f9 zero size 2024-09-12T22:11:26.279 INFO:tasks.workunit.client.0.smithi019.stdout:1/175: mknod d1/d2/d18/d29/d27/c40 0 2024-09-12T22:11:26.279 INFO:tasks.workunit.client.0.smithi019.stdout:6/177: dread - d9/f22 zero size 2024-09-12T22:11:26.279 INFO:tasks.workunit.client.0.smithi019.stdout:5/199: dwrite d0/f19 [0,4194304] 0 2024-09-12T22:11:26.279 INFO:tasks.workunit.client.0.smithi019.stdout:3/178: fsync f9 0 2024-09-12T22:11:26.280 INFO:tasks.workunit.client.0.smithi019.stdout:8/137: write d5/f6 [2173584,49686] 0 2024-09-12T22:11:26.282 INFO:tasks.workunit.client.0.smithi019.stdout:4/178: dread d9/db/f24 [0,4194304] 0 2024-09-12T22:11:26.282 INFO:tasks.workunit.client.0.smithi019.stdout:1/176: chown d1/d2/d18/d29/d27/c40 334 1 2024-09-12T22:11:26.283 INFO:tasks.workunit.client.0.smithi019.stdout:9/139: link d12/f1a d12/d1b/d20/d29/f2d 0 2024-09-12T22:11:26.283 INFO:tasks.workunit.client.0.smithi019.stdout:8/138: read d5/fd [2833995,8118] 0 2024-09-12T22:11:26.284 INFO:tasks.workunit.client.0.smithi019.stdout:4/179: symlink d9/d14/d33/l3c 0 2024-09-12T22:11:26.284 INFO:tasks.workunit.client.0.smithi019.stdout:0/197: dwrite d5/d7/f18 [0,4194304] 0 2024-09-12T22:11:26.285 INFO:tasks.workunit.client.0.smithi019.stdout:8/139: rmdir d5/d16/d19 39 2024-09-12T22:11:26.285 INFO:tasks.workunit.client.0.smithi019.stdout:9/140: truncate f11 372420 0 2024-09-12T22:11:26.287 INFO:tasks.workunit.client.0.smithi019.stdout:9/141: mknod d12/c2e 0 2024-09-12T22:11:26.287 INFO:tasks.workunit.client.0.smithi019.stdout:1/177: rename d1/d2/d18/d29/d27/d12/l2a to d1/d2/d18/d35/l41 0 2024-09-12T22:11:26.287 INFO:tasks.workunit.client.0.smithi019.stdout:3/179: dwrite d18/f19 [0,4194304] 0 2024-09-12T22:11:26.288 INFO:tasks.workunit.client.0.smithi019.stdout:6/178: dwrite d9/dc/f15 [0,4194304] 0 2024-09-12T22:11:26.289 INFO:tasks.workunit.client.0.smithi019.stdout:9/142: mkdir d12/d1b/d2f 0 2024-09-12T22:11:26.289 INFO:tasks.workunit.client.0.smithi019.stdout:8/140: creat d5/dc/f2a x:0 0 0 2024-09-12T22:11:26.289 INFO:tasks.workunit.client.0.smithi019.stdout:8/141: fdatasync d5/f15 0 2024-09-12T22:11:26.289 INFO:tasks.workunit.client.0.smithi019.stdout:9/143: chown d12/d1b/d20 19757821 1 2024-09-12T22:11:26.290 INFO:tasks.workunit.client.0.smithi019.stdout:0/198: rename d5/d7/l1a to d5/d7/de/l3d 0 2024-09-12T22:11:26.291 INFO:tasks.workunit.client.0.smithi019.stdout:8/142: chown d5/l21 9 1 2024-09-12T22:11:26.291 INFO:tasks.workunit.client.0.smithi019.stdout:6/179: rename d9/dc/d25 to d9/d3d 0 2024-09-12T22:11:26.291 INFO:tasks.workunit.client.0.smithi019.stdout:1/178: creat d1/d4/dc/df/d2c/f42 x:0 0 0 2024-09-12T22:11:26.292 INFO:tasks.workunit.client.0.smithi019.stdout:8/143: dread - d5/d16/f28 zero size 2024-09-12T22:11:26.292 INFO:tasks.workunit.client.0.smithi019.stdout:6/180: symlink d9/d3d/l3e 0 2024-09-12T22:11:26.293 INFO:tasks.workunit.client.0.smithi019.stdout:1/179: symlink d1/d37/l43 0 2024-09-12T22:11:26.293 INFO:tasks.workunit.client.0.smithi019.stdout:8/144: creat d5/dc/d17/f2b x:0 0 0 2024-09-12T22:11:26.293 INFO:tasks.workunit.client.0.smithi019.stdout:0/199: getdents d5/d7/d10 0 2024-09-12T22:11:26.294 INFO:tasks.workunit.client.0.smithi019.stdout:1/180: readlink d1/d4/dc/df/l21 0 2024-09-12T22:11:26.294 INFO:tasks.workunit.client.0.smithi019.stdout:8/145: mknod d5/dc/c2c 0 2024-09-12T22:11:26.296 INFO:tasks.workunit.client.0.smithi019.stdout:0/200: dread d5/d7/d10/f24 [0,4194304] 0 2024-09-12T22:11:26.297 INFO:tasks.workunit.client.0.smithi019.stdout:9/144: dwrite fe [0,4194304] 0 2024-09-12T22:11:26.297 INFO:tasks.workunit.client.0.smithi019.stdout:8/146: symlink d5/l2d 0 2024-09-12T22:11:26.297 INFO:tasks.workunit.client.0.smithi019.stdout:5/200: truncate d0/f3 2002825 0 2024-09-12T22:11:26.299 INFO:tasks.workunit.client.0.smithi019.stdout:0/201: creat d5/d7/d10/d26/f3e x:0 0 0 2024-09-12T22:11:26.300 INFO:tasks.workunit.client.0.smithi019.stdout:7/220: truncate da/d19/d25/d39/f45 4160038 0 2024-09-12T22:11:26.300 INFO:tasks.workunit.client.0.smithi019.stdout:6/181: dwrite d9/d3d/f2f [0,4194304] 0 2024-09-12T22:11:26.301 INFO:tasks.workunit.client.0.smithi019.stdout:4/180: truncate f5 5365784 0 2024-09-12T22:11:26.301 INFO:tasks.workunit.client.0.smithi019.stdout:9/145: getdents d12/d1b/d20 0 2024-09-12T22:11:26.302 INFO:tasks.workunit.client.0.smithi019.stdout:1/181: dwrite d1/d2/f7 [0,4194304] 0 2024-09-12T22:11:26.302 INFO:tasks.workunit.client.0.smithi019.stdout:3/180: truncate d18/d1d/f2a 1391370 0 2024-09-12T22:11:26.303 INFO:tasks.workunit.client.0.smithi019.stdout:5/201: getdents d0/d26/d42 0 2024-09-12T22:11:26.303 INFO:tasks.workunit.client.0.smithi019.stdout:6/182: chown d9/ce 15 1 2024-09-12T22:11:26.306 INFO:tasks.workunit.client.0.smithi019.stdout:0/202: rename d5/d7/d10/d26/d2a/l35 to d5/d7/de/l3f 0 2024-09-12T22:11:26.306 INFO:tasks.workunit.client.0.smithi019.stdout:3/181: read d18/f19 [2651417,56796] 0 2024-09-12T22:11:26.306 INFO:tasks.workunit.client.0.smithi019.stdout:5/202: dread - d0/f39 zero size 2024-09-12T22:11:26.308 INFO:tasks.workunit.client.0.smithi019.stdout:8/147: dwrite d5/dc/f1c [0,4194304] 0 2024-09-12T22:11:26.309 INFO:tasks.workunit.client.0.smithi019.stdout:1/182: truncate d1/d2/d18/d29/f3e 246896 0 2024-09-12T22:11:26.310 INFO:tasks.workunit.client.0.smithi019.stdout:3/182: creat d18/f34 x:0 0 0 2024-09-12T22:11:26.310 INFO:tasks.workunit.client.0.smithi019.stdout:0/203: mknod d5/d7/d10/c40 0 2024-09-12T22:11:26.310 INFO:tasks.workunit.client.0.smithi019.stdout:6/183: write d9/dc/d20/f1a [1933420,52592] 0 2024-09-12T22:11:26.311 INFO:tasks.workunit.client.0.smithi019.stdout:7/221: dwrite da/f11 [0,4194304] 0 2024-09-12T22:11:26.312 INFO:tasks.workunit.client.0.smithi019.stdout:8/148: creat d5/dc/f2e x:0 0 0 2024-09-12T22:11:26.314 INFO:tasks.workunit.client.0.smithi019.stdout:1/183: truncate d1/d4/f31 410686 0 2024-09-12T22:11:26.314 INFO:tasks.workunit.client.0.smithi019.stdout:3/183: mkdir d18/d1d/d35 0 2024-09-12T22:11:26.314 INFO:tasks.workunit.client.0.smithi019.stdout:6/184: creat d9/f3f x:0 0 0 2024-09-12T22:11:26.315 INFO:tasks.workunit.client.0.smithi019.stdout:6/185: sync 2024-09-12T22:11:26.315 INFO:tasks.workunit.client.0.smithi019.stdout:0/204: unlink d5/d7/d10/d26/d2a/f33 0 2024-09-12T22:11:26.315 INFO:tasks.workunit.client.0.smithi019.stdout:1/184: readlink d1/d37/l43 0 2024-09-12T22:11:26.315 INFO:tasks.workunit.client.0.smithi019.stdout:3/184: fsync f17 0 2024-09-12T22:11:26.315 INFO:tasks.workunit.client.0.smithi019.stdout:1/185: sync 2024-09-12T22:11:26.316 INFO:tasks.workunit.client.0.smithi019.stdout:8/149: mknod d5/d16/d19/c2f 0 2024-09-12T22:11:26.316 INFO:tasks.workunit.client.0.smithi019.stdout:0/205: fdatasync d5/f1f 0 2024-09-12T22:11:26.316 INFO:tasks.workunit.client.0.smithi019.stdout:3/185: readlink d18/l21 0 2024-09-12T22:11:26.316 INFO:tasks.workunit.client.0.smithi019.stdout:9/146: dwrite d12/d1b/d20/f2a [0,4194304] 0 2024-09-12T22:11:26.317 INFO:tasks.workunit.client.0.smithi019.stdout:4/181: dwrite d9/db/fd [4194304,4194304] 0 2024-09-12T22:11:26.317 INFO:tasks.workunit.client.0.smithi019.stdout:6/186: dread - d9/dc/d20/f21 zero size 2024-09-12T22:11:26.318 INFO:tasks.workunit.client.0.smithi019.stdout:1/186: chown d1/d2/d18/d29/d27/c40 4024497 1 2024-09-12T22:11:26.318 INFO:tasks.workunit.client.0.smithi019.stdout:3/186: chown f3 25466786 1 2024-09-12T22:11:26.319 INFO:tasks.workunit.client.0.smithi019.stdout:2/133: dread d0/d2/d12/f17 [0,4194304] 0 2024-09-12T22:11:26.320 INFO:tasks.workunit.client.0.smithi019.stdout:9/147: creat d12/f30 x:0 0 0 2024-09-12T22:11:26.320 INFO:tasks.workunit.client.0.smithi019.stdout:1/187: chown d1/d2/d18/d29/d27/d12 5533969 1 2024-09-12T22:11:26.320 INFO:tasks.workunit.client.0.smithi019.stdout:6/187: symlink d9/l40 0 2024-09-12T22:11:26.320 INFO:tasks.workunit.client.0.smithi019.stdout:4/182: mknod d9/d14/c3d 0 2024-09-12T22:11:26.320 INFO:tasks.workunit.client.0.smithi019.stdout:9/148: readlink d12/l13 0 2024-09-12T22:11:26.321 INFO:tasks.workunit.client.0.smithi019.stdout:5/203: write d0/f3 [1634248,68657] 0 2024-09-12T22:11:26.321 INFO:tasks.workunit.client.0.smithi019.stdout:3/187: truncate d18/d1d/f2f 384396 0 2024-09-12T22:11:26.322 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:26.321+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:26.323 INFO:tasks.workunit.client.0.smithi019.stdout:4/183: chown d9/db/l35 5198651 1 2024-09-12T22:11:26.323 INFO:tasks.workunit.client.0.smithi019.stdout:1/188: write d1/d2/f7 [957710,24808] 0 2024-09-12T22:11:26.323 INFO:tasks.workunit.client.0.smithi019.stdout:5/204: stat d0/d14/f2b 0 2024-09-12T22:11:26.323 INFO:tasks.workunit.client.0.smithi019.stdout:9/149: truncate d12/f30 242200 0 2024-09-12T22:11:26.323 INFO:tasks.workunit.client.0.smithi019.stdout:3/188: stat d18/d1d/d35 0 2024-09-12T22:11:26.324 INFO:tasks.workunit.client.0.smithi019.stdout:1/189: fdatasync d1/d2/d18/d29/f3e 0 2024-09-12T22:11:26.324 INFO:tasks.workunit.client.0.smithi019.stdout:5/205: symlink d0/d14/l43 0 2024-09-12T22:11:26.325 INFO:tasks.workunit.client.0.smithi019.stdout:5/206: stat d0/l2c 0 2024-09-12T22:11:26.327 INFO:tasks.workunit.client.0.smithi019.stdout:5/207: fsync d0/d1d/f33 0 2024-09-12T22:11:26.327 INFO:tasks.workunit.client.0.smithi019.stdout:3/189: truncate d18/d1d/f2a 438330 0 2024-09-12T22:11:26.327 INFO:tasks.workunit.client.0.smithi019.stdout:2/134: dwrite d0/d3/df/f2a [0,4194304] 0 2024-09-12T22:11:26.328 INFO:tasks.workunit.client.0.smithi019.stdout:2/135: chown d0 137092 1 2024-09-12T22:11:26.328 INFO:tasks.workunit.client.0.smithi019.stdout:1/190: chown d1/d2/d18/d29/d27/d12/f1b 46 1 2024-09-12T22:11:26.328 INFO:tasks.workunit.client.0.smithi019.stdout:3/190: creat d18/d26/f36 x:0 0 0 2024-09-12T22:11:26.329 INFO:tasks.workunit.client.0.smithi019.stdout:9/150: dread f6 [0,4194304] 0 2024-09-12T22:11:26.329 INFO:tasks.workunit.client.0.smithi019.stdout:1/191: readlink d1/d4/l1d 0 2024-09-12T22:11:26.329 INFO:tasks.workunit.client.0.smithi019.stdout:5/208: rename d0/f37 to d0/d1d/f44 0 2024-09-12T22:11:26.330 INFO:tasks.workunit.client.0.smithi019.stdout:3/191: fdatasync f8 0 2024-09-12T22:11:26.330 INFO:tasks.workunit.client.0.smithi019.stdout:6/188: dwrite d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:26.330 INFO:tasks.workunit.client.0.smithi019.stdout:2/136: chown d0/d3/d11/f19 0 1 2024-09-12T22:11:26.330 INFO:tasks.workunit.client.0.smithi019.stdout:8/150: dwrite d5/fa [0,4194304] 0 2024-09-12T22:11:26.331 INFO:tasks.workunit.client.0.smithi019.stdout:2/137: sync 2024-09-12T22:11:26.331 INFO:tasks.workunit.client.0.smithi019.stdout:1/192: chown d1/d2/l16 669131 1 2024-09-12T22:11:26.333 INFO:tasks.workunit.client.0.smithi019.stdout:1/193: chown d1/d4/dc/df 590452 1 2024-09-12T22:11:26.333 INFO:tasks.workunit.client.0.smithi019.stdout:6/189: symlink d9/dc/d20/d30/l41 0 2024-09-12T22:11:26.333 INFO:tasks.workunit.client.0.smithi019.stdout:5/209: creat d0/d1d/f45 x:0 0 0 2024-09-12T22:11:26.333 INFO:tasks.workunit.client.0.smithi019.stdout:2/138: mkdir d0/d3/d11/d2e 0 2024-09-12T22:11:26.333 INFO:tasks.workunit.client.0.smithi019.stdout:0/206: truncate d5/f36 2945337 0 2024-09-12T22:11:26.334 INFO:tasks.workunit.client.0.smithi019.stdout:8/151: creat d5/dc/d26/f30 x:0 0 0 2024-09-12T22:11:26.334 INFO:tasks.workunit.client.0.smithi019.stdout:5/210: symlink d0/d1d/d3d/l46 0 2024-09-12T22:11:26.335 INFO:tasks.workunit.client.0.smithi019.stdout:6/190: creat d9/dc/d20/d30/f42 x:0 0 0 2024-09-12T22:11:26.336 INFO:tasks.workunit.client.0.smithi019.stdout:3/192: truncate d18/d1d/f2b 412400 0 2024-09-12T22:11:26.336 INFO:tasks.workunit.client.0.smithi019.stdout:5/211: mkdir d0/d14/d47 0 2024-09-12T22:11:26.337 INFO:tasks.workunit.client.0.smithi019.stdout:8/152: creat d5/d16/d19/f31 x:0 0 0 2024-09-12T22:11:26.337 INFO:tasks.workunit.client.0.smithi019.stdout:7/222: dwrite da/d19/d25/d39/f45 [0,4194304] 0 2024-09-12T22:11:26.339 INFO:tasks.workunit.client.0.smithi019.stdout:3/193: mknod d18/d26/c37 0 2024-09-12T22:11:26.341 INFO:tasks.workunit.client.0.smithi019.stdout:2/139: dread d0/d2/d4/f24 [0,4194304] 0 2024-09-12T22:11:26.341 INFO:tasks.workunit.client.0.smithi019.stdout:1/194: dwrite d1/fe [0,4194304] 0 2024-09-12T22:11:26.342 INFO:tasks.workunit.client.0.smithi019.stdout:0/207: truncate d5/d7/d10/d26/d2a/f2b 1754242 0 2024-09-12T22:11:26.342 INFO:tasks.workunit.client.0.smithi019.stdout:6/191: write d9/dc/d20/f21 [748521,124714] 0 2024-09-12T22:11:26.342 INFO:tasks.workunit.client.0.smithi019.stdout:1/195: chown d1/d37 13996 1 2024-09-12T22:11:26.344 INFO:tasks.workunit.client.0.smithi019.stdout:7/223: link da/l31 da/d24/l4e 0 2024-09-12T22:11:26.345 INFO:tasks.workunit.client.0.smithi019.stdout:2/140: symlink d0/d3/df/l2f 0 2024-09-12T22:11:26.345 INFO:tasks.workunit.client.0.smithi019.stdout:7/224: sync 2024-09-12T22:11:26.345 INFO:tasks.workunit.client.0.smithi019.stdout:6/192: mknod d9/c43 0 2024-09-12T22:11:26.345 INFO:tasks.workunit.client.0.smithi019.stdout:8/153: dwrite d5/f10 [0,4194304] 0 2024-09-12T22:11:26.345 INFO:tasks.workunit.client.0.smithi019.stdout:0/208: creat d5/f41 x:0 0 0 2024-09-12T22:11:26.345 INFO:tasks.workunit.client.0.smithi019.stdout:3/194: stat d18/d1d/f2a 0 2024-09-12T22:11:26.346 INFO:tasks.workunit.client.0.smithi019.stdout:1/196: chown d1/d2/d18/d35/l41 15178 1 2024-09-12T22:11:26.346 INFO:tasks.workunit.client.0.smithi019.stdout:7/225: chown da/l31 4 1 2024-09-12T22:11:26.346 INFO:tasks.workunit.client.0.smithi019.stdout:3/195: fsync f4 0 2024-09-12T22:11:26.347 INFO:tasks.workunit.client.0.smithi019.stdout:6/193: creat d9/dc/f44 x:0 0 0 2024-09-12T22:11:26.347 INFO:tasks.workunit.client.0.smithi019.stdout:2/141: mkdir d0/d3/df/d18/d2c/d30 0 2024-09-12T22:11:26.347 INFO:tasks.workunit.client.0.smithi019.stdout:8/154: truncate d5/dc/d26/f30 474821 0 2024-09-12T22:11:26.348 INFO:tasks.workunit.client.0.smithi019.stdout:0/209: creat d5/d7/d10/f42 x:0 0 0 2024-09-12T22:11:26.348 INFO:tasks.workunit.client.0.smithi019.stdout:6/194: chown d9/dc/d20/c29 12 1 2024-09-12T22:11:26.348 INFO:tasks.workunit.client.0.smithi019.stdout:1/197: creat d1/d2/d18/d29/d27/d12/f44 x:0 0 0 2024-09-12T22:11:26.349 INFO:tasks.workunit.client.0.smithi019.stdout:7/226: rename da/d24/l26 to da/d24/l4f 0 2024-09-12T22:11:26.349 INFO:tasks.workunit.client.0.smithi019.stdout:3/196: dread d18/d1d/f2a [0,4194304] 0 2024-09-12T22:11:26.350 INFO:tasks.workunit.client.0.smithi019.stdout:8/155: mkdir d5/d16/d19/d32 0 2024-09-12T22:11:26.350 INFO:tasks.workunit.client.0.smithi019.stdout:3/197: stat cf 0 2024-09-12T22:11:26.350 INFO:tasks.workunit.client.0.smithi019.stdout:0/210: mkdir d5/d7/d10/d43 0 2024-09-12T22:11:26.350 INFO:tasks.workunit.client.0.smithi019.stdout:8/156: write d5/f6 [822499,91239] 0 2024-09-12T22:11:26.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/195: symlink d9/dc/d20/d30/l45 0 2024-09-12T22:11:26.350 INFO:tasks.workunit.client.0.smithi019.stdout:0/211: chown d5/d7/d10/c15 31540000 1 2024-09-12T22:11:26.351 INFO:tasks.workunit.client.0.smithi019.stdout:6/196: symlink d9/dc/l46 0 2024-09-12T22:11:26.351 INFO:tasks.workunit.client.0.smithi019.stdout:8/157: mknod d5/d16/c33 0 2024-09-12T22:11:26.352 INFO:tasks.workunit.client.0.smithi019.stdout:0/212: getdents d5/d7/d10/d43 0 2024-09-12T22:11:26.354 INFO:tasks.workunit.client.0.smithi019.stdout:6/197: read d9/fa [54257,111878] 0 2024-09-12T22:11:26.355 INFO:tasks.workunit.client.0.smithi019.stdout:2/142: dread d0/d3/d11/f19 [0,4194304] 0 2024-09-12T22:11:26.355 INFO:tasks.workunit.client.0.smithi019.stdout:9/151: dread f4 [0,4194304] 0 2024-09-12T22:11:26.357 INFO:tasks.workunit.client.0.smithi019.stdout:1/198: dwrite d1/d4/dc/f19 [0,4194304] 0 2024-09-12T22:11:26.357 INFO:tasks.workunit.client.0.smithi019.stdout:3/198: dwrite d18/f19 [0,4194304] 0 2024-09-12T22:11:26.357 INFO:tasks.workunit.client.0.smithi019.stdout:6/198: chown d9/f22 6 1 2024-09-12T22:11:26.358 INFO:tasks.workunit.client.0.smithi019.stdout:2/143: rename d0/d2 to d0/d31 0 2024-09-12T22:11:26.358 INFO:tasks.workunit.client.0.smithi019.stdout:3/199: chown c14 2 1 2024-09-12T22:11:26.358 INFO:tasks.workunit.client.0.smithi019.stdout:9/152: mknod d12/c31 0 2024-09-12T22:11:26.359 INFO:tasks.workunit.client.0.smithi019.stdout:6/199: read - d9/d3d/f3c zero size 2024-09-12T22:11:26.359 INFO:tasks.workunit.client.0.smithi019.stdout:1/199: chown d1/d2/d18/d29/d27 12388300 1 2024-09-12T22:11:26.359 INFO:tasks.workunit.client.0.smithi019.stdout:8/158: dwrite d5/d16/d19/f31 [0,4194304] 0 2024-09-12T22:11:26.362 INFO:tasks.workunit.client.0.smithi019.stdout:6/200: truncate d9/dc/d20/d24/f2d 9063588 0 2024-09-12T22:11:26.362 INFO:tasks.workunit.client.0.smithi019.stdout:3/200: mknod d18/d1d/c38 0 2024-09-12T22:11:26.362 INFO:tasks.workunit.client.0.smithi019.stdout:9/153: creat d12/d1b/f32 x:0 0 0 2024-09-12T22:11:26.362 INFO:tasks.workunit.client.0.smithi019.stdout:8/159: creat d5/d16/d19/f34 x:0 0 0 2024-09-12T22:11:26.362 INFO:tasks.workunit.client.0.smithi019.stdout:2/144: mkdir d0/d3/df/d18/d2c/d30/d32 0 2024-09-12T22:11:26.363 INFO:tasks.workunit.client.0.smithi019.stdout:9/154: write f5 [729879,78246] 0 2024-09-12T22:11:26.364 INFO:tasks.workunit.client.0.smithi019.stdout:1/200: mkdir d1/d4/dc/df/d45 0 2024-09-12T22:11:26.364 INFO:tasks.workunit.client.0.smithi019.stdout:6/201: unlink d9/dc/d20/l1b 0 2024-09-12T22:11:26.364 INFO:tasks.workunit.client.0.smithi019.stdout:8/160: symlink d5/dc/d17/l35 0 2024-09-12T22:11:26.364 INFO:tasks.workunit.client.0.smithi019.stdout:9/155: mknod d12/d1b/c33 0 2024-09-12T22:11:26.365 INFO:tasks.workunit.client.0.smithi019.stdout:4/184: dread d9/d17/f1d [0,4194304] 0 2024-09-12T22:11:26.365 INFO:tasks.workunit.client.0.smithi019.stdout:9/156: readlink d12/l13 0 2024-09-12T22:11:26.365 INFO:tasks.workunit.client.0.smithi019.stdout:6/202: read - d9/f22 zero size 2024-09-12T22:11:26.366 INFO:tasks.workunit.client.0.smithi019.stdout:4/185: read - d9/d14/f38 zero size 2024-09-12T22:11:26.366 INFO:tasks.workunit.client.0.smithi019.stdout:8/161: creat d5/dc/d26/f36 x:0 0 0 2024-09-12T22:11:26.367 INFO:tasks.workunit.client.0.smithi019.stdout:5/212: dread d0/d24/f36 [0,4194304] 0 2024-09-12T22:11:26.367 INFO:tasks.workunit.client.0.smithi019.stdout:2/145: truncate d0/d3/d11/f19 511110 0 2024-09-12T22:11:26.367 INFO:tasks.workunit.client.0.smithi019.stdout:9/157: symlink d12/l34 0 2024-09-12T22:11:26.367 INFO:tasks.workunit.client.0.smithi019.stdout:6/203: dread - d9/dc/d20/d24/f2c zero size 2024-09-12T22:11:26.368 INFO:tasks.workunit.client.0.smithi019.stdout:5/213: readlink d0/l2c 0 2024-09-12T22:11:26.368 INFO:tasks.workunit.client.0.smithi019.stdout:3/201: dwrite d18/f1b [0,4194304] 0 2024-09-12T22:11:26.368 INFO:tasks.workunit.client.0.smithi019.stdout:8/162: symlink d5/dc/l37 0 2024-09-12T22:11:26.369 INFO:tasks.workunit.client.0.smithi019.stdout:5/214: dread - d0/d26/f2d zero size 2024-09-12T22:11:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:1/201: dread d1/d2/f7 [0,4194304] 0 2024-09-12T22:11:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:4/186: rename d9/c2e to d9/c3e 0 2024-09-12T22:11:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:3/202: rmdir d18/d1d 39 2024-09-12T22:11:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:6/204: readlink d9/dc/ld 0 2024-09-12T22:11:26.371 INFO:tasks.workunit.client.0.smithi019.stdout:5/215: creat d0/d1d/d3d/f48 x:0 0 0 2024-09-12T22:11:26.372 INFO:tasks.workunit.client.0.smithi019.stdout:8/163: creat d5/d16/d19/d29/f38 x:0 0 0 2024-09-12T22:11:26.372 INFO:tasks.workunit.client.0.smithi019.stdout:1/202: chown d1/d4/dc/f32 65342955 1 2024-09-12T22:11:26.372 INFO:tasks.workunit.client.0.smithi019.stdout:6/205: fsync d9/dc/d20/f32 0 2024-09-12T22:11:26.372 INFO:tasks.workunit.client.0.smithi019.stdout:8/164: stat d5/d16/d19/l25 0 2024-09-12T22:11:26.373 INFO:tasks.workunit.client.0.smithi019.stdout:5/216: rename d0/d1d to d0/d1d/d3d/d49 22 2024-09-12T22:11:26.373 INFO:tasks.workunit.client.0.smithi019.stdout:4/187: write d9/d17/f1d [4285940,33289] 0 2024-09-12T22:11:26.373 INFO:tasks.workunit.client.0.smithi019.stdout:1/203: stat d1/d2/d18/d29/d27/c30 0 2024-09-12T22:11:26.373 INFO:tasks.workunit.client.0.smithi019.stdout:3/203: symlink d18/d1d/l39 0 2024-09-12T22:11:26.374 INFO:tasks.workunit.client.0.smithi019.stdout:5/217: creat d0/d14/d47/f4a x:0 0 0 2024-09-12T22:11:26.374 INFO:tasks.workunit.client.0.smithi019.stdout:8/165: fdatasync d5/d16/d19/d29/f38 0 2024-09-12T22:11:26.374 INFO:tasks.workunit.client.0.smithi019.stdout:4/188: mkdir d9/d14/d31/d3f 0 2024-09-12T22:11:26.375 INFO:tasks.workunit.client.0.smithi019.stdout:6/206: link d9/dc/d20/c29 d9/dc/d20/c47 0 2024-09-12T22:11:26.375 INFO:tasks.workunit.client.0.smithi019.stdout:3/204: mknod d18/d26/c3a 0 2024-09-12T22:11:26.375 INFO:tasks.workunit.client.0.smithi019.stdout:5/218: creat d0/d14/f4b x:0 0 0 2024-09-12T22:11:26.375 INFO:tasks.workunit.client.0.smithi019.stdout:6/207: dread - d9/dc/d20/d24/f2c zero size 2024-09-12T22:11:26.376 INFO:tasks.workunit.client.0.smithi019.stdout:3/205: creat d18/d1d/f3b x:0 0 0 2024-09-12T22:11:26.376 INFO:tasks.workunit.client.0.smithi019.stdout:8/166: symlink d5/dc/d17/l39 0 2024-09-12T22:11:26.376 INFO:tasks.workunit.client.0.smithi019.stdout:5/219: chown d0/d14/l43 1997 1 2024-09-12T22:11:26.377 INFO:tasks.workunit.client.0.smithi019.stdout:7/227: dread da/d24/d28/d1c/f23 [0,4194304] 0 2024-09-12T22:11:26.378 INFO:tasks.workunit.client.0.smithi019.stdout:6/208: write d9/dc/d20/d30/f34 [78055,90358] 0 2024-09-12T22:11:26.379 INFO:tasks.workunit.client.0.smithi019.stdout:7/228: fsync da/f11 0 2024-09-12T22:11:26.381 INFO:tasks.workunit.client.0.smithi019.stdout:8/167: stat d5/dc/l1e 0 2024-09-12T22:11:26.381 INFO:tasks.workunit.client.0.smithi019.stdout:7/229: creat da/d19/f50 x:0 0 0 2024-09-12T22:11:26.382 INFO:tasks.workunit.client.0.smithi019.stdout:6/209: chown d9/dc/c3b 252097 1 2024-09-12T22:11:26.382 INFO:tasks.workunit.client.0.smithi019.stdout:0/213: dread d5/f1e [0,4194304] 0 2024-09-12T22:11:26.382 INFO:tasks.workunit.client.0.smithi019.stdout:1/204: dwrite d1/d4/dc/f19 [0,4194304] 0 2024-09-12T22:11:26.383 INFO:tasks.workunit.client.0.smithi019.stdout:4/189: dread d9/db/d2b/f30 [0,4194304] 0 2024-09-12T22:11:26.383 INFO:tasks.workunit.client.0.smithi019.stdout:3/206: truncate d18/d1d/f2f 185659 0 2024-09-12T22:11:26.384 INFO:tasks.workunit.client.0.smithi019.stdout:8/168: write d5/f10 [1999894,29752] 0 2024-09-12T22:11:26.385 INFO:tasks.workunit.client.0.smithi019.stdout:0/214: mkdir d5/d7/d2c/d44 0 2024-09-12T22:11:26.385 INFO:tasks.workunit.client.0.smithi019.stdout:7/230: write da/d24/d28/d1c/f20 [266622,47284] 0 2024-09-12T22:11:26.386 INFO:tasks.workunit.client.0.smithi019.stdout:1/205: write d1/d4/f1f [3211507,113049] 0 2024-09-12T22:11:26.386 INFO:tasks.workunit.client.0.smithi019.stdout:6/210: mknod d9/dc/d20/d24/c48 0 2024-09-12T22:11:26.387 INFO:tasks.workunit.client.0.smithi019.stdout:5/220: dwrite d0/f1b [4194304,4194304] 0 2024-09-12T22:11:26.387 INFO:tasks.workunit.client.0.smithi019.stdout:9/158: dwrite d12/d1b/d20/f2b [0,4194304] 0 2024-09-12T22:11:26.387 INFO:tasks.workunit.client.0.smithi019.stdout:4/190: symlink d9/d14/d31/l40 0 2024-09-12T22:11:26.389 INFO:tasks.workunit.client.0.smithi019.stdout:4/191: chown d9/db/d2b 75 1 2024-09-12T22:11:26.389 INFO:tasks.workunit.client.0.smithi019.stdout:2/146: dread d0/d31/d12/f1b [0,4194304] 0 2024-09-12T22:11:26.389 INFO:tasks.workunit.client.0.smithi019.stdout:8/169: creat d5/dc/d26/f3a x:0 0 0 2024-09-12T22:11:26.389 INFO:tasks.workunit.client.0.smithi019.stdout:7/231: mkdir da/d19/d25/d39/d51 0 2024-09-12T22:11:26.390 INFO:tasks.workunit.client.0.smithi019.stdout:4/192: readlink d9/d14/l18 0 2024-09-12T22:11:26.391 INFO:tasks.workunit.client.0.smithi019.stdout:1/206: symlink d1/d4/dc/df/l46 0 2024-09-12T22:11:26.391 INFO:tasks.workunit.client.0.smithi019.stdout:5/221: write d0/d24/f36 [2594339,82232] 0 2024-09-12T22:11:26.393 INFO:tasks.workunit.client.0.smithi019.stdout:4/193: read d9/db/f24 [1027557,6136] 0 2024-09-12T22:11:26.394 INFO:tasks.workunit.client.0.smithi019.stdout:3/207: dwrite fb [4194304,4194304] 0 2024-09-12T22:11:26.395 INFO:tasks.workunit.client.0.smithi019.stdout:5/222: write d0/d1d/d3d/f3e [651601,54102] 0 2024-09-12T22:11:26.395 INFO:tasks.workunit.client.0.smithi019.stdout:3/208: chown d18/f28 206586628 1 2024-09-12T22:11:26.396 INFO:tasks.workunit.client.0.smithi019.stdout:5/223: write d0/ff [1023359,196] 0 2024-09-12T22:11:26.397 INFO:tasks.workunit.client.0.smithi019.stdout:3/209: truncate f15 1782799 0 2024-09-12T22:11:26.397 INFO:tasks.workunit.client.0.smithi019.stdout:4/194: link d9/d17/c23 d9/d14/d31/c41 0 2024-09-12T22:11:26.397 INFO:tasks.workunit.client.0.smithi019.stdout:0/215: dwrite d5/d7/d10/d26/f3e [0,4194304] 0 2024-09-12T22:11:26.397 INFO:tasks.workunit.client.0.smithi019.stdout:5/224: fsync d0/d14/f16 0 2024-09-12T22:11:26.398 INFO:tasks.workunit.client.0.smithi019.stdout:4/195: chown d9/db/d2b/f37 30955 1 2024-09-12T22:11:26.399 INFO:tasks.workunit.client.0.smithi019.stdout:3/210: rename f4 to d18/d26/d30/f3c 0 2024-09-12T22:11:26.399 INFO:tasks.workunit.client.0.smithi019.stdout:0/216: creat d5/d7/d2c/d44/f45 x:0 0 0 2024-09-12T22:11:26.399 INFO:tasks.workunit.client.0.smithi019.stdout:7/232: dwrite da/d19/d25/d39/f45 [0,4194304] 0 2024-09-12T22:11:26.399 INFO:tasks.workunit.client.0.smithi019.stdout:5/225: write d0/d14/f2b [2222679,31376] 0 2024-09-12T22:11:26.399 INFO:tasks.workunit.client.0.smithi019.stdout:4/196: truncate d9/d14/f1c 885955 0 2024-09-12T22:11:26.401 INFO:tasks.workunit.client.0.smithi019.stdout:9/159: truncate d12/d1b/d20/f2a 1837689 0 2024-09-12T22:11:26.403 INFO:tasks.workunit.client.0.smithi019.stdout:8/170: truncate d5/fa 4031470 0 2024-09-12T22:11:26.403 INFO:tasks.workunit.client.0.smithi019.stdout:1/207: truncate d1/fe 2409566 0 2024-09-12T22:11:26.406 INFO:tasks.workunit.client.0.smithi019.stdout:7/233: symlink da/l52 0 2024-09-12T22:11:26.410 INFO:tasks.workunit.client.0.smithi019.stdout:5/226: dwrite d0/d14/f2b [0,4194304] 0 2024-09-12T22:11:26.410 INFO:tasks.workunit.client.0.smithi019.stdout:0/217: dwrite d5/d7/d10/d26/f3e [0,4194304] 0 2024-09-12T22:11:26.410 INFO:tasks.workunit.client.0.smithi019.stdout:8/171: symlink d5/dc/d26/l3b 0 2024-09-12T22:11:26.411 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:26.409+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:26.412 INFO:tasks.workunit.client.0.smithi019.stdout:7/234: mkdir da/d30/d53 0 2024-09-12T22:11:26.413 INFO:tasks.workunit.client.0.smithi019.stdout:8/172: read d5/f6 [500717,101975] 0 2024-09-12T22:11:26.414 INFO:tasks.workunit.client.0.smithi019.stdout:2/147: dwrite d0/d31/d12/f17 [0,4194304] 0 2024-09-12T22:11:26.415 INFO:tasks.workunit.client.0.smithi019.stdout:1/208: getdents d1/d4 0 2024-09-12T22:11:26.415 INFO:tasks.workunit.client.0.smithi019.stdout:5/227: creat d0/d14/d47/f4c x:0 0 0 2024-09-12T22:11:26.416 INFO:tasks.workunit.client.0.smithi019.stdout:0/218: mkdir d5/d7/d25/d46 0 2024-09-12T22:11:26.417 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:26.417 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:26.417 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:26.417 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:26.417 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:26.418 INFO:tasks.workunit.client.0.smithi019.stdout:3/211: dwrite f12 [0,4194304] 0 2024-09-12T22:11:26.418 INFO:tasks.workunit.client.0.smithi019.stdout:7/235: mknod da/d24/d28/d1c/c54 0 2024-09-12T22:11:26.418 INFO:tasks.workunit.client.0.smithi019.stdout:2/148: fdatasync d0/d3/df/f1f 0 2024-09-12T22:11:26.418 INFO:tasks.workunit.client.0.smithi019.stdout:8/173: creat d5/d16/d19/f3c x:0 0 0 2024-09-12T22:11:26.418 INFO:tasks.workunit.client.0.smithi019.stdout:9/160: dwrite d12/d1b/f32 [0,4194304] 0 2024-09-12T22:11:26.419 INFO:tasks.workunit.client.0.smithi019.stdout:5/228: creat d0/d14/f4d x:0 0 0 2024-09-12T22:11:26.419 INFO:tasks.workunit.client.0.smithi019.stdout:3/212: unlink d18/f25 0 2024-09-12T22:11:26.420 INFO:tasks.workunit.client.0.smithi019.stdout:1/209: mkdir d1/d4/dc/df/d45/d47 0 2024-09-12T22:11:26.420 INFO:tasks.workunit.client.0.smithi019.stdout:7/236: rmdir da/d24/d28/d1c 39 2024-09-12T22:11:26.420 INFO:tasks.workunit.client.0.smithi019.stdout:4/197: dwrite d9/db/d2b/f37 [0,4194304] 0 2024-09-12T22:11:26.421 INFO:tasks.workunit.client.0.smithi019.stdout:8/174: dread - d5/dc/d26/f36 zero size 2024-09-12T22:11:26.421 INFO:tasks.workunit.client.0.smithi019.stdout:5/229: write d0/f3 [2735061,127815] 0 2024-09-12T22:11:26.424 INFO:tasks.workunit.client.0.smithi019.stdout:2/149: creat d0/d31/d12/d15/f33 x:0 0 0 2024-09-12T22:11:26.424 INFO:tasks.workunit.client.0.smithi019.stdout:0/219: rename d5/f36 to d5/d7/d2c/f47 0 2024-09-12T22:11:26.424 INFO:tasks.workunit.client.0.smithi019.stdout:8/175: mknod d5/c3d 0 2024-09-12T22:11:26.426 INFO:tasks.workunit.client.0.smithi019.stdout:4/198: creat d9/d14/d31/d3f/f42 x:0 0 0 2024-09-12T22:11:26.427 INFO:tasks.workunit.client.0.smithi019.stdout:8/176: stat d5/dc 0 2024-09-12T22:11:26.427 INFO:tasks.workunit.client.0.smithi019.stdout:2/150: write d0/d31/d4/f22 [1431476,35438] 0 2024-09-12T22:11:26.427 INFO:tasks.workunit.client.0.smithi019.stdout:4/199: sync 2024-09-12T22:11:26.428 INFO:tasks.workunit.client.0.smithi019.stdout:0/220: write d5/f41 [790560,111616] 0 2024-09-12T22:11:26.430 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:26.431 INFO:tasks.workunit.client.0.smithi019.stdout:9/161: dwrite d12/f15 [0,4194304] 0 2024-09-12T22:11:26.431 INFO:tasks.workunit.client.0.smithi019.stdout:3/213: dwrite fb [4194304,4194304] 0 2024-09-12T22:11:26.431 INFO:tasks.workunit.client.0.smithi019.stdout:1/210: dwrite d1/d2/d18/d35/f3a [4194304,4194304] 0 2024-09-12T22:11:26.432 INFO:tasks.workunit.client.0.smithi019.stdout:6/211: dread d9/dc/d20/f1a [0,4194304] 0 2024-09-12T22:11:26.432 INFO:tasks.workunit.client.0.smithi019.stdout:7/237: getdents da/d19 0 2024-09-12T22:11:26.433 INFO:tasks.workunit.client.0.smithi019.stdout:4/200: chown d9/d14/d31/c41 2636774 1 2024-09-12T22:11:26.434 INFO:tasks.workunit.client.0.smithi019.stdout:9/162: rename f7 to d12/f35 0 2024-09-12T22:11:26.434 INFO:tasks.workunit.client.0.smithi019.stdout:5/230: dwrite d0/fe [0,4194304] 0 2024-09-12T22:11:26.434 INFO:tasks.workunit.client.0.smithi019.stdout:9/163: sync 2024-09-12T22:11:26.434 INFO:tasks.workunit.client.0.smithi019.stdout:2/151: mkdir d0/d3/d11/d2e/d34 0 2024-09-12T22:11:26.434 INFO:tasks.workunit.client.0.smithi019.stdout:9/164: read f0 [1796023,127028] 0 2024-09-12T22:11:26.435 INFO:tasks.workunit.client.0.smithi019.stdout:1/211: rename d1/d4/l1d to d1/d2/d18/l48 0 2024-09-12T22:11:26.435 INFO:tasks.workunit.client.0.smithi019.stdout:8/177: dread d5/dc/d26/f30 [0,4194304] 0 2024-09-12T22:11:26.436 INFO:tasks.workunit.client.0.smithi019.stdout:5/231: mkdir d0/d4e 0 2024-09-12T22:11:26.436 INFO:tasks.workunit.client.0.smithi019.stdout:7/238: getdents da 0 2024-09-12T22:11:26.437 INFO:tasks.workunit.client.0.smithi019.stdout:6/212: getdents d9/dc/d20 0 2024-09-12T22:11:26.437 INFO:tasks.workunit.client.0.smithi019.stdout:1/212: creat d1/d4/dc/df/d2c/f49 x:0 0 0 2024-09-12T22:11:26.437 INFO:tasks.workunit.client.0.smithi019.stdout:5/232: rename d0/d14 to d0/d1d/d4f 0 2024-09-12T22:11:26.438 INFO:tasks.workunit.client.0.smithi019.stdout:3/214: dwrite d18/f34 [0,4194304] 0 2024-09-12T22:11:26.438 INFO:tasks.workunit.client.0.smithi019.stdout:4/201: write f4 [248259,10387] 0 2024-09-12T22:11:26.438 INFO:tasks.workunit.client.0.smithi019.stdout:8/178: link d5/d16/l20 d5/d16/d19/l3e 0 2024-09-12T22:11:26.439 INFO:tasks.workunit.client.0.smithi019.stdout:2/152: link d0/c8 d0/d3/df/d18/d2c/c35 0 2024-09-12T22:11:26.439 INFO:tasks.workunit.client.0.smithi019.stdout:7/239: write da/d19/d25/f2e [741772,56888] 0 2024-09-12T22:11:26.439 INFO:tasks.workunit.client.0.smithi019.stdout:3/215: readlink d18/d1d/l2c 0 2024-09-12T22:11:26.440 INFO:tasks.workunit.client.0.smithi019.stdout:5/233: chown d0/d26/f32 1131 1 2024-09-12T22:11:26.440 INFO:tasks.workunit.client.0.smithi019.stdout:6/213: symlink d9/dc/d20/d30/l49 0 2024-09-12T22:11:26.440 INFO:tasks.workunit.client.0.smithi019.stdout:2/153: chown d0/d3/df 80391884 1 2024-09-12T22:11:26.440 INFO:tasks.workunit.client.0.smithi019.stdout:1/213: chown d1/f11 3520 1 2024-09-12T22:11:26.440 INFO:tasks.workunit.client.0.smithi019.stdout:4/202: truncate d9/d14/f1c 1254064 0 2024-09-12T22:11:26.440 INFO:tasks.workunit.client.0.smithi019.stdout:8/179: write d5/d16/d19/f3c [526477,112283] 0 2024-09-12T22:11:26.441 INFO:tasks.workunit.client.0.smithi019.stdout:3/216: truncate f17 574773 0 2024-09-12T22:11:26.441 INFO:tasks.workunit.client.0.smithi019.stdout:4/203: fdatasync d9/d17/f2c 0 2024-09-12T22:11:26.441 INFO:tasks.workunit.client.0.smithi019.stdout:5/234: read - d0/d1d/d3d/f48 zero size 2024-09-12T22:11:26.441 INFO:tasks.workunit.client.0.smithi019.stdout:1/214: write d1/f14 [1046298,29558] 0 2024-09-12T22:11:26.442 INFO:tasks.workunit.client.0.smithi019.stdout:8/180: unlink f4 0 2024-09-12T22:11:26.442 INFO:tasks.workunit.client.0.smithi019.stdout:3/217: write d18/f28 [4958528,109399] 0 2024-09-12T22:11:26.442 INFO:tasks.workunit.client.0.smithi019.stdout:4/204: mknod d9/d14/d31/d3f/c43 0 2024-09-12T22:11:26.442 INFO:tasks.workunit.client.0.smithi019.stdout:5/235: mkdir d0/d4e/d50 0 2024-09-12T22:11:26.442 INFO:tasks.workunit.client.0.smithi019.stdout:8/181: dread - d5/f23 zero size 2024-09-12T22:11:26.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/218: write f16 [7433121,105510] 0 2024-09-12T22:11:26.443 INFO:tasks.workunit.client.0.smithi019.stdout:1/215: fsync d1/d2/f7 0 2024-09-12T22:11:26.443 INFO:tasks.workunit.client.0.smithi019.stdout:1/216: stat d1 0 2024-09-12T22:11:26.444 INFO:tasks.workunit.client.0.smithi019.stdout:4/205: write d9/db/fd [5228666,100345] 0 2024-09-12T22:11:26.444 INFO:tasks.workunit.client.0.smithi019.stdout:3/219: mknod d18/d26/c3d 0 2024-09-12T22:11:26.446 INFO:tasks.workunit.client.0.smithi019.stdout:8/182: rename d5/d16/l20 to d5/dc/d26/l3f 0 2024-09-12T22:11:26.447 INFO:tasks.workunit.client.0.smithi019.stdout:3/220: creat d18/f3e x:0 0 0 2024-09-12T22:11:26.447 INFO:tasks.workunit.client.0.smithi019.stdout:6/214: dwrite d9/dc/d20/d24/f2d [0,4194304] 0 2024-09-12T22:11:26.447 INFO:tasks.workunit.client.0.smithi019.stdout:5/236: truncate d0/d1d/d4f/f16 457084 0 2024-09-12T22:11:26.447 INFO:tasks.workunit.client.0.smithi019.stdout:1/217: rmdir d1/d4/dc/df/d45/d47 0 2024-09-12T22:11:26.448 INFO:tasks.workunit.client.0.smithi019.stdout:2/154: dwrite d0/d3/df/f1f [0,4194304] 0 2024-09-12T22:11:26.448 INFO:tasks.workunit.client.0.smithi019.stdout:3/221: stat f16 0 2024-09-12T22:11:26.449 INFO:tasks.workunit.client.0.smithi019.stdout:1/218: stat d1/d4/dc/df/l10 0 2024-09-12T22:11:26.449 INFO:tasks.workunit.client.0.smithi019.stdout:5/237: truncate d0/d1d/f45 393955 0 2024-09-12T22:11:26.449 INFO:tasks.workunit.client.0.smithi019.stdout:9/165: write fb [708312,16652] 0 2024-09-12T22:11:26.449 INFO:tasks.workunit.client.0.smithi019.stdout:6/215: fsync d9/dc/d20/d30/f37 0 2024-09-12T22:11:26.449 INFO:tasks.workunit.client.0.smithi019.stdout:8/183: truncate d5/d16/d19/d29/f38 125045 0 2024-09-12T22:11:26.450 INFO:tasks.workunit.client.0.smithi019.stdout:3/222: creat d18/d1d/f3f x:0 0 0 2024-09-12T22:11:26.450 INFO:tasks.workunit.client.0.smithi019.stdout:2/155: write d0/d3/d11/f10 [1936434,16283] 0 2024-09-12T22:11:26.451 INFO:tasks.workunit.client.0.smithi019.stdout:4/206: rename d9/d14/d31/l36 to d9/l44 0 2024-09-12T22:11:26.452 INFO:tasks.workunit.client.0.smithi019.stdout:3/223: unlink d18/d26/c37 0 2024-09-12T22:11:26.452 INFO:tasks.workunit.client.0.smithi019.stdout:4/207: truncate d9/d14/d31/d3f/f42 1022119 0 2024-09-12T22:11:26.452 INFO:tasks.workunit.client.0.smithi019.stdout:1/219: mknod d1/d2/d18/d35/c4a 0 2024-09-12T22:11:26.453 INFO:tasks.workunit.client.0.smithi019.stdout:9/166: rename d12/f35 to d12/d1b/d20/f36 0 2024-09-12T22:11:26.454 INFO:tasks.workunit.client.0.smithi019.stdout:2/156: mkdir d0/d3/d21/d36 0 2024-09-12T22:11:26.454 INFO:tasks.workunit.client.0.smithi019.stdout:9/167: stat d12/l13 0 2024-09-12T22:11:26.454 INFO:tasks.workunit.client.0.smithi019.stdout:3/224: mknod d18/c40 0 2024-09-12T22:11:26.456 INFO:tasks.workunit.client.0.smithi019.stdout:9/168: write d12/f26 [742324,32560] 0 2024-09-12T22:11:26.456 INFO:tasks.workunit.client.0.smithi019.stdout:3/225: creat d18/d26/f41 x:0 0 0 2024-09-12T22:11:26.456 INFO:tasks.workunit.client.0.smithi019.stdout:4/208: write d9/db/f24 [2857309,68391] 0 2024-09-12T22:11:26.457 INFO:tasks.workunit.client.0.smithi019.stdout:1/220: write d1/d2/d18/d29/d27/d12/f2d [1121276,49113] 0 2024-09-12T22:11:26.457 INFO:tasks.workunit.client.0.smithi019.stdout:2/157: truncate d0/d31/d12/d15/f33 902167 0 2024-09-12T22:11:26.457 INFO:tasks.workunit.client.0.smithi019.stdout:4/209: readlink d9/la 0 2024-09-12T22:11:26.457 INFO:tasks.workunit.client.0.smithi019.stdout:3/226: write f3 [9182836,61577] 0 2024-09-12T22:11:26.457 INFO:tasks.workunit.client.0.smithi019.stdout:9/169: chown d12/d1b/l22 1 1 2024-09-12T22:11:26.458 INFO:tasks.workunit.client.0.smithi019.stdout:2/158: readlink d0/d3/df/l2f 0 2024-09-12T22:11:26.458 INFO:tasks.workunit.client.0.smithi019.stdout:3/227: readlink d18/d1d/l39 0 2024-09-12T22:11:26.458 INFO:tasks.workunit.client.0.smithi019.stdout:6/216: dwrite d9/dc/d20/d30/f38 [0,4194304] 0 2024-09-12T22:11:26.458 INFO:tasks.workunit.client.0.smithi019.stdout:4/210: rename d9/db to d9/db/d45 22 2024-09-12T22:11:26.458 INFO:tasks.workunit.client.0.smithi019.stdout:1/221: symlink d1/d2/d18/d29/d27/l4b 0 2024-09-12T22:11:26.459 INFO:tasks.workunit.client.0.smithi019.stdout:4/211: chown d9/d17/c23 11758663 1 2024-09-12T22:11:26.459 INFO:tasks.workunit.client.0.smithi019.stdout:1/222: creat d1/d37/f4c x:0 0 0 2024-09-12T22:11:26.460 INFO:tasks.workunit.client.0.smithi019.stdout:4/212: fdatasync d9/d14/f34 0 2024-09-12T22:11:26.460 INFO:tasks.workunit.client.0.smithi019.stdout:3/228: link d18/c1a d18/d1d/c42 0 2024-09-12T22:11:26.460 INFO:tasks.workunit.client.0.smithi019.stdout:6/217: getdents d9/d3d 0 2024-09-12T22:11:26.461 INFO:tasks.workunit.client.0.smithi019.stdout:3/229: readlink d18/d1d/l27 0 2024-09-12T22:11:26.461 INFO:tasks.workunit.client.0.smithi019.stdout:8/184: dread d5/d16/d19/f3c [0,4194304] 0 2024-09-12T22:11:26.461 INFO:tasks.workunit.client.0.smithi019.stdout:4/213: creat d9/d14/d33/f46 x:0 0 0 2024-09-12T22:11:26.462 INFO:tasks.workunit.client.0.smithi019.stdout:8/185: chown d5/d16/d19/c2f 45 1 2024-09-12T22:11:26.462 INFO:tasks.workunit.client.0.smithi019.stdout:3/230: write d18/d1d/f3b [959109,50238] 0 2024-09-12T22:11:26.463 INFO:tasks.workunit.client.0.smithi019.stdout:2/159: dread d0/d3/df/f1f [0,4194304] 0 2024-09-12T22:11:26.463 INFO:tasks.workunit.client.0.smithi019.stdout:6/218: link d9/dc/d20/d30/f34 d9/dc/d20/f4a 0 2024-09-12T22:11:26.463 INFO:tasks.workunit.client.0.smithi019.stdout:3/231: truncate d18/f3e 724433 0 2024-09-12T22:11:26.464 INFO:tasks.workunit.client.0.smithi019.stdout:5/238: truncate d0/f34 2112034 0 2024-09-12T22:11:26.464 INFO:tasks.workunit.client.0.smithi019.stdout:7/240: read da/f47 [65262,127491] 0 2024-09-12T22:11:26.464 INFO:tasks.workunit.client.0.smithi019.stdout:6/219: unlink d9/dc/l46 0 2024-09-12T22:11:26.466 INFO:tasks.workunit.client.0.smithi019.stdout:7/241: write da/d19/f41 [85128,77288] 0 2024-09-12T22:11:26.466 INFO:tasks.workunit.client.0.smithi019.stdout:8/186: rename d5/f10 to d5/d16/d19/f40 0 2024-09-12T22:11:26.467 INFO:tasks.workunit.client.0.smithi019.stdout:1/223: dread d1/d2/d18/d29/d27/d12/f2d [0,4194304] 0 2024-09-12T22:11:26.468 INFO:tasks.workunit.client.0.smithi019.stdout:6/220: rename d9/dc/d20/d24 to d9/dc/d20/d4b 0 2024-09-12T22:11:26.468 INFO:tasks.workunit.client.0.smithi019.stdout:5/239: truncate d0/d1d/d4f/f4b 306357 0 2024-09-12T22:11:26.468 INFO:tasks.workunit.client.0.smithi019.stdout:7/242: symlink da/d19/l55 0 2024-09-12T22:11:26.468 INFO:tasks.workunit.client.0.smithi019.stdout:4/214: dwrite d9/f3b [0,4194304] 0 2024-09-12T22:11:26.469 INFO:tasks.workunit.client.0.smithi019.stdout:1/224: chown d1/d4/dc/df/f13 6393 1 2024-09-12T22:11:26.469 INFO:tasks.workunit.client.0.smithi019.stdout:6/221: symlink d9/dc/d20/l4c 0 2024-09-12T22:11:26.469 INFO:tasks.workunit.client.0.smithi019.stdout:5/240: mknod d0/d26/d3a/c51 0 2024-09-12T22:11:26.470 INFO:tasks.workunit.client.0.smithi019.stdout:4/215: rmdir d9/db 39 2024-09-12T22:11:26.470 INFO:tasks.workunit.client.0.smithi019.stdout:1/225: chown d1/d2/c20 263213 1 2024-09-12T22:11:26.471 INFO:tasks.workunit.client.0.smithi019.stdout:3/232: dwrite d18/f1b [0,4194304] 0 2024-09-12T22:11:26.471 INFO:tasks.workunit.client.0.smithi019.stdout:6/222: write d9/dc/f36 [1809546,55044] 0 2024-09-12T22:11:26.473 INFO:tasks.workunit.client.0.smithi019.stdout:5/241: unlink d0/l13 0 2024-09-12T22:11:26.474 INFO:tasks.workunit.client.0.smithi019.stdout:3/233: mknod d18/c43 0 2024-09-12T22:11:26.474 INFO:tasks.workunit.client.0.smithi019.stdout:5/242: chown d0/d1d/c2a 546 1 2024-09-12T22:11:26.475 INFO:tasks.workunit.client.0.smithi019.stdout:8/187: creat d5/dc/d26/f41 x:0 0 0 2024-09-12T22:11:26.475 INFO:tasks.workunit.client.0.smithi019.stdout:7/243: dwrite da/d19/f50 [0,4194304] 0 2024-09-12T22:11:26.475 INFO:tasks.workunit.client.0.smithi019.stdout:4/216: fsync d9/db/f24 0 2024-09-12T22:11:26.477 INFO:tasks.workunit.client.0.smithi019.stdout:7/244: readlink da/d30/l42 0 2024-09-12T22:11:26.477 INFO:tasks.workunit.client.0.smithi019.stdout:9/170: dread fa [0,4194304] 0 2024-09-12T22:11:26.477 INFO:tasks.workunit.client.0.smithi019.stdout:3/234: rename c14 to d18/d26/c44 0 2024-09-12T22:11:26.478 INFO:tasks.workunit.client.0.smithi019.stdout:6/223: dread d9/dc/d20/d30/f38 [0,4194304] 0 2024-09-12T22:11:26.478 INFO:tasks.workunit.client.0.smithi019.stdout:1/226: write d1/fe [2450671,38840] 0 2024-09-12T22:11:26.478 INFO:tasks.workunit.client.0.smithi019.stdout:5/243: unlink d0/f1c 0 2024-09-12T22:11:26.479 INFO:tasks.workunit.client.0.smithi019.stdout:6/224: sync 2024-09-12T22:11:26.479 INFO:tasks.workunit.client.0.smithi019.stdout:9/171: write f5 [3604974,92718] 0 2024-09-12T22:11:26.479 INFO:tasks.workunit.client.0.smithi019.stdout:2/160: dwrite d0/d3/d11/f19 [0,4194304] 0 2024-09-12T22:11:26.479 INFO:tasks.workunit.client.0.smithi019.stdout:3/235: mknod d18/d26/c45 0 2024-09-12T22:11:26.480 INFO:tasks.workunit.client.0.smithi019.stdout:7/245: truncate da/d19/d25/d39/f49 178123 0 2024-09-12T22:11:26.481 INFO:tasks.workunit.client.0.smithi019.stdout:8/188: creat d5/f42 x:0 0 0 2024-09-12T22:11:26.481 INFO:tasks.workunit.client.0.smithi019.stdout:1/227: chown d1/d4/dc/df/d2c/f49 71682 1 2024-09-12T22:11:26.482 INFO:tasks.workunit.client.0.smithi019.stdout:9/172: write fe [4011983,57820] 0 2024-09-12T22:11:26.482 INFO:tasks.workunit.client.0.smithi019.stdout:1/228: chown d1/d4/dc/f32 296011 1 2024-09-12T22:11:26.483 INFO:tasks.workunit.client.0.smithi019.stdout:5/244: creat d0/d1d/d4f/d47/f52 x:0 0 0 2024-09-12T22:11:26.484 INFO:tasks.workunit.client.0.smithi019.stdout:9/173: mkdir d12/d1b/d20/d37 0 2024-09-12T22:11:26.484 INFO:tasks.workunit.client.0.smithi019.stdout:2/161: unlink d0/d3/df/d18/d2c/c35 0 2024-09-12T22:11:26.484 INFO:tasks.workunit.client.0.smithi019.stdout:3/236: dread d18/f34 [0,4194304] 0 2024-09-12T22:11:26.485 INFO:tasks.workunit.client.0.smithi019.stdout:7/246: chown da/d24/d28/d1c/d32/f3c 4369 1 2024-09-12T22:11:26.485 INFO:tasks.workunit.client.0.smithi019.stdout:5/245: chown d0/d26/c2f 234 1 2024-09-12T22:11:26.486 INFO:tasks.workunit.client.0.smithi019.stdout:4/217: truncate f4 872243 0 2024-09-12T22:11:26.486 INFO:tasks.workunit.client.0.smithi019.stdout:6/225: dwrite d9/f22 [0,4194304] 0 2024-09-12T22:11:26.486 INFO:tasks.workunit.client.0.smithi019.stdout:9/174: rename fc to d12/d1b/f38 0 2024-09-12T22:11:26.487 INFO:tasks.workunit.client.0.smithi019.stdout:3/237: stat d18/d1d/f2f 0 2024-09-12T22:11:26.487 INFO:tasks.workunit.client.0.smithi019.stdout:3/238: sync 2024-09-12T22:11:26.488 INFO:tasks.workunit.client.0.smithi019.stdout:4/218: write d9/db/f24 [2021494,107600] 0 2024-09-12T22:11:26.489 INFO:tasks.workunit.client.0.smithi019.stdout:7/247: unlink da/d24/d28/f27 0 2024-09-12T22:11:26.489 INFO:tasks.workunit.client.0.smithi019.stdout:3/239: symlink d18/d1d/l46 0 2024-09-12T22:11:26.489 INFO:tasks.workunit.client.0.smithi019.stdout:3/240: sync 2024-09-12T22:11:26.490 INFO:tasks.workunit.client.0.smithi019.stdout:2/162: link d0/d31/d12/f1b d0/d3/df/f37 0 2024-09-12T22:11:26.490 INFO:tasks.workunit.client.0.smithi019.stdout:9/175: creat d12/d1b/d20/d37/f39 x:0 0 0 2024-09-12T22:11:26.492 INFO:tasks.workunit.client.0.smithi019.stdout:7/248: creat da/d30/f56 x:0 0 0 2024-09-12T22:11:26.493 INFO:tasks.workunit.client.0.smithi019.stdout:1/229: dwrite d1/d2/d18/d29/d27/d12/f44 [0,4194304] 0 2024-09-12T22:11:26.494 INFO:tasks.workunit.client.0.smithi019.stdout:6/226: truncate d9/dc/d20/d30/f34 341148 0 2024-09-12T22:11:26.494 INFO:tasks.workunit.client.0.smithi019.stdout:8/189: dwrite d5/dc/f1c [4194304,4194304] 0 2024-09-12T22:11:26.494 INFO:tasks.workunit.client.0.smithi019.stdout:8/190: sync 2024-09-12T22:11:26.494 INFO:tasks.workunit.client.0.smithi019.stdout:2/163: write d0/d3/d11/f10 [3057771,8350] 0 2024-09-12T22:11:26.497 INFO:tasks.workunit.client.0.smithi019.stdout:7/249: write da/d19/f4a [1034755,27713] 0 2024-09-12T22:11:26.497 INFO:tasks.workunit.client.0.smithi019.stdout:1/230: readlink d1/d2/d18/d29/d27/l3d 0 2024-09-12T22:11:26.497 INFO:tasks.workunit.client.0.smithi019.stdout:0/221: dread d5/f16 [4194304,4194304] 0 2024-09-12T22:11:26.498 INFO:tasks.workunit.client.0.smithi019.stdout:8/191: rmdir d5/dc 39 2024-09-12T22:11:26.498 INFO:tasks.workunit.client.0.smithi019.stdout:5/246: dwrite d0/f10 [0,4194304] 0 2024-09-12T22:11:26.499 INFO:tasks.workunit.client.0.smithi019.stdout:6/227: write d9/dc/d20/f32 [768173,26687] 0 2024-09-12T22:11:26.499 INFO:tasks.workunit.client.0.smithi019.stdout:6/228: sync 2024-09-12T22:11:26.499 INFO:tasks.workunit.client.0.smithi019.stdout:2/164: write d0/d31/d12/d15/f33 [1875503,82725] 0 2024-09-12T22:11:26.501 INFO:tasks.workunit.client.0.smithi019.stdout:5/247: truncate d0/f17 898036 0 2024-09-12T22:11:26.502 INFO:tasks.workunit.client.0.smithi019.stdout:9/176: dread d12/d1b/d20/f36 [0,4194304] 0 2024-09-12T22:11:26.502 INFO:tasks.workunit.client.0.smithi019.stdout:1/231: creat d1/d2/d38/f4d x:0 0 0 2024-09-12T22:11:26.502 INFO:tasks.workunit.client.0.smithi019.stdout:7/250: rename da/d24/f38 to da/d24/d28/f57 0 2024-09-12T22:11:26.502 INFO:tasks.workunit.client.0.smithi019.stdout:4/219: dwrite d9/f27 [0,4194304] 0 2024-09-12T22:11:26.502 INFO:tasks.workunit.client.0.smithi019.stdout:3/241: dwrite d18/f1b [0,4194304] 0 2024-09-12T22:11:26.504 INFO:tasks.workunit.client.0.smithi019.stdout:5/248: creat d0/d1d/d3d/f53 x:0 0 0 2024-09-12T22:11:26.504 INFO:tasks.workunit.client.0.smithi019.stdout:8/192: truncate d5/dc/d17/f2b 1042335 0 2024-09-12T22:11:26.504 INFO:tasks.workunit.client.0.smithi019.stdout:7/251: read - da/d30/f56 zero size 2024-09-12T22:11:26.505 INFO:tasks.workunit.client.0.smithi019.stdout:9/177: creat d12/d1b/f3a x:0 0 0 2024-09-12T22:11:26.505 INFO:tasks.workunit.client.0.smithi019.stdout:3/242: chown d18/d26/c3a 234 1 2024-09-12T22:11:26.506 INFO:tasks.workunit.client.0.smithi019.stdout:2/165: truncate d0/d3/d11/fc 1445193 0 2024-09-12T22:11:26.506 INFO:tasks.workunit.client.0.smithi019.stdout:4/220: mknod d9/c47 0 2024-09-12T22:11:26.506 INFO:tasks.workunit.client.0.smithi019.stdout:8/193: mkdir d5/dc/d26/d43 0 2024-09-12T22:11:26.506 INFO:tasks.workunit.client.0.smithi019.stdout:1/232: chown d1/d4/dc/df/l46 0 1 2024-09-12T22:11:26.506 INFO:tasks.workunit.client.0.smithi019.stdout:5/249: symlink d0/d24/l54 0 2024-09-12T22:11:26.507 INFO:tasks.workunit.client.0.smithi019.stdout:3/243: chown d18/d1d/l2c 2020854 1 2024-09-12T22:11:26.507 INFO:tasks.workunit.client.0.smithi019.stdout:2/166: fdatasync d0/d31/d4/f16 0 2024-09-12T22:11:26.508 INFO:tasks.workunit.client.0.smithi019.stdout:8/194: chown d5/f42 478019 1 2024-09-12T22:11:26.508 INFO:tasks.workunit.client.0.smithi019.stdout:8/195: sync 2024-09-12T22:11:26.509 INFO:tasks.workunit.client.0.smithi019.stdout:0/222: truncate d5/d7/d10/d26/d2a/f37 1468601 0 2024-09-12T22:11:26.509 INFO:tasks.workunit.client.0.smithi019.stdout:7/252: symlink da/d24/d28/l58 0 2024-09-12T22:11:26.509 INFO:tasks.workunit.client.0.smithi019.stdout:5/250: creat d0/d1d/d3d/f55 x:0 0 0 2024-09-12T22:11:26.510 INFO:tasks.workunit.client.0.smithi019.stdout:1/233: chown d1/d2/d18/d29/d27/d12/f1b 1 1 2024-09-12T22:11:26.510 INFO:tasks.workunit.client.0.smithi019.stdout:6/229: dwrite d9/dc/d20/f14 [0,4194304] 0 2024-09-12T22:11:26.510 INFO:tasks.workunit.client.0.smithi019.stdout:9/178: getdents d12/d1b/d2f 0 2024-09-12T22:11:26.511 INFO:tasks.workunit.client.0.smithi019.stdout:2/167: symlink d0/d3/d11/d2e/l38 0 2024-09-12T22:11:26.511 INFO:tasks.workunit.client.0.smithi019.stdout:3/244: symlink d18/l47 0 2024-09-12T22:11:26.511 INFO:tasks.workunit.client.0.smithi019.stdout:5/251: creat d0/d4e/f56 x:0 0 0 2024-09-12T22:11:26.512 INFO:tasks.workunit.client.0.smithi019.stdout:7/253: creat da/d30/d53/f59 x:0 0 0 2024-09-12T22:11:26.512 INFO:tasks.workunit.client.0.smithi019.stdout:8/196: rename d5/dc/l1e to d5/d16/d19/d32/l44 0 2024-09-12T22:11:26.513 INFO:tasks.workunit.client.0.smithi019.stdout:9/179: rmdir d12/d1b/d20/d37 39 2024-09-12T22:11:26.513 INFO:tasks.workunit.client.0.smithi019.stdout:6/230: creat d9/dc/f4d x:0 0 0 2024-09-12T22:11:26.513 INFO:tasks.workunit.client.0.smithi019.stdout:3/245: mkdir d18/d1d/d48 0 2024-09-12T22:11:26.513 INFO:tasks.workunit.client.0.smithi019.stdout:0/223: creat d5/d7/de/f48 x:0 0 0 2024-09-12T22:11:26.513 INFO:tasks.workunit.client.0.smithi019.stdout:1/234: mknod d1/d4/dc/df/d2c/c4e 0 2024-09-12T22:11:26.514 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:26.513+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:26.514 INFO:tasks.workunit.client.0.smithi019.stdout:4/221: dwrite d9/f27 [4194304,4194304] 0 2024-09-12T22:11:26.514 INFO:tasks.workunit.client.0.smithi019.stdout:0/224: chown d5/d7/d10/c15 3564 1 2024-09-12T22:11:26.515 INFO:tasks.workunit.client.0.smithi019.stdout:5/252: mkdir d0/d1d/d4f/d47/d57 0 2024-09-12T22:11:26.515 INFO:tasks.workunit.client.0.smithi019.stdout:7/254: stat da/d24/d28/l43 0 2024-09-12T22:11:26.516 INFO:tasks.workunit.client.0.smithi019.stdout:6/231: creat d9/f4e x:0 0 0 2024-09-12T22:11:26.516 INFO:tasks.workunit.client.0.smithi019.stdout:2/168: creat d0/d3/d21/d36/f39 x:0 0 0 2024-09-12T22:11:26.516 INFO:tasks.workunit.client.0.smithi019.stdout:1/235: mknod d1/d4/c4f 0 2024-09-12T22:11:26.517 INFO:tasks.workunit.client.0.smithi019.stdout:4/222: creat d9/d14/d31/d3f/f48 x:0 0 0 2024-09-12T22:11:26.517 INFO:tasks.workunit.client.0.smithi019.stdout:6/232: chown d9/dc/f36 104336113 1 2024-09-12T22:11:26.518 INFO:tasks.workunit.client.0.smithi019.stdout:9/180: rmdir d12/d1b/d2f 0 2024-09-12T22:11:26.518 INFO:tasks.workunit.client.0.smithi019.stdout:5/253: dread d0/f17 [0,4194304] 0 2024-09-12T22:11:26.519 INFO:tasks.workunit.client.0.smithi019.stdout:7/255: mknod da/d24/d28/d1c/d32/c5a 0 2024-09-12T22:11:26.521 INFO:tasks.workunit.client.0.smithi019.stdout:4/223: fsync f4 0 2024-09-12T22:11:26.522 INFO:tasks.workunit.client.0.smithi019.stdout:5/254: rmdir d0/d4e 39 2024-09-12T22:11:26.522 INFO:tasks.workunit.client.0.smithi019.stdout:9/181: creat d12/d1b/d20/d25/f3b x:0 0 0 2024-09-12T22:11:26.523 INFO:tasks.workunit.client.0.smithi019.stdout:3/246: dwrite d18/f3e [0,4194304] 0 2024-09-12T22:11:26.523 INFO:tasks.workunit.client.0.smithi019.stdout:1/236: write d1/d2/d18/d29/d27/f39 [2285948,4844] 0 2024-09-12T22:11:26.523 INFO:tasks.workunit.client.0.smithi019.stdout:8/197: dwrite d5/dc/f1c [8388608,4194304] 0 2024-09-12T22:11:26.524 INFO:tasks.workunit.client.0.smithi019.stdout:7/256: creat da/f5b x:0 0 0 2024-09-12T22:11:26.524 INFO:tasks.workunit.client.0.smithi019.stdout:6/233: dread d9/dc/f23 [0,4194304] 0 2024-09-12T22:11:26.524 INFO:tasks.workunit.client.0.smithi019.stdout:9/182: dread - f9 zero size 2024-09-12T22:11:26.526 INFO:tasks.workunit.client.0.smithi019.stdout:6/234: rmdir d9/dc/d20 39 2024-09-12T22:11:26.526 INFO:tasks.workunit.client.0.smithi019.stdout:8/198: creat d5/d16/d19/f45 x:0 0 0 2024-09-12T22:11:26.527 INFO:tasks.workunit.client.0.smithi019.stdout:5/255: mkdir d0/d24/d58 0 2024-09-12T22:11:26.527 INFO:tasks.workunit.client.0.smithi019.stdout:9/183: symlink d12/d1b/d20/l3c 0 2024-09-12T22:11:26.528 INFO:tasks.workunit.client.0.smithi019.stdout:8/199: dread - d5/dc/f2a zero size 2024-09-12T22:11:26.528 INFO:tasks.workunit.client.0.smithi019.stdout:9/184: fdatasync fb 0 2024-09-12T22:11:26.528 INFO:tasks.workunit.client.0.smithi019.stdout:6/235: write d9/dc/f44 [211282,124800] 0 2024-09-12T22:11:26.529 INFO:tasks.workunit.client.0.smithi019.stdout:8/200: readlink d5/dc/d17/l1b 0 2024-09-12T22:11:26.530 INFO:tasks.workunit.client.0.smithi019.stdout:3/247: dwrite f16 [4194304,4194304] 0 2024-09-12T22:11:26.531 INFO:tasks.workunit.client.0.smithi019.stdout:6/236: mkdir d9/d3d/d4f 0 2024-09-12T22:11:26.531 INFO:tasks.workunit.client.0.smithi019.stdout:8/201: unlink d5/dc/f2a 0 2024-09-12T22:11:26.532 INFO:tasks.workunit.client.0.smithi019.stdout:5/256: getdents d0/d26 0 2024-09-12T22:11:26.532 INFO:tasks.workunit.client.0.smithi019.stdout:4/224: read f4 [840138,85924] 0 2024-09-12T22:11:26.532 INFO:tasks.workunit.client.0.smithi019.stdout:3/248: rename d18/f1f to d18/d1d/d35/f49 0 2024-09-12T22:11:26.532 INFO:tasks.workunit.client.0.smithi019.stdout:3/249: stat f9 0 2024-09-12T22:11:26.533 INFO:tasks.workunit.client.0.smithi019.stdout:7/257: write da/d24/f2c [2524112,59586] 0 2024-09-12T22:11:26.533 INFO:tasks.workunit.client.0.smithi019.stdout:9/185: truncate d12/d1b/d20/f2a 2409629 0 2024-09-12T22:11:26.534 INFO:tasks.workunit.client.0.smithi019.stdout:6/237: getdents d9/dc/d20 0 2024-09-12T22:11:26.534 INFO:tasks.workunit.client.0.smithi019.stdout:3/250: mkdir d18/d26/d30/d4a 0 2024-09-12T22:11:26.536 INFO:tasks.workunit.client.0.smithi019.stdout:9/186: symlink d12/d1b/d20/l3d 0 2024-09-12T22:11:26.536 INFO:tasks.workunit.client.0.smithi019.stdout:3/251: chown d18/c20 58 1 2024-09-12T22:11:26.536 INFO:tasks.workunit.client.0.smithi019.stdout:6/238: creat d9/dc/d20/f50 x:0 0 0 2024-09-12T22:11:26.538 INFO:tasks.workunit.client.0.smithi019.stdout:6/239: fsync d9/dc/d20/d30/f42 0 2024-09-12T22:11:26.539 INFO:tasks.workunit.client.0.smithi019.stdout:8/202: dwrite d5/d16/d19/d29/f38 [0,4194304] 0 2024-09-12T22:11:26.540 INFO:tasks.workunit.client.0.smithi019.stdout:5/257: dwrite d0/f11 [0,4194304] 0 2024-09-12T22:11:26.542 INFO:tasks.workunit.client.0.smithi019.stdout:8/203: symlink d5/d16/d19/d29/l46 0 2024-09-12T22:11:26.544 INFO:tasks.workunit.client.0.smithi019.stdout:4/225: truncate d9/f27 3304813 0 2024-09-12T22:11:26.544 INFO:tasks.workunit.client.0.smithi019.stdout:7/258: truncate da/d24/d28/f57 3087323 0 2024-09-12T22:11:26.544 INFO:tasks.workunit.client.0.smithi019.stdout:9/187: truncate d12/d1b/f32 2044579 0 2024-09-12T22:11:26.545 INFO:tasks.workunit.client.0.smithi019.stdout:3/252: truncate d18/d1d/d35/f49 4011498 0 2024-09-12T22:11:26.545 INFO:tasks.workunit.client.0.smithi019.stdout:5/258: truncate d0/f19 239412 0 2024-09-12T22:11:26.545 INFO:tasks.workunit.client.0.smithi019.stdout:4/226: mknod d9/d14/d33/c49 0 2024-09-12T22:11:26.546 INFO:tasks.workunit.client.0.smithi019.stdout:3/253: readlink d18/d1d/l2c 0 2024-09-12T22:11:26.546 INFO:tasks.workunit.client.0.smithi019.stdout:6/240: dwrite d9/dc/d20/f21 [0,4194304] 0 2024-09-12T22:11:26.546 INFO:tasks.workunit.client.0.smithi019.stdout:7/259: fdatasync da/d24/d28/f57 0 2024-09-12T22:11:26.547 INFO:tasks.workunit.client.0.smithi019.stdout:9/188: symlink d12/l3e 0 2024-09-12T22:11:26.547 INFO:tasks.workunit.client.0.smithi019.stdout:5/259: creat d0/d26/d3a/f59 x:0 0 0 2024-09-12T22:11:26.547 INFO:tasks.workunit.client.0.smithi019.stdout:2/169: dread d0/d31/d12/d15/f23 [0,4194304] 0 2024-09-12T22:11:26.547 INFO:tasks.workunit.client.0.smithi019.stdout:4/227: symlink d9/d14/d31/d3f/l4a 0 2024-09-12T22:11:26.548 INFO:tasks.workunit.client.0.smithi019.stdout:5/260: write d0/f5 [7102926,35608] 0 2024-09-12T22:11:26.549 INFO:tasks.workunit.client.0.smithi019.stdout:7/260: chown da/d30/d53/f59 78961 1 2024-09-12T22:11:26.549 INFO:tasks.workunit.client.0.smithi019.stdout:9/189: unlink d12/l21 0 2024-09-12T22:11:26.549 INFO:tasks.workunit.client.0.smithi019.stdout:4/228: read d9/f3b [2237094,66964] 0 2024-09-12T22:11:26.549 INFO:tasks.workunit.client.0.smithi019.stdout:6/241: rename d9/dc/d20/f4a to d9/dc/d20/d30/f51 0 2024-09-12T22:11:26.549 INFO:tasks.workunit.client.0.smithi019.stdout:8/204: dread d5/dc/d17/f2b [0,4194304] 0 2024-09-12T22:11:26.550 INFO:tasks.workunit.client.0.smithi019.stdout:7/261: fsync da/d30/f56 0 2024-09-12T22:11:26.550 INFO:tasks.workunit.client.0.smithi019.stdout:4/229: chown d9/d14/f1c 53499 1 2024-09-12T22:11:26.551 INFO:tasks.workunit.client.0.smithi019.stdout:2/170: getdents d0/d3/d21/d36 0 2024-09-12T22:11:26.551 INFO:tasks.workunit.client.0.smithi019.stdout:7/262: stat da/d24/d28/c1b 0 2024-09-12T22:11:26.552 INFO:tasks.workunit.client.0.smithi019.stdout:6/242: creat d9/dc/f52 x:0 0 0 2024-09-12T22:11:26.553 INFO:tasks.workunit.client.0.smithi019.stdout:4/230: creat d9/d14/d33/f4b x:0 0 0 2024-09-12T22:11:26.553 INFO:tasks.workunit.client.0.smithi019.stdout:6/243: stat d9/f22 0 2024-09-12T22:11:26.555 INFO:tasks.workunit.client.0.smithi019.stdout:3/254: dwrite d18/d1d/f3b [0,4194304] 0 2024-09-12T22:11:26.555 INFO:tasks.workunit.client.0.smithi019.stdout:4/231: write d9/db/d2b/f37 [4345238,122237] 0 2024-09-12T22:11:26.558 INFO:tasks.workunit.client.0.smithi019.stdout:6/244: write d9/dc/d20/f50 [60993,48895] 0 2024-09-12T22:11:26.558 INFO:tasks.workunit.client.0.smithi019.stdout:5/261: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:11:26.559 INFO:tasks.workunit.client.0.smithi019.stdout:3/255: creat d18/d26/f4b x:0 0 0 2024-09-12T22:11:26.562 INFO:tasks.workunit.client.0.smithi019.stdout:8/205: dread d5/f6 [0,4194304] 0 2024-09-12T22:11:26.562 INFO:tasks.workunit.client.0.smithi019.stdout:2/171: write d0/d3/d11/fc [2006275,64237] 0 2024-09-12T22:11:26.563 INFO:tasks.workunit.client.0.smithi019.stdout:9/190: dwrite d12/d1b/d20/d25/f3b [0,4194304] 0 2024-09-12T22:11:26.565 INFO:tasks.workunit.client.0.smithi019.stdout:7/263: dwrite da/d19/f46 [0,4194304] 0 2024-09-12T22:11:26.569 INFO:tasks.workunit.client.0.smithi019.stdout:6/245: dwrite d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:26.570 INFO:tasks.workunit.client.0.smithi019.stdout:2/172: dwrite d0/d31/d4/f16 [4194304,4194304] 0 2024-09-12T22:11:26.570 INFO:tasks.workunit.client.0.smithi019.stdout:6/246: readlink d9/dc/d20/d30/l41 0 2024-09-12T22:11:26.570 INFO:tasks.workunit.client.0.smithi019.stdout:1/237: sync 2024-09-12T22:11:26.573 INFO:tasks.workunit.client.0.smithi019.stdout:0/225: dread d5/f16 [0,4194304] 0 2024-09-12T22:11:26.578 INFO:tasks.workunit.client.0.smithi019.stdout:3/256: mknod d18/d26/d30/c4c 0 2024-09-12T22:11:26.578 INFO:tasks.workunit.client.0.smithi019.stdout:2/173: symlink d0/d3/df/d18/d2c/d30/l3a 0 2024-09-12T22:11:26.578 INFO:tasks.workunit.client.0.smithi019.stdout:1/238: unlink d1/d2/d18/d29/d27/d12/f2d 0 2024-09-12T22:11:26.579 INFO:tasks.workunit.client.0.smithi019.stdout:5/262: creat d0/d4e/f5a x:0 0 0 2024-09-12T22:11:26.579 INFO:tasks.workunit.client.0.smithi019.stdout:9/191: truncate d12/f1a 1412150 0 2024-09-12T22:11:26.579 INFO:tasks.workunit.client.0.smithi019.stdout:2/174: readlink d0/d3/d11/d2e/l38 0 2024-09-12T22:11:26.579 INFO:tasks.workunit.client.0.smithi019.stdout:3/257: rmdir d18/d1d/d35 39 2024-09-12T22:11:26.579 INFO:tasks.workunit.client.0.smithi019.stdout:0/226: write d5/d7/de/f3c [1210164,57274] 0 2024-09-12T22:11:26.580 INFO:tasks.workunit.client.0.smithi019.stdout:6/247: link f4 d9/d3d/d4f/f53 0 2024-09-12T22:11:26.580 INFO:tasks.workunit.client.0.smithi019.stdout:6/248: read d9/dc/f36 [2324274,17700] 0 2024-09-12T22:11:26.583 INFO:tasks.workunit.client.0.smithi019.stdout:4/232: getdents d9/d14/d33 0 2024-09-12T22:11:26.583 INFO:tasks.workunit.client.0.smithi019.stdout:5/263: rename d0/f10 to d0/d24/f5b 0 2024-09-12T22:11:26.583 INFO:tasks.workunit.client.0.smithi019.stdout:9/192: rmdir d12/d1b/d20/d29 39 2024-09-12T22:11:26.583 INFO:tasks.workunit.client.0.smithi019.stdout:3/258: unlink cf 0 2024-09-12T22:11:26.584 INFO:tasks.workunit.client.0.smithi019.stdout:1/239: creat d1/d4/dc/f50 x:0 0 0 2024-09-12T22:11:26.584 INFO:tasks.workunit.client.0.smithi019.stdout:5/264: stat d0/d1d/f44 0 2024-09-12T22:11:26.584 INFO:tasks.workunit.client.0.smithi019.stdout:4/233: write d9/db/d2b/f30 [298876,58553] 0 2024-09-12T22:11:26.585 INFO:tasks.workunit.client.0.smithi019.stdout:5/265: stat d0/d1d/d4f/f2b 0 2024-09-12T22:11:26.585 INFO:tasks.workunit.client.0.smithi019.stdout:3/259: rmdir d18/d1d/d48 0 2024-09-12T22:11:26.585 INFO:tasks.workunit.client.0.smithi019.stdout:1/240: write d1/d2/f24 [694524,69851] 0 2024-09-12T22:11:26.585 INFO:tasks.workunit.client.0.smithi019.stdout:4/234: write d9/fc [3990521,18959] 0 2024-09-12T22:11:26.585 INFO:tasks.workunit.client.0.smithi019.stdout:3/260: write f8 [2131023,23794] 0 2024-09-12T22:11:26.586 INFO:tasks.workunit.client.0.smithi019.stdout:5/266: write d0/f2 [3094508,108961] 0 2024-09-12T22:11:26.586 INFO:tasks.workunit.client.0.smithi019.stdout:1/241: mkdir d1/d2/d18/d29/d51 0 2024-09-12T22:11:26.586 INFO:tasks.workunit.client.0.smithi019.stdout:4/235: write f7 [328611,122934] 0 2024-09-12T22:11:26.587 INFO:tasks.workunit.client.0.smithi019.stdout:3/261: unlink d18/d26/f41 0 2024-09-12T22:11:26.587 INFO:tasks.workunit.client.0.smithi019.stdout:5/267: fdatasync d0/d1d/f44 0 2024-09-12T22:11:26.588 INFO:tasks.workunit.client.0.smithi019.stdout:4/236: write d9/d14/d33/f4b [924536,48306] 0 2024-09-12T22:11:26.588 INFO:tasks.workunit.client.0.smithi019.stdout:1/242: creat d1/d2/d18/d29/d27/d12/f52 x:0 0 0 2024-09-12T22:11:26.588 INFO:tasks.workunit.client.0.smithi019.stdout:5/268: fsync d0/d1d/d3d/f55 0 2024-09-12T22:11:26.589 INFO:tasks.workunit.client.0.smithi019.stdout:9/193: dwrite f11 [0,4194304] 0 2024-09-12T22:11:26.589 INFO:tasks.workunit.client.0.smithi019.stdout:3/262: rename d18/c1a to d18/d26/d30/d4a/c4d 0 2024-09-12T22:11:26.589 INFO:tasks.workunit.client.0.smithi019.stdout:5/269: dread - d0/d1d/d4f/d47/f4a zero size 2024-09-12T22:11:26.592 INFO:tasks.workunit.client.0.smithi019.stdout:9/194: symlink d12/d1b/l3f 0 2024-09-12T22:11:26.592 INFO:tasks.workunit.client.0.smithi019.stdout:3/263: mkdir d18/d26/d30/d4e 0 2024-09-12T22:11:26.592 INFO:tasks.workunit.client.0.smithi019.stdout:1/243: mkdir d1/d4/dc/df/d53 0 2024-09-12T22:11:26.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/264: chown fb 2952 1 2024-09-12T22:11:26.595 INFO:tasks.workunit.client.0.smithi019.stdout:5/270: dwrite d0/d1d/d3d/f48 [0,4194304] 0 2024-09-12T22:11:26.595 INFO:tasks.workunit.client.0.smithi019.stdout:9/195: mkdir d12/d1b/d40 0 2024-09-12T22:11:26.597 INFO:tasks.workunit.client.0.smithi019.stdout:5/271: write d0/d1d/d4f/f2b [4460643,102991] 0 2024-09-12T22:11:26.599 INFO:tasks.workunit.client.0.smithi019.stdout:9/196: mknod d12/c41 0 2024-09-12T22:11:26.600 INFO:tasks.workunit.client.0.smithi019.stdout:5/272: creat d0/d26/d3a/f5c x:0 0 0 2024-09-12T22:11:26.600 INFO:tasks.workunit.client.0.smithi019.stdout:3/265: mknod d18/d26/d30/d4e/c4f 0 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8828457269999994, 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8822447929999999, 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8706836679999999, 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 3795856~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6708945229999994, 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021812946, 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931218+0000", 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0800000000000001e-07 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931221+0000", 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8219999999999998e-06 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931227+0000", 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931229+0000", 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7180000000000001e-06 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950607+0000", 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019377976000000002 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950649+0000", 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1968000000000002e-05 2024-09-12T22:11:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.950719+0000", 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9245000000000005e-05 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952304+0000", 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00158519 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952974+0000", 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00066995900000000003 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953003+0000", 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9184e-05 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953031+0000", 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8014999999999999e-05 2024-09-12T22:11:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 3797262~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6708803000000003, 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021906492999999999, 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931232+0000", 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931234+0000", 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.404e-06 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931237+0000", 2024-09-12T22:11:26.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9510000000000002e-06 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931239+0000", 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4260000000000002e-06 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951070+0000", 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019830711000000001 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951151+0000", 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1200999999999997e-05 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951248+0000", 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6430999999999999e-05 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952498+0000", 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012502710000000001 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953074+0000", 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057586699999999998 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953115+0000", 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1817000000000003e-05 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953139+0000", 2024-09-12T22:11:26.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3187999999999999e-05 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 3798667~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6708707920000005, 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021993792000000002, 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.633 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931242+0000", 2024-09-12T22:11:26.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931243+0000", 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5820000000000001e-06 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931246+0000", 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9059999999999998e-06 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931249+0000", 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.813e-06 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951505+0000", 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020255813000000001 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951578+0000", 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3119000000000002e-05 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.951691+0000", 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113177 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.952502+0000", 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00081045499999999996 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953182+0000", 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00068051099999999996 2024-09-12T22:11:26.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953216+0000", 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3708999999999999e-05 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953235+0000", 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9497e-05 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 3800068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6708584650000002, 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024017679, 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-07 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931256+0000", 2024-09-12T22:11:26.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7e-06 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931261+0000", 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2179999999999998e-06 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931266+0000", 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953273+0000", 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022006537999999999 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953326+0000", 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3256e-05 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953415+0000", 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8657000000000002e-05 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954136+0000", 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072149300000000003 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955218+0000", 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010819110000000001 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955249+0000", 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0542e-05 2024-09-12T22:11:26.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955272+0000", 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3037999999999999e-05 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6708401790000007, 2024-09-12T22:11:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:26.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:26.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.649 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6708183299999995, 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:26.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:26.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:26.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6708035399999996, 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.656 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.661 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6707936710000002, 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:26.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:26.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.670779585, 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:26.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:26.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:26.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10788 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.715867+0000", 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.88624538399999997, 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023172617, 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10788 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.715867+0000", 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.715867+0000", 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.715868+0000", 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.724674+0000", 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088059720000000005 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.724684+0000", 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0339e-05 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.724689+0000", 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8509999999999998e-06 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.724774+0000", 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5350000000000001e-05 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.724857+0000", 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2911000000000006e-05 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.724983+0000", 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000125687 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.731878+0000", 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006894636 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.738977+0000", 2024-09-12T22:11:26.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070992609999999999 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.739010+0000", 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3379e-05 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.739040+0000", 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9430000000000001e-05 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.78420361500000002, 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:26.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:26.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:26.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10890 4.26 4:643f89d3:::10000003197.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.908618+0000", 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.693494057, 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022217615999999999, 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10890 2024-09-12T22:11:26.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.908618+0000", 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.908618+0000", 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.908619+0000", 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6899999999999996e-07 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.913239+0000", 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046198300000000001 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.913251+0000", 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.165e-05 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.913256+0000", 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4319999999999998e-06 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.913306+0000", 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9926999999999998e-05 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.913439+0000", 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013312400000000001 2024-09-12T22:11:26.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.913575+0000", 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013607699999999999 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.917890+0000", 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043145060000000001 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.930782+0000", 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012891952999999999 2024-09-12T22:11:26.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.930813+0000", 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0923000000000002e-05 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.930836+0000", 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3224999999999999e-05 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.48353216399999999, 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.692 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.697 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:11111 4.20 e52/34 4:060b30bc:::100000030e8.00000000:head v 52'193, mlcod=52'191)", 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.279013+0000", 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.32309940999999998, 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022635230999999999, 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279013+0000", 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279013+0000", 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279014+0000", 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9600000000000008e-07 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.285657+0000", 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066433660000000004 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.285672+0000", 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4611e-05 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.285681+0000", 2024-09-12T22:11:26.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4239999999999999e-06 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.285746+0000", 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4247999999999999e-05 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.285775+0000", 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.921e-05 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.301593+0000", 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015817906 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.301648+0000", 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5470000000000003e-05 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11117 4.33 4:cf859f74:::10000003108.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.279016+0000", 2024-09-12T22:11:26.702 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.32309623399999998, 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023810147, 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11117 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279016+0000", 2024-09-12T22:11:26.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279016+0000", 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279017+0000", 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.223e-06 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286299+0000", 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007281526 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286309+0000", 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.012e-05 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286314+0000", 2024-09-12T22:11:26.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1529999999999996e-06 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286366+0000", 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1943000000000001e-05 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286515+0000", 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014908099999999999 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.302715+0000", 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016199623 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.302759+0000", 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769000000000001e-05 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.302826+0000", 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7708999999999998e-05 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.15400456000000001, 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.708 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:26.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11316 4.29 4:9786b8f5:::10000003100.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.540995+0000", 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.061117414000000002, 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022059631999999999, 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:26.715 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11316 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.540995+0000", 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.540995+0000", 2024-09-12T22:11:26.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.540996+0000", 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1880000000000001e-06 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.547891+0000", 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068945339999999999 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.547910+0000", 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8875000000000001e-05 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.547919+0000", 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0070000000000003e-06 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.548021+0000", 2024-09-12T22:11:26.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010187999999999999 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.548097+0000", 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6705999999999994e-05 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.548216+0000", 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011895 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:26.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.555820+0000", 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076038720000000002 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.562980+0000", 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071599840000000003 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.563016+0000", 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5617999999999997e-05 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:26.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.563055+0000", 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9017999999999998e-05 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:26.721 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:26.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:26.723 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:26.721+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:26.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:5/273: fdatasync d0/fe 0 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:5/274: stat d0/d1d/c2a 0 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:3/266: symlink d18/d26/l50 0 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:3/267: write d18/f2e [29711,98708] 0 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:3/268: dread d18/d1d/f2f [0,4194304] 0 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:1/244: link d1/d4/dc/df/d2c/c4e d1/d4/dc/df/d2c/c54 0 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:9/197: dwrite d12/d1b/d20/f36 [4194304,4194304] 0 2024-09-12T22:11:26.751 INFO:tasks.workunit.client.0.smithi019.stdout:3/269: write d18/d1d/f3f [163987,95064] 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:7/264: truncate da/d19/d25/d39/f45 2457835 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:6/249: truncate d9/dc/f13 1798347 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:5/275: creat d0/d1d/d4f/d47/f5d x:0 0 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:1/245: rename d1/d4/dc/df/d45 to d1/d4/dc/df/d53/d55 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:3/270: rename d18/d26/d30/d4e/c4f to d18/d26/d30/d4e/c51 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:7/265: creat da/d24/d28/d1c/d32/f5c x:0 0 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:9/198: fdatasync d12/f1a 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:8/206: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:0/227: dwrite d5/d7/d10/d26/d2a/f37 [0,4194304] 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:4/237: dwrite d9/d14/f38 [0,4194304] 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:7/266: write da/d19/f50 [3555567,85595] 0 2024-09-12T22:11:26.752 INFO:tasks.workunit.client.0.smithi019.stdout:1/246: mkdir d1/d4/dc/df/d53/d55/d56 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:6/250: rename d9/f3f to d9/dc/f54 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:9/199: creat d12/d1b/f42 x:0 0 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:8/207: mknod d5/d16/d19/c47 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:3/271: dwrite d18/f34 [0,4194304] 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:6/251: link d9/l1f d9/dc/l55 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:1/247: symlink d1/d4/dc/df/d53/d55/d56/l57 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:8/208: getdents d5/dc/d26/d43 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:3/272: rmdir d18/d1d/d35 39 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:1/248: readlink d1/d2/d18/d35/l41 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:6/252: mkdir d9/dc/d56 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:8/209: truncate d5/f15 4440909 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:0/228: write d5/d7/f12 [176905,51570] 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:7/267: truncate da/d19/f50 154771 0 2024-09-12T22:11:26.753 INFO:tasks.workunit.client.0.smithi019.stdout:6/253: creat d9/f57 x:0 0 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:3/273: chown d18/d26/d30/d4e 106 1 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:1/249: creat d1/d2/d18/d29/d27/d12/f58 x:0 0 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:8/210: dread - d5/dc/d26/f36 zero size 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:6/254: symlink d9/dc/d20/l58 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:0/229: fdatasync d5/d7/d2c/f47 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:8/211: chown d5/dc/l37 2138 1 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:0/230: unlink d5/f1f 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:8/212: write d5/f42 [1043736,129116] 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:6/255: mkdir d9/d3d/d4f/d59 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:7/268: dread da/d19/d25/d39/f45 [0,4194304] 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:6/256: chown d9/dc/d20/f1a 762 1 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:6/257: truncate d9/dc/f36 3072400 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:7/269: rename da/d24/d28/d1c/d32/l4b to da/d24/d28/d1c/l5d 0 2024-09-12T22:11:26.754 INFO:tasks.workunit.client.0.smithi019.stdout:6/258: mknod d9/dc/d20/d30/c5a 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:7/270: chown da/d19/d25/d39/f49 52 1 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:3/274: read f8 [1910533,51942] 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:8/213: dwrite d5/dc/ff [0,4194304] 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:7/271: unlink da/d24/d28/l3d 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:8/214: chown d5/d16/c22 248 1 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:8/215: stat d5/d16/d19/d29/f38 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:8/216: rmdir d5/d16 39 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:0/231: truncate d5/d7/de/f31 328535 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:0/232: chown d5/d7/d10/d26/f3e 2979331 1 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:8/217: rename d5/d16/d19/c1f to d5/dc/d26/d43/c48 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:7/272: dwrite da/d19/f41 [0,4194304] 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:8/218: mkdir d5/dc/d26/d43/d49 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:7/273: truncate da/f5b 91571 0 2024-09-12T22:11:26.755 INFO:tasks.workunit.client.0.smithi019.stdout:0/233: rmdir d5/d7/d10/d43 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:3/275: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:1/250: dread d1/d4/dc/f32 [0,4194304] 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:7/274: chown da/d24/d28/l43 100116130 1 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:2/175: sync 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:8/219: unlink d5/d16/d19/d32/l44 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:1/251: fdatasync d1/d2/d18/d29/d27/d12/f1b 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:4/238: dread d9/fc [4194304,4194304] 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:7/275: mkdir da/d24/d28/d1c/d32/d5e 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:4/239: read d9/f3b [3206932,25230] 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:0/234: unlink d5/c21 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:8/220: write d5/d16/d19/d29/f38 [2043967,44907] 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:1/252: write d1/d2/d18/d29/d27/d12/f44 [5012481,8449] 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:7/276: unlink da/d24/d28/d1c/d32/c5a 0 2024-09-12T22:11:26.756 INFO:tasks.workunit.client.0.smithi019.stdout:7/277: write da/d19/f46 [971841,64285] 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:8/221: write d5/f23 [12866,20848] 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:1/253: write d1/fe [671017,77772] 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:2/176: dread d0/d31/d4/f24 [0,4194304] 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:5/276: dread d0/d1d/d4f/f1a [0,4194304] 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:7/278: chown da/d19/d25/f2e 635 1 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:6/259: dread d9/dc/d20/f32 [0,4194304] 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:4/240: truncate d9/f3b 324073 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:0/235: truncate d5/d7/de/f3c 830666 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:1/254: rename d1/d2/d38 to d1/d2/d18/d59 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:5/277: fsync d0/d1d/d4f/d47/f5d 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:2/177: stat d0/d3/d21/c29 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:4/241: stat d9/d17/f1d 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:6/260: mkdir d9/dc/d20/d30/d5b 0 2024-09-12T22:11:26.757 INFO:tasks.workunit.client.0.smithi019.stdout:7/279: write da/d19/f50 [1191750,25591] 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:1/255: stat d1/d2/d18/d59/f4d 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:0/236: symlink d5/d7/l49 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:5/278: mknod d0/d26/d42/c5e 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:2/178: mkdir d0/d31/d12/d3b 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:6/261: dread - d9/dc/f54 zero size 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:1/256: creat d1/d4/f5a x:0 0 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:5/279: mkdir d0/d26/d5f 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:4/242: read d9/d14/f1c [1037274,78294] 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:8/222: dwrite d5/d16/f28 [0,4194304] 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:3/276: dread f15 [0,4194304] 0 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:6/262: chown d9/dc/d20/d30/c5a 380226404 1 2024-09-12T22:11:26.758 INFO:tasks.workunit.client.0.smithi019.stdout:2/179: fdatasync d0/d31/d12/d15/f23 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:1/257: rmdir d1/d2/d18 39 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:4/243: fsync d9/db/f24 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:0/237: creat d5/d7/f4a x:0 0 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:2/180: write d0/d31/d12/d15/f33 [2718651,74068] 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:8/223: mknod d5/dc/d17/c4a 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:3/277: creat d18/d26/d30/d4e/f52 x:0 0 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:5/280: getdents d0/d26/d5f 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:4/244: mkdir d9/d4c 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:0/238: fsync d5/d7/f12 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:6/263: creat d9/dc/d56/f5c x:0 0 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:9/200: dread f5 [0,4194304] 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:3/278: fdatasync f8 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:0/239: fdatasync d5/f41 0 2024-09-12T22:11:26.759 INFO:tasks.workunit.client.0.smithi019.stdout:2/181: symlink d0/d3/df/d18/l3c 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:4/245: symlink d9/l4d 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:5/281: creat d0/d4e/d50/f60 x:0 0 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:9/201: creat d12/d1b/f43 x:0 0 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:6/264: readlink d9/d3d/l3e 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:0/240: mkdir d5/d7/d2c/d44/d4b 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:9/202: chown d12/c31 279275396 1 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:3/279: creat d18/d26/d30/d4a/f53 x:0 0 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:4/246: mkdir d9/d14/d33/d4e 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:5/282: mknod d0/d26/d5f/c61 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:2/182: truncate d0/d3/d21/d36/f39 826158 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:8/224: dread d5/d16/d19/d29/f38 [0,4194304] 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:5/283: fdatasync d0/f1b 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:9/203: read d12/d1b/d20/f2a [2212375,67690] 0 2024-09-12T22:11:26.760 INFO:tasks.workunit.client.0.smithi019.stdout:6/265: creat d9/dc/d20/d30/d5b/f5d x:0 0 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:4/247: creat d9/d17/f4f x:0 0 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:5/284: dread - d0/d1d/d3d/f53 zero size 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:8/225: mkdir d5/dc/d26/d4b 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:6/266: unlink d9/dc/l55 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:0/241: rmdir d5/d7/d2c/d44/d4b 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:9/204: symlink d12/d1b/d20/d29/l44 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:2/183: truncate d0/d31/d12/d15/f33 3289363 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:5/285: dread - d0/d4e/d50/f60 zero size 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:3/280: truncate f3 7039480 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:9/205: creat d12/f45 x:0 0 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:5/286: chown d0/d26/d42 0 1 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:0/242: creat d5/f4c x:0 0 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:8/226: creat d5/dc/d26/d43/f4c x:0 0 0 2024-09-12T22:11:26.761 INFO:tasks.workunit.client.0.smithi019.stdout:6/267: truncate d9/dc/d20/f50 291242 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:3/281: symlink d18/d26/d30/d4e/l54 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:7/280: dread da/f11 [0,4194304] 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:8/227: dread - d5/dc/d26/f36 zero size 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:3/282: chown d18/d26/d30 636311 1 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:6/268: creat d9/d3d/d4f/f5e x:0 0 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:4/248: dwrite d9/d17/f1d [0,4194304] 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:8/228: truncate d5/d16/d19/f34 632345 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:3/283: rename d18/c24 to d18/d26/d30/d4e/c55 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:1/258: dread d1/d2/f7 [0,4194304] 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:4/249: symlink d9/l50 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:0/243: dwrite d5/f22 [0,4194304] 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:7/281: getdents da/d19/d25/d39 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:9/206: dwrite d12/f17 [0,4194304] 0 2024-09-12T22:11:26.762 INFO:tasks.workunit.client.0.smithi019.stdout:6/269: mknod d9/dc/c5f 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:6/270: readlink l2 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:8/229: read - d5/d16/d19/f45 zero size 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:2/184: dwrite d0/d31/d12/f1b [0,4194304] 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:4/250: rmdir d9/d14 39 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:3/284: creat d18/f56 x:0 0 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:5/287: sync 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:1/259: symlink d1/d2/d18/d29/l5b 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:3/285: truncate d18/d1d/f3f 1050680 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:0/244: rename d5/d7/f18 to d5/d7/d10/f4d 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:8/230: creat d5/d16/d19/d29/f4d x:0 0 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:7/282: symlink da/l5f 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:9/207: fdatasync d12/d1b/f1c 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:5/288: rename d0/d26/f3f to d0/d4e/d50/f62 0 2024-09-12T22:11:26.763 INFO:tasks.workunit.client.0.smithi019.stdout:8/231: rmdir d5/d16 39 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:0/245: chown d5/d7/de/l3d 862871242 1 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:9/208: chown d12/d1b/l27 0 1 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:8/232: chown d5/dc 3509279 1 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:1/260: truncate d1/d4/dc/df/d2c/f49 343978 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:2/185: dwrite d0/d3/d11/f10 [0,4194304] 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:6/271: link l3 d9/dc/d20/d30/l60 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:5/289: rmdir d0/d26/d5f 39 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:9/209: unlink d12/f26 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:7/283: creat da/d24/d28/d1c/d32/f60 x:0 0 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:4/251: dread d9/f2f [0,4194304] 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:8/233: readlink d5/dc/d26/l3f 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:2/186: write d0/d31/d12/f1b [2301938,119965] 0 2024-09-12T22:11:26.764 INFO:tasks.workunit.client.0.smithi019.stdout:0/246: stat d5/d7/de/f31 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:3/286: getdents d18/d1d 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:8/234: write d5/dc/d26/f36 [749233,75616] 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:5/290: creat d0/f63 x:0 0 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:4/252: fsync d9/f27 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:1/261: write d1/d2/d18/d29/d27/d12/f52 [564209,85503] 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:2/187: symlink d0/l3d 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:3/287: mknod d18/d1d/c57 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:7/284: truncate da/d19/d25/d39/f45 1437306 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:3/288: sync 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:0/247: mknod d5/d7/d25/d46/c4e 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:8/235: symlink d5/dc/d26/l4e 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:7/285: fdatasync da/d19/f50 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:5/291: write d0/d1d/d4f/f4b [288362,96057] 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:4/253: mknod d9/c51 0 2024-09-12T22:11:26.765 INFO:tasks.workunit.client.0.smithi019.stdout:3/289: mkdir d18/d58 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:8/236: dread - d5/dc/d26/f41 zero size 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:7/286: rmdir da/d24 39 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:9/210: dwrite d12/f1f [0,4194304] 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:1/262: creat d1/d2/d18/d29/d51/f5c x:0 0 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:0/248: write d5/d7/f11 [5246754,74020] 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:3/290: creat d18/d26/d30/d4e/f59 x:0 0 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:4/254: mknod d9/d14/d33/d4e/c52 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:3/291: fdatasync f9 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:6/272: dwrite f4 [0,4194304] 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:4/255: chown d9 1072 1 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:5/292: read d0/d1d/f22 [60317,116007] 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:2/188: dwrite d0/d3/d11/f10 [4194304,4194304] 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:5/293: truncate d0/d4e/f5a 419758 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:9/211: rename d12/d1b/c1d to d12/d1b/d20/d37/c46 0 2024-09-12T22:11:26.766 INFO:tasks.workunit.client.0.smithi019.stdout:7/287: dread da/d19/f46 [0,4194304] 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:4/256: write d9/d14/d31/d3f/f48 [693903,30792] 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:6/273: creat d9/d3d/f61 x:0 0 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:3/292: stat d18/d1d/c42 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:1/263: dread d1/f11 [0,4194304] 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:8/237: dread d5/d16/f28 [0,4194304] 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:8/238: dread - d5/dc/f2e zero size 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:6/274: unlink d9/d3d/l3e 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:7/288: creat da/d19/d25/d39/f61 x:0 0 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:3/293: fdatasync d18/d1d/f2b 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:2/189: link d0/l3d d0/d31/d12/d15/l3e 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:4/257: getdents d9/d4c 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:7/289: read - da/d30/d53/f59 zero size 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:9/212: dread f4 [0,4194304] 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:6/275: rename d9/dc/f54 to d9/d3d/d4f/f62 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:5/294: write d0/d1d/f22 [641836,13137] 0 2024-09-12T22:11:26.767 INFO:tasks.workunit.client.0.smithi019.stdout:2/190: write d0/d31/d12/f1b [4038914,129594] 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:4/258: rmdir d9/db 39 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:7/290: chown da/d19/l55 1052731653 1 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:1/264: getdents d1/d4/dc/df/d53/d55/d56 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:9/213: creat d12/f47 x:0 0 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:5/295: chown d0/d1d/d4f/d47/f4a 98138320 1 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:4/259: creat d9/d14/d33/d4e/f53 x:0 0 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:8/239: getdents d5/dc/d17 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:9/214: write d12/d1b/f43 [638920,33673] 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:7/291: creat da/d19/f62 x:0 0 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:1/265: mkdir d1/d4/dc/df/d2c/d5d 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:5/296: link d0/f2 d0/d1d/d4f/f64 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:2/191: rename d0/d3/df/f1f to d0/d31/d4/f3f 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:4/260: fsync d9/d14/d33/f4b 0 2024-09-12T22:11:26.768 INFO:tasks.workunit.client.0.smithi019.stdout:1/266: fdatasync d1/d2/d18/d29/d27/d12/f34 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:3/294: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:8/240: write d5/fd [4275798,122814] 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:7/292: dread da/f47 [0,4194304] 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:6/276: dwrite d9/dc/d20/d4b/f2d [0,4194304] 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:2/192: truncate d0/d31/d12/d15/f33 3779390 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:5/297: mknod d0/d26/c65 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:1/267: mknod d1/d4/c5e 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:2/193: fsync d0/d3/d21/d36/f39 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:3/295: mknod d18/c5a 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:6/277: creat d9/dc/d20/d30/d5b/f63 x:0 0 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:8/241: getdents d5/dc/d26 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:5/298: creat d0/d24/d58/f66 x:0 0 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:2/194: chown d0/d3/d21/d36/f39 27 1 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:6/278: mkdir d9/dc/d20/d4b/d64 0 2024-09-12T22:11:26.769 INFO:tasks.workunit.client.0.smithi019.stdout:9/215: dwrite d12/f1e [0,4194304] 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:7/293: dread da/d19/f46 [0,4194304] 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:5/299: readlink d0/d24/l35 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:5/300: readlink d0/d24/l40 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:2/195: symlink d0/d3/df/d18/l40 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:6/279: creat d9/dc/d56/f65 x:0 0 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:5/301: rmdir d0 39 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:8/242: rename d5/d16/d19/l25 to d5/d16/d19/l4f 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:6/280: readlink d9/l31 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:2/196: chown d0/d31/c28 0 1 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:9/216: getdents d12/d1b/d20 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:6/281: write d9/d3d/d4f/f53 [1512660,5348] 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:5/302: symlink d0/d24/l67 0 2024-09-12T22:11:26.770 INFO:tasks.workunit.client.0.smithi019.stdout:7/294: rename da/d24/c4c to da/d24/d28/d1c/d32/d5e/c63 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:9/217: mkdir d12/d48 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:3/296: dread f17 [0,4194304] 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:7/295: stat da/d24/d28/d1c/l5d 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:0/249: dread d5/d7/d10/d26/d2a/f2b [0,4194304] 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:9/218: creat d12/d1b/d20/d25/f49 x:0 0 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:5/303: creat d0/d26/d3a/f68 x:0 0 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:6/282: rename d9/dc/ld to d9/dc/d20/d30/d5b/l66 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:9/219: fdatasync d12/d1b/f1c 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:3/297: truncate d18/d1d/f2f 1050500 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:5/304: fdatasync d0/d1d/d3d/f53 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:6/283: creat d9/dc/d56/f67 x:0 0 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:0/250: creat d5/d7/d25/f4f x:0 0 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:8/243: dwrite d5/dc/d26/f3a [0,4194304] 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:2/197: dwrite d0/d31/d4/f3f [0,4194304] 0 2024-09-12T22:11:26.771 INFO:tasks.workunit.client.0.smithi019.stdout:9/220: mknod d12/d1b/c4a 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:5/305: unlink d0/d1d/d4f/d47/f4c 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:3/298: unlink d18/d26/l50 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:6/284: unlink d9/dc/d20/d30/f51 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:2/198: mknod d0/c41 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:0/251: mkdir d5/d50 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:2/199: sync 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:3/299: fsync d18/d1d/f3b 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:6/285: mknod d9/dc/d20/d4b/c68 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:5/306: read - d0/d1d/d4f/d47/f4a zero size 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:1/268: dread d1/d4/dc/f19 [4194304,4194304] 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:2/200: truncate d0/d31/d4/f3f 4536280 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:8/244: dread d5/d16/f28 [0,4194304] 0 2024-09-12T22:11:26.772 INFO:tasks.workunit.client.0.smithi019.stdout:7/296: dread da/f1d [0,4194304] 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:1/269: fsync d1/d4/dc/f50 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:6/286: truncate d9/dc/d56/f65 485858 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:5/307: creat d0/d1d/d3d/f69 x:0 0 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:3/300: rename d18/d26/l32 to d18/d26/d30/d4a/l5b 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:0/252: getdents d5/d7/d2c 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:9/221: dwrite d12/f17 [4194304,4194304] 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:5/308: fsync d0/d4e/d50/f60 0 2024-09-12T22:11:26.773 INFO:tasks.workunit.client.0.smithi019.stdout:3/301: symlink d18/d1d/d35/l5c 0 2024-09-12T22:11:26.777 INFO:tasks.workunit.client.0.smithi019.stdout:6/287: dread d9/dc/d56/f65 [0,4194304] 0 2024-09-12T22:11:26.777 INFO:tasks.workunit.client.0.smithi019.stdout:5/309: mknod d0/d1d/c6a 0 2024-09-12T22:11:26.777 INFO:tasks.workunit.client.0.smithi019.stdout:9/222: link d12/f30 d12/d1b/d20/d37/f4b 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:8/245: dread d5/dc/ff [0,4194304] 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:2/201: dread d0/d3/df/f37 [0,4194304] 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:5/310: stat d0/d26/d5f 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:3/302: creat d18/d1d/f5d x:0 0 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:4/261: dread f7 [0,4194304] 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:1/270: dwrite d1/d4/dc/f19 [4194304,4194304] 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:7/297: dwrite da/d19/d25/f2e [4194304,4194304] 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:2/202: creat d0/f42 x:0 0 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:6/288: getdents d9/dc/d20 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:9/223: creat d12/d1b/d20/d25/f4c x:0 0 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:0/253: dwrite d5/d7/f4a [0,4194304] 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:5/311: symlink d0/d26/d5f/l6b 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:7/298: creat da/d30/d53/f64 x:0 0 0 2024-09-12T22:11:26.778 INFO:tasks.workunit.client.0.smithi019.stdout:6/289: mknod d9/d3d/d4f/d59/c69 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:8/246: getdents d5/d16 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:1/271: symlink d1/d4/dc/df/d2c/d5d/l5f 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:2/203: unlink d0/d31/d4/c14 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:4/262: getdents d9/d14/d31 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:9/224: link d12/d1b/c33 d12/d1b/d20/c4d 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:6/290: chown l2 5 1 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:7/299: symlink da/d30/l65 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:9/225: read - f9 zero size 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:1/272: truncate d1/d4/dc/f28 215240 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:2/204: symlink d0/d3/d11/d2e/d34/l43 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:9/226: chown d12/d1b/l27 98 1 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:7/300: creat da/d30/d53/f66 x:0 0 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:0/254: dwrite d5/d7/d10/d26/f3e [0,4194304] 0 2024-09-12T22:11:26.779 INFO:tasks.workunit.client.0.smithi019.stdout:7/301: getdents da/d24/d28/d1c 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:4/263: dwrite d9/db/d2b/f30 [4194304,4194304] 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:8/247: dwrite d5/d16/d19/d29/f4d [0,4194304] 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:0/255: chown d5/d7/d2c/l3a 17 1 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:0/256: dread - d5/d7/d25/f4f zero size 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:2/205: dwrite d0/d3/d11/f19 [0,4194304] 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:7/302: mknod da/d19/d25/d39/d51/c67 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:7/303: write da/d19/f50 [56631,38257] 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:8/248: creat d5/d16/d19/f50 x:0 0 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:7/304: mkdir da/d30/d68 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:0/257: symlink d5/d7/l51 0 2024-09-12T22:11:26.780 INFO:tasks.workunit.client.0.smithi019.stdout:9/227: rename d12/d1b/d20/d29/l44 to d12/d1b/d20/l4e 0 2024-09-12T22:11:26.781 INFO:tasks.workunit.client.0.smithi019.stdout:6/291: sync 2024-09-12T22:11:26.781 INFO:tasks.workunit.client.0.smithi019.stdout:5/312: sync 2024-09-12T22:11:26.781 INFO:tasks.workunit.client.0.smithi019.stdout:8/249: read - d5/dc/d26/d43/f4c zero size 2024-09-12T22:11:26.781 INFO:tasks.workunit.client.0.smithi019.stdout:0/258: dread - d5/d7/de/f48 zero size 2024-09-12T22:11:26.782 INFO:tasks.workunit.client.0.smithi019.stdout:7/305: mknod da/d19/d25/d39/c69 0 2024-09-12T22:11:26.782 INFO:tasks.workunit.client.0.smithi019.stdout:4/264: dwrite d9/fc [4194304,4194304] 0 2024-09-12T22:11:26.782 INFO:tasks.workunit.client.0.smithi019.stdout:6/292: chown d9/d3d/d4f/f53 1306386 1 2024-09-12T22:11:26.783 INFO:tasks.workunit.client.0.smithi019.stdout:8/250: write d5/dc/f1c [6221334,46801] 0 2024-09-12T22:11:26.784 INFO:tasks.workunit.client.0.smithi019.stdout:7/306: creat da/d30/f6a x:0 0 0 2024-09-12T22:11:26.784 INFO:tasks.workunit.client.0.smithi019.stdout:5/313: rename d0/d4e/f56 to d0/d4e/d50/f6c 0 2024-09-12T22:11:26.784 INFO:tasks.workunit.client.0.smithi019.stdout:0/259: mkdir d5/d7/d25/d52 0 2024-09-12T22:11:26.785 INFO:tasks.workunit.client.0.smithi019.stdout:7/307: unlink da/d30/c4d 0 2024-09-12T22:11:26.785 INFO:tasks.workunit.client.0.smithi019.stdout:4/265: creat d9/f54 x:0 0 0 2024-09-12T22:11:26.785 INFO:tasks.workunit.client.0.smithi019.stdout:2/206: dwrite d0/d31/d12/f17 [0,4194304] 0 2024-09-12T22:11:26.786 INFO:tasks.workunit.client.0.smithi019.stdout:5/314: write d0/d1d/f20 [3614774,121758] 0 2024-09-12T22:11:26.787 INFO:tasks.workunit.client.0.smithi019.stdout:8/251: creat d5/f51 x:0 0 0 2024-09-12T22:11:26.787 INFO:tasks.workunit.client.0.smithi019.stdout:6/293: truncate d9/dc/d20/d30/d5b/f63 362697 0 2024-09-12T22:11:26.788 INFO:tasks.workunit.client.0.smithi019.stdout:3/303: dread d18/d1d/f3f [0,4194304] 0 2024-09-12T22:11:26.788 INFO:tasks.workunit.client.0.smithi019.stdout:9/228: truncate d12/d1b/d20/f2b 1567515 0 2024-09-12T22:11:26.789 INFO:tasks.workunit.client.0.smithi019.stdout:0/260: link d5/d7/f12 d5/d7/de/f53 0 2024-09-12T22:11:26.789 INFO:tasks.workunit.client.0.smithi019.stdout:4/266: rename d9/d14/d33/l3c to d9/d14/d33/l55 0 2024-09-12T22:11:26.789 INFO:tasks.workunit.client.0.smithi019.stdout:8/252: unlink d5/d16/d19/c47 0 2024-09-12T22:11:26.790 INFO:tasks.workunit.client.0.smithi019.stdout:6/294: mkdir d9/dc/d56/d6a 0 2024-09-12T22:11:26.790 INFO:tasks.workunit.client.0.smithi019.stdout:3/304: symlink d18/l5e 0 2024-09-12T22:11:26.790 INFO:tasks.workunit.client.0.smithi019.stdout:5/315: write d0/f17 [256431,20370] 0 2024-09-12T22:11:26.791 INFO:tasks.workunit.client.0.smithi019.stdout:0/261: rmdir d5/d7/d25/d46 39 2024-09-12T22:11:26.791 INFO:tasks.workunit.client.0.smithi019.stdout:9/229: symlink d12/d1b/d20/l4f 0 2024-09-12T22:11:26.792 INFO:tasks.workunit.client.0.smithi019.stdout:8/253: mknod d5/dc/d26/d43/c52 0 2024-09-12T22:11:26.792 INFO:tasks.workunit.client.0.smithi019.stdout:5/316: mkdir d0/d1d/d6d 0 2024-09-12T22:11:26.792 INFO:tasks.workunit.client.0.smithi019.stdout:1/273: dread d1/fe [0,4194304] 0 2024-09-12T22:11:26.793 INFO:tasks.workunit.client.0.smithi019.stdout:3/305: chown d18/c43 232365 1 2024-09-12T22:11:26.794 INFO:tasks.workunit.client.0.smithi019.stdout:0/262: chown d5/d7/de/l13 7 1 2024-09-12T22:11:26.794 INFO:tasks.workunit.client.0.smithi019.stdout:5/317: write d0/d1d/f22 [764245,62543] 0 2024-09-12T22:11:26.797 INFO:tasks.workunit.client.0.smithi019.stdout:4/267: truncate d9/d14/d33/d4e/f53 323167 0 2024-09-12T22:11:26.797 INFO:tasks.workunit.client.0.smithi019.stdout:9/230: creat d12/d1b/d20/d29/f50 x:0 0 0 2024-09-12T22:11:26.797 INFO:tasks.workunit.client.0.smithi019.stdout:7/308: dwrite da/d24/d28/d1c/d32/f5c [0,4194304] 0 2024-09-12T22:11:26.797 INFO:tasks.workunit.client.0.smithi019.stdout:2/207: dwrite d0/d3/d21/d36/f39 [0,4194304] 0 2024-09-12T22:11:26.797 INFO:tasks.workunit.client.0.smithi019.stdout:1/274: rename d1/d4/c5e to d1/c60 0 2024-09-12T22:11:26.798 INFO:tasks.workunit.client.0.smithi019.stdout:1/275: chown d1/d2/d18/f1c 35 1 2024-09-12T22:11:26.799 INFO:tasks.workunit.client.0.smithi019.stdout:9/231: read - d12/d1b/f3a zero size 2024-09-12T22:11:26.801 INFO:tasks.workunit.client.0.smithi019.stdout:6/295: dread d9/dc/d20/f50 [0,4194304] 0 2024-09-12T22:11:26.802 INFO:tasks.workunit.client.0.smithi019.stdout:2/208: mkdir d0/d3/d21/d36/d44 0 2024-09-12T22:11:26.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/263: creat d5/d7/de/f54 x:0 0 0 2024-09-12T22:11:26.802 INFO:tasks.workunit.client.0.smithi019.stdout:5/318: rename d0/f15 to d0/d1d/d4f/d47/d57/f6e 0 2024-09-12T22:11:26.802 INFO:tasks.workunit.client.0.smithi019.stdout:7/309: creat da/d19/d25/d39/f6b x:0 0 0 2024-09-12T22:11:26.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/264: dread - d5/d7/f30 zero size 2024-09-12T22:11:26.802 INFO:tasks.workunit.client.0.smithi019.stdout:9/232: fdatasync d12/d1b/d20/d29/f2d 0 2024-09-12T22:11:26.802 INFO:tasks.workunit.client.0.smithi019.stdout:4/268: rename d9/d17/c23 to d9/d4c/c56 0 2024-09-12T22:11:26.803 INFO:tasks.workunit.client.0.smithi019.stdout:0/265: creat d5/d7/d10/f55 x:0 0 0 2024-09-12T22:11:26.803 INFO:tasks.workunit.client.0.smithi019.stdout:1/276: rename d1/d2/d18/d29/d27/d12 to d1/d4/dc/df/d61 0 2024-09-12T22:11:26.803 INFO:tasks.workunit.client.0.smithi019.stdout:0/266: chown d5/d7/d25/c29 238061 1 2024-09-12T22:11:26.804 INFO:tasks.workunit.client.0.smithi019.stdout:0/267: stat d5/d7/de/l3d 0 2024-09-12T22:11:26.804 INFO:tasks.workunit.client.0.smithi019.stdout:1/277: chown d1/d2/d18/d35/c4a 19466 1 2024-09-12T22:11:26.805 INFO:tasks.workunit.client.0.smithi019.stdout:6/296: truncate d9/dc/d20/f14 2212714 0 2024-09-12T22:11:26.805 INFO:tasks.workunit.client.0.smithi019.stdout:1/278: chown d1/d4/dc/df/d61 10330 1 2024-09-12T22:11:26.805 INFO:tasks.workunit.client.0.smithi019.stdout:2/209: truncate d0/d3/d11/fc 1083567 0 2024-09-12T22:11:26.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/297: mkdir d9/d6b 0 2024-09-12T22:11:26.807 INFO:tasks.workunit.client.0.smithi019.stdout:7/310: dwrite da/d24/d28/d1c/d32/f5c [0,4194304] 0 2024-09-12T22:11:26.807 INFO:tasks.workunit.client.0.smithi019.stdout:1/279: stat d1/d4/dc/df/d53/d55 0 2024-09-12T22:11:26.808 INFO:tasks.workunit.client.0.smithi019.stdout:9/233: dread d12/d1b/d20/d25/f3b [0,4194304] 0 2024-09-12T22:11:26.810 INFO:tasks.workunit.client.0.smithi019.stdout:1/280: unlink d1/d2/d18/d29/d27/c30 0 2024-09-12T22:11:26.811 INFO:tasks.workunit.client.0.smithi019.stdout:9/234: creat d12/d1b/d20/d25/f51 x:0 0 0 2024-09-12T22:11:26.812 INFO:tasks.workunit.client.0.smithi019.stdout:1/281: read d1/d4/dc/f32 [54396,47432] 0 2024-09-12T22:11:26.812 INFO:tasks.workunit.client.0.smithi019.stdout:0/268: dwrite d5/d7/de/f48 [0,4194304] 0 2024-09-12T22:11:26.812 INFO:tasks.workunit.client.0.smithi019.stdout:2/210: write d0/d3/d11/fc [1154626,114277] 0 2024-09-12T22:11:26.814 INFO:tasks.workunit.client.0.smithi019.stdout:9/235: mkdir d12/d1b/d40/d52 0 2024-09-12T22:11:26.814 INFO:tasks.workunit.client.0.smithi019.stdout:0/269: symlink d5/d7/d10/l56 0 2024-09-12T22:11:26.815 INFO:tasks.workunit.client.0.smithi019.stdout:6/298: dwrite d9/d3d/d4f/f62 [0,4194304] 0 2024-09-12T22:11:26.816 INFO:tasks.workunit.client.0.smithi019.stdout:2/211: creat d0/d31/d4/d7/f45 x:0 0 0 2024-09-12T22:11:26.816 INFO:tasks.workunit.client.0.smithi019.stdout:1/282: getdents d1/d37 0 2024-09-12T22:11:26.817 INFO:tasks.workunit.client.0.smithi019.stdout:8/254: dread d5/d16/d19/f31 [0,4194304] 0 2024-09-12T22:11:26.817 INFO:tasks.workunit.client.0.smithi019.stdout:6/299: dread - d9/f57 zero size 2024-09-12T22:11:26.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/283: unlink d1/d4/dc/df/f13 0 2024-09-12T22:11:26.818 INFO:tasks.workunit.client.0.smithi019.stdout:8/255: chown d5/d16/c33 485851 1 2024-09-12T22:11:26.818 INFO:tasks.workunit.client.0.smithi019.stdout:1/284: chown d1 12173030 1 2024-09-12T22:11:26.818 INFO:tasks.workunit.client.0.smithi019.stdout:6/300: mkdir d9/dc/d20/d4b/d6c 0 2024-09-12T22:11:26.819 INFO:tasks.workunit.client.0.smithi019.stdout:9/236: link d12/d1b/d20/d37/f4b d12/d1b/d20/d37/f53 0 2024-09-12T22:11:26.820 INFO:tasks.workunit.client.0.smithi019.stdout:9/237: fsync d12/f47 0 2024-09-12T22:11:26.820 INFO:tasks.workunit.client.0.smithi019.stdout:0/270: dread d5/d7/d10/d26/f3e [0,4194304] 0 2024-09-12T22:11:26.820 INFO:tasks.workunit.client.0.smithi019.stdout:1/285: symlink d1/d4/dc/df/l62 0 2024-09-12T22:11:26.821 INFO:tasks.workunit.client.0.smithi019.stdout:6/301: rmdir d9/dc/d56/d6a 0 2024-09-12T22:11:26.821 INFO:tasks.workunit.client.0.smithi019.stdout:9/238: chown d12/d1b/l3f 723701 1 2024-09-12T22:11:26.822 INFO:tasks.workunit.client.0.smithi019.stdout:2/212: dwrite d0/d3/d11/fc [0,4194304] 0 2024-09-12T22:11:26.823 INFO:tasks.workunit.client.0.smithi019.stdout:1/286: creat d1/d4/dc/df/d2c/f63 x:0 0 0 2024-09-12T22:11:26.823 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:26.822+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:26.823 INFO:tasks.workunit.client.0.smithi019.stdout:2/213: fdatasync d0/d31/d12/d15/f33 0 2024-09-12T22:11:26.825 INFO:tasks.workunit.client.0.smithi019.stdout:8/256: dwrite d5/dc/d26/f30 [0,4194304] 0 2024-09-12T22:11:26.825 INFO:tasks.workunit.client.0.smithi019.stdout:6/302: creat d9/dc/d20/d30/d5b/f6d x:0 0 0 2024-09-12T22:11:26.827 INFO:tasks.workunit.client.0.smithi019.stdout:8/257: write d5/d16/d19/f34 [74583,125746] 0 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:0/271: write d5/d7/d10/d26/d2a/f2b [1086234,114065] 0 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:6/303: write d9/dc/d20/d30/f42 [752415,47280] 0 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:8/258: rmdir d5/dc/d26 39 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:9/239: dwrite f5 [0,4194304] 0 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:8/259: mkdir d5/d53 0 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:3/306: dread fb [0,4194304] 0 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:1/287: dread d1/f11 [0,4194304] 0 2024-09-12T22:11:26.833 INFO:tasks.workunit.client.0.smithi019.stdout:6/304: chown d9/d3d/f3c 2817894 1 2024-09-12T22:11:26.834 INFO:tasks.workunit.client.0.smithi019.stdout:0/272: link d5/d7/d10/c2f d5/d7/d10/d26/d2a/c57 0 2024-09-12T22:11:26.834 INFO:tasks.workunit.client.0.smithi019.stdout:1/288: rmdir d1/d4/dc 39 2024-09-12T22:11:26.834 INFO:tasks.workunit.client.0.smithi019.stdout:3/307: dread - d18/d26/d30/d4e/f52 zero size 2024-09-12T22:11:26.835 INFO:tasks.workunit.client.0.smithi019.stdout:2/214: dwrite d0/d31/d4/d7/f45 [0,4194304] 0 2024-09-12T22:11:26.835 INFO:tasks.workunit.client.0.smithi019.stdout:6/305: write d9/dc/f13 [121205,70711] 0 2024-09-12T22:11:26.837 INFO:tasks.workunit.client.0.smithi019.stdout:2/215: chown d0/d31/d4/f3f 232 1 2024-09-12T22:11:26.837 INFO:tasks.workunit.client.0.smithi019.stdout:3/308: stat d18/d26/d30/d4a/l5b 0 2024-09-12T22:11:26.838 INFO:tasks.workunit.client.0.smithi019.stdout:3/309: dread - d18/f56 zero size 2024-09-12T22:11:26.839 INFO:tasks.workunit.client.0.smithi019.stdout:6/306: getdents d9/dc/d20/d4b/d64 0 2024-09-12T22:11:26.839 INFO:tasks.workunit.client.0.smithi019.stdout:0/273: link d5/d7/d10/c15 d5/d7/d10/c58 0 2024-09-12T22:11:26.839 INFO:tasks.workunit.client.0.smithi019.stdout:9/240: dwrite d12/f47 [0,4194304] 0 2024-09-12T22:11:26.839 INFO:tasks.workunit.client.0.smithi019.stdout:8/260: dread d5/f6 [0,4194304] 0 2024-09-12T22:11:26.840 INFO:tasks.workunit.client.0.smithi019.stdout:9/241: unlink d12/f1e 0 2024-09-12T22:11:26.840 INFO:tasks.workunit.client.0.smithi019.stdout:8/261: write d5/dc/f2e [877042,12907] 0 2024-09-12T22:11:26.841 INFO:tasks.workunit.client.0.smithi019.stdout:0/274: fdatasync d5/f16 0 2024-09-12T22:11:26.841 INFO:tasks.workunit.client.0.smithi019.stdout:3/310: unlink d18/d26/d30/d4a/f53 0 2024-09-12T22:11:26.842 INFO:tasks.workunit.client.0.smithi019.stdout:3/311: fsync f15 0 2024-09-12T22:11:26.842 INFO:tasks.workunit.client.0.smithi019.stdout:9/242: readlink d12/d1b/d20/l3c 0 2024-09-12T22:11:26.842 INFO:tasks.workunit.client.0.smithi019.stdout:8/262: mknod d5/d16/d19/c54 0 2024-09-12T22:11:26.843 INFO:tasks.workunit.client.0.smithi019.stdout:1/289: read d1/d2/d18/d29/f3e [3416,22102] 0 2024-09-12T22:11:26.843 INFO:tasks.workunit.client.0.smithi019.stdout:3/312: unlink d18/f2e 0 2024-09-12T22:11:26.844 INFO:tasks.workunit.client.0.smithi019.stdout:9/243: unlink d12/d1b/d20/d25/f51 0 2024-09-12T22:11:26.845 INFO:tasks.workunit.client.0.smithi019.stdout:1/290: creat d1/d37/f64 x:0 0 0 2024-09-12T22:11:26.845 INFO:tasks.workunit.client.0.smithi019.stdout:8/263: write d5/dc/d26/d43/f4c [378207,42112] 0 2024-09-12T22:11:26.845 INFO:tasks.workunit.client.0.smithi019.stdout:6/307: dwrite d9/f4e [0,4194304] 0 2024-09-12T22:11:26.847 INFO:tasks.workunit.client.0.smithi019.stdout:0/275: dread d5/d7/de/f48 [0,4194304] 0 2024-09-12T22:11:26.847 INFO:tasks.workunit.client.0.smithi019.stdout:6/308: write d9/dc/d20/d4b/f2d [4351253,69754] 0 2024-09-12T22:11:26.847 INFO:tasks.workunit.client.0.smithi019.stdout:9/244: mknod d12/d1b/d20/c54 0 2024-09-12T22:11:26.848 INFO:tasks.workunit.client.0.smithi019.stdout:1/291: creat d1/d37/f65 x:0 0 0 2024-09-12T22:11:26.848 INFO:tasks.workunit.client.0.smithi019.stdout:3/313: getdents d18/d26/d30 0 2024-09-12T22:11:26.849 INFO:tasks.workunit.client.0.smithi019.stdout:6/309: unlink d9/dc/d20/d30/l49 0 2024-09-12T22:11:26.849 INFO:tasks.workunit.client.0.smithi019.stdout:8/264: getdents d5/d16/d19/d32 0 2024-09-12T22:11:26.849 INFO:tasks.workunit.client.0.smithi019.stdout:0/276: chown d5/d7/de/f39 1759034 1 2024-09-12T22:11:26.849 INFO:tasks.workunit.client.0.smithi019.stdout:9/245: readlink d12/d1b/d20/l4e 0 2024-09-12T22:11:26.849 INFO:tasks.workunit.client.0.smithi019.stdout:1/292: chown d1/d4/f1f 1974791 1 2024-09-12T22:11:26.850 INFO:tasks.workunit.client.0.smithi019.stdout:3/314: creat d18/d1d/d35/f5f x:0 0 0 2024-09-12T22:11:26.850 INFO:tasks.workunit.client.0.smithi019.stdout:6/310: creat d9/d3d/f6e x:0 0 0 2024-09-12T22:11:26.850 INFO:tasks.workunit.client.0.smithi019.stdout:9/246: creat d12/f55 x:0 0 0 2024-09-12T22:11:26.850 INFO:tasks.workunit.client.0.smithi019.stdout:8/265: creat d5/d53/f55 x:0 0 0 2024-09-12T22:11:26.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/216: fsync d0/d31/d4/d7/f45 0 2024-09-12T22:11:26.850 INFO:tasks.workunit.client.0.smithi019.stdout:9/247: readlink d12/l13 0 2024-09-12T22:11:26.851 INFO:tasks.workunit.client.0.smithi019.stdout:0/277: creat d5/d7/d25/f59 x:0 0 0 2024-09-12T22:11:26.851 INFO:tasks.workunit.client.0.smithi019.stdout:3/315: unlink d18/d1d/d35/f5f 0 2024-09-12T22:11:26.851 INFO:tasks.workunit.client.0.smithi019.stdout:9/248: readlink d12/d1b/l3f 0 2024-09-12T22:11:26.851 INFO:tasks.workunit.client.0.smithi019.stdout:6/311: rename d9/dc/d56 to d9/d3d/d6f 0 2024-09-12T22:11:26.852 INFO:tasks.workunit.client.0.smithi019.stdout:0/278: mknod d5/c5a 0 2024-09-12T22:11:26.854 INFO:tasks.workunit.client.0.smithi019.stdout:0/279: read d5/f22 [1255341,91652] 0 2024-09-12T22:11:26.854 INFO:tasks.workunit.client.0.smithi019.stdout:4/269: sync 2024-09-12T22:11:26.854 INFO:tasks.workunit.client.0.smithi019.stdout:7/311: sync 2024-09-12T22:11:26.854 INFO:tasks.workunit.client.0.smithi019.stdout:5/319: sync 2024-09-12T22:11:26.857 INFO:tasks.workunit.client.0.smithi019.stdout:5/320: rmdir d0/d26 39 2024-09-12T22:11:26.857 INFO:tasks.workunit.client.0.smithi019.stdout:0/280: dread - d5/d7/d25/f59 zero size 2024-09-12T22:11:26.857 INFO:tasks.workunit.client.0.smithi019.stdout:2/217: dread d0/d3/d11/fc [0,4194304] 0 2024-09-12T22:11:26.857 INFO:tasks.workunit.client.0.smithi019.stdout:6/312: write d9/dc/f15 [2331009,93615] 0 2024-09-12T22:11:26.858 INFO:tasks.workunit.client.0.smithi019.stdout:4/270: mkdir d9/d14/d57 0 2024-09-12T22:11:26.860 INFO:tasks.workunit.client.0.smithi019.stdout:9/249: write d12/d1b/f32 [717993,41298] 0 2024-09-12T22:11:26.860 INFO:tasks.workunit.client.0.smithi019.stdout:1/293: dwrite d1/d4/dc/df/d61/f58 [0,4194304] 0 2024-09-12T22:11:26.860 INFO:tasks.workunit.client.0.smithi019.stdout:8/266: dwrite d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:26.861 INFO:tasks.workunit.client.0.smithi019.stdout:3/316: dwrite f8 [0,4194304] 0 2024-09-12T22:11:26.861 INFO:tasks.workunit.client.0.smithi019.stdout:9/250: read - d12/d1b/d20/d37/f39 zero size 2024-09-12T22:11:26.862 INFO:tasks.workunit.client.0.smithi019.stdout:6/313: truncate d9/dc/f44 693776 0 2024-09-12T22:11:26.863 INFO:tasks.workunit.client.0.smithi019.stdout:2/218: mknod d0/d3/d11/d2e/d34/c46 0 2024-09-12T22:11:26.865 INFO:tasks.workunit.client.0.smithi019.stdout:3/317: unlink l11 0 2024-09-12T22:11:26.865 INFO:tasks.workunit.client.0.smithi019.stdout:6/314: dread - d9/d3d/d4f/f5e zero size 2024-09-12T22:11:26.865 INFO:tasks.workunit.client.0.smithi019.stdout:9/251: write d12/f55 [490698,91232] 0 2024-09-12T22:11:26.865 INFO:tasks.workunit.client.0.smithi019.stdout:4/271: mkdir d9/d58 0 2024-09-12T22:11:26.865 INFO:tasks.workunit.client.0.smithi019.stdout:0/281: symlink d5/d7/l5b 0 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:940 3.0 3:07a02702:::200.0000000c:head [write 3631541~13351 [fadvise_dontneed] in=13351b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.863512+0000", 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.00010648400000000001, 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013582500000000001, 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:26.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.863512+0000", 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.863512+0000", 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.863513+0000", 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.153e-06 2024-09-12T22:11:26.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.863532+0000", 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9363000000000001e-05 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.863543+0000", 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0899e-05 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:26.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.863549+0000", 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5450000000000003e-06 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.863599+0000", 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9886000000000003e-05 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:11:26.869 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:26.870 INFO:tasks.workunit.client.0.smithi019.stdout:2/219: chown d0/d31/d4/f24 12945 1 2024-09-12T22:11:26.870 INFO:tasks.workunit.client.0.smithi019.stdout:5/321: mkdir d0/d26/d6f 0 2024-09-12T22:11:26.870 INFO:tasks.workunit.client.0.smithi019.stdout:7/312: dwrite da/d24/d28/d1c/d32/f3c [0,4194304] 0 2024-09-12T22:11:26.871 INFO:tasks.workunit.client.0.smithi019.stdout:3/318: rename f12 to d18/d26/d30/d4e/f60 0 2024-09-12T22:11:26.871 INFO:tasks.workunit.client.0.smithi019.stdout:9/252: write d12/d1b/d20/d25/f3b [2428904,79961] 0 2024-09-12T22:11:26.871 INFO:tasks.workunit.client.0.smithi019.stdout:0/282: write d5/d7/d25/f59 [437123,83977] 0 2024-09-12T22:11:26.871 INFO:tasks.workunit.client.0.smithi019.stdout:2/220: write d0/d3/d11/f10 [3387208,124808] 0 2024-09-12T22:11:26.872 INFO:tasks.workunit.client.0.smithi019.stdout:5/322: creat d0/d1d/d4f/d47/f70 x:0 0 0 2024-09-12T22:11:26.872 INFO:tasks.workunit.client.0.smithi019.stdout:1/294: dwrite d1/d4/f5a [0,4194304] 0 2024-09-12T22:11:26.872 INFO:tasks.workunit.client.0.smithi019.stdout:7/313: write da/d30/d53/f59 [148472,51324] 0 2024-09-12T22:11:26.874 INFO:tasks.workunit.client.0.smithi019.stdout:8/267: dwrite d5/dc/ff [0,4194304] 0 2024-09-12T22:11:26.874 INFO:tasks.workunit.client.0.smithi019.stdout:9/253: mkdir d12/d1b/d20/d29/d56 0 2024-09-12T22:11:26.875 INFO:tasks.workunit.client.0.smithi019.stdout:1/295: rmdir d1/d4/dc/df/d53 39 2024-09-12T22:11:26.875 INFO:tasks.workunit.client.0.smithi019.stdout:5/323: read - d0/d1d/d4f/f4d zero size 2024-09-12T22:11:26.875 INFO:tasks.workunit.client.0.smithi019.stdout:0/283: creat d5/d7/d25/d46/f5c x:0 0 0 2024-09-12T22:11:26.876 INFO:tasks.workunit.client.0.smithi019.stdout:4/272: dwrite d9/db/fd [4194304,4194304] 0 2024-09-12T22:11:26.877 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:26.877 INFO:tasks.workunit.client.0.smithi019.stdout:8/268: write d5/dc/d17/f2b [1816713,40237] 0 2024-09-12T22:11:26.878 INFO:tasks.workunit.client.0.smithi019.stdout:6/315: dread d9/dc/d20/d4b/f2d [0,4194304] 0 2024-09-12T22:11:26.879 INFO:tasks.workunit.client.0.smithi019.stdout:7/314: rename da/d24/d28/d1c/f29 to da/d19/d25/d39/d51/f6c 0 2024-09-12T22:11:26.879 INFO:tasks.workunit.client.0.smithi019.stdout:9/254: creat d12/d1b/d40/f57 x:0 0 0 2024-09-12T22:11:26.880 INFO:tasks.workunit.client.0.smithi019.stdout:0/284: write d5/d7/d10/f4d [2184113,54179] 0 2024-09-12T22:11:26.883 INFO:tasks.workunit.client.0.smithi019.stdout:8/269: mknod d5/c56 0 2024-09-12T22:11:26.884 INFO:tasks.workunit.client.0.smithi019.stdout:4/273: link d9/l50 d9/d14/d31/l59 0 2024-09-12T22:11:26.884 INFO:tasks.workunit.client.0.smithi019.stdout:6/316: creat d9/dc/d20/d4b/d6c/f70 x:0 0 0 2024-09-12T22:11:26.884 INFO:tasks.workunit.client.0.smithi019.stdout:9/255: rmdir d12/d1b/d20 39 2024-09-12T22:11:26.885 INFO:tasks.workunit.client.0.smithi019.stdout:7/315: symlink da/d19/d25/d39/l6d 0 2024-09-12T22:11:26.886 INFO:tasks.workunit.client.0.smithi019.stdout:8/270: creat d5/dc/d26/d43/f57 x:0 0 0 2024-09-12T22:11:26.886 INFO:tasks.workunit.client.0.smithi019.stdout:0/285: creat d5/d7/d10/d26/d2a/f5d x:0 0 0 2024-09-12T22:11:26.887 INFO:tasks.workunit.client.0.smithi019.stdout:4/274: truncate d9/f27 2678765 0 2024-09-12T22:11:26.889 INFO:tasks.workunit.client.0.smithi019.stdout:6/317: dread d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:26.889 INFO:tasks.workunit.client.0.smithi019.stdout:2/221: dwrite d0/d31/d12/d15/f23 [4194304,4194304] 0 2024-09-12T22:11:26.892 INFO:tasks.workunit.client.0.smithi019.stdout:7/316: write da/d19/d25/d39/f45 [740233,97847] 0 2024-09-12T22:11:26.892 INFO:tasks.workunit.client.0.smithi019.stdout:0/286: truncate d5/d7/de/f31 1296876 0 2024-09-12T22:11:26.893 INFO:tasks.workunit.client.0.smithi019.stdout:4/275: mknod d9/d14/d33/d4e/c5a 0 2024-09-12T22:11:26.893 INFO:tasks.workunit.client.0.smithi019.stdout:1/296: dwrite d1/fe [0,4194304] 0 2024-09-12T22:11:26.894 INFO:tasks.workunit.client.0.smithi019.stdout:4/276: dread - d9/d14/f34 zero size 2024-09-12T22:11:26.896 INFO:tasks.workunit.client.0.smithi019.stdout:2/222: symlink d0/d31/d4/d7/l47 0 2024-09-12T22:11:26.897 INFO:tasks.workunit.client.0.smithi019.stdout:1/297: write d1/d2/d18/f1c [357408,76722] 0 2024-09-12T22:11:26.897 INFO:tasks.workunit.client.0.smithi019.stdout:0/287: creat d5/d7/d10/f5e x:0 0 0 2024-09-12T22:11:26.897 INFO:tasks.workunit.client.0.smithi019.stdout:4/277: rmdir d9/d14/d33 39 2024-09-12T22:11:26.897 INFO:tasks.workunit.client.0.smithi019.stdout:7/317: symlink da/l6e 0 2024-09-12T22:11:26.898 INFO:tasks.workunit.client.0.smithi019.stdout:9/256: dwrite d12/d1b/d20/d25/f4c [0,4194304] 0 2024-09-12T22:11:26.899 INFO:tasks.workunit.client.0.smithi019.stdout:7/318: chown da/d30/f56 96 1 2024-09-12T22:11:26.899 INFO:tasks.workunit.client.0.smithi019.stdout:9/257: read - d12/d1b/f3a zero size 2024-09-12T22:11:26.899 INFO:tasks.workunit.client.0.smithi019.stdout:8/271: dwrite d5/d16/d19/f34 [0,4194304] 0 2024-09-12T22:11:26.900 INFO:tasks.workunit.client.0.smithi019.stdout:8/272: write d5/fd [4879831,36230] 0 2024-09-12T22:11:26.901 INFO:tasks.workunit.client.0.smithi019.stdout:9/258: write d12/d1b/f42 [924007,82468] 0 2024-09-12T22:11:26.901 INFO:tasks.workunit.client.0.smithi019.stdout:6/318: dwrite d9/dc/f36 [0,4194304] 0 2024-09-12T22:11:26.903 INFO:tasks.workunit.client.0.smithi019.stdout:6/319: write d9/d3d/d4f/f5e [122444,122154] 0 2024-09-12T22:11:26.903 INFO:tasks.workunit.client.0.smithi019.stdout:1/298: dread d1/d4/dc/f19 [4194304,4194304] 0 2024-09-12T22:11:26.908 INFO:tasks.workunit.client.0.smithi019.stdout:4/278: symlink d9/d17/l5b 0 2024-09-12T22:11:26.908 INFO:tasks.workunit.client.0.smithi019.stdout:7/319: mknod da/d24/c6f 0 2024-09-12T22:11:26.908 INFO:tasks.workunit.client.0.smithi019.stdout:6/320: dwrite d9/dc/d20/d30/f38 [0,4194304] 0 2024-09-12T22:11:26.908 INFO:tasks.workunit.client.0.smithi019.stdout:1/299: dwrite d1/d4/dc/df/d2c/f49 [0,4194304] 0 2024-09-12T22:11:26.909 INFO:tasks.workunit.client.0.smithi019.stdout:4/279: stat d9/d14/l32 0 2024-09-12T22:11:26.909 INFO:tasks.workunit.client.0.smithi019.stdout:3/319: dread d18/f19 [0,4194304] 0 2024-09-12T22:11:26.909 INFO:tasks.workunit.client.0.smithi019.stdout:8/273: mknod d5/dc/d17/c58 0 2024-09-12T22:11:26.909 INFO:tasks.workunit.client.0.smithi019.stdout:2/223: mknod d0/d3/d21/d36/d44/c48 0 2024-09-12T22:11:26.910 INFO:tasks.workunit.client.0.smithi019.stdout:3/320: stat d18/d1d/d35/f49 0 2024-09-12T22:11:26.910 INFO:tasks.workunit.client.0.smithi019.stdout:9/259: write f4 [1221326,59173] 0 2024-09-12T22:11:26.911 INFO:tasks.workunit.client.0.smithi019.stdout:2/224: readlink d0/d31/d4/l2b 0 2024-09-12T22:11:26.912 INFO:tasks.workunit.client.0.smithi019.stdout:0/288: creat d5/d7/f5f x:0 0 0 2024-09-12T22:11:26.912 INFO:tasks.workunit.client.0.smithi019.stdout:5/324: sync 2024-09-12T22:11:26.913 INFO:tasks.workunit.client.0.smithi019.stdout:9/260: creat d12/d1b/d40/f58 x:0 0 0 2024-09-12T22:11:26.914 INFO:tasks.workunit.client.0.smithi019.stdout:1/300: mkdir d1/d4/dc/df/d53/d66 0 2024-09-12T22:11:26.914 INFO:tasks.workunit.client.0.smithi019.stdout:2/225: creat d0/d3/d11/d2e/f49 x:0 0 0 2024-09-12T22:11:26.916 INFO:tasks.workunit.client.0.smithi019.stdout:9/261: fsync d12/f1a 0 2024-09-12T22:11:26.919 INFO:tasks.workunit.client.0.smithi019.stdout:2/226: write d0/d31/d4/f24 [719916,120209] 0 2024-09-12T22:11:26.920 INFO:tasks.workunit.client.0.smithi019.stdout:0/289: creat d5/d7/d25/d46/f60 x:0 0 0 2024-09-12T22:11:26.921 INFO:tasks.workunit.client.0.smithi019.stdout:3/321: dwrite d18/f28 [0,4194304] 0 2024-09-12T22:11:26.923 INFO:tasks.workunit.client.0.smithi019.stdout:1/301: mknod d1/d2/d18/d35/c67 0 2024-09-12T22:11:26.923 INFO:tasks.workunit.client.0.smithi019.stdout:4/280: dwrite d9/d14/f38 [0,4194304] 0 2024-09-12T22:11:26.924 INFO:tasks.workunit.client.0.smithi019.stdout:1/302: mknod d1/c68 0 2024-09-12T22:11:26.925 INFO:tasks.workunit.client.0.smithi019.stdout:7/320: dwrite da/f47 [0,4194304] 0 2024-09-12T22:11:26.926 INFO:tasks.workunit.client.0.smithi019.stdout:8/274: dwrite d5/d16/d19/d29/f38 [0,4194304] 0 2024-09-12T22:11:26.927 INFO:tasks.workunit.client.0.smithi019.stdout:8/275: fsync d5/dc/f1c 0 2024-09-12T22:11:26.929 INFO:tasks.workunit.client.0.smithi019.stdout:2/227: getdents d0/d3/df/d18 0 2024-09-12T22:11:26.929 INFO:tasks.workunit.client.0.smithi019.stdout:9/262: dwrite d12/d1b/d20/d37/f39 [0,4194304] 0 2024-09-12T22:11:26.931 INFO:tasks.workunit.client.0.smithi019.stdout:7/321: getdents da/d24/d28/d1c 0 2024-09-12T22:11:26.931 INFO:tasks.workunit.client.0.smithi019.stdout:8/276: symlink d5/d16/d19/d29/l59 0 2024-09-12T22:11:26.932 INFO:tasks.workunit.client.0.smithi019.stdout:0/290: dread d5/d7/de/f48 [0,4194304] 0 2024-09-12T22:11:26.932 INFO:tasks.workunit.client.0.smithi019.stdout:7/322: fdatasync da/f11 0 2024-09-12T22:11:26.933 INFO:tasks.workunit.client.0.smithi019.stdout:2/228: truncate d0/d31/d4/f3f 4823602 0 2024-09-12T22:11:26.933 INFO:tasks.workunit.client.0.smithi019.stdout:9/263: getdents d12/d1b/d20/d25 0 2024-09-12T22:11:26.933 INFO:tasks.workunit.client.0.smithi019.stdout:3/322: read f3 [2646075,39952] 0 2024-09-12T22:11:26.933 INFO:tasks.workunit.client.0.smithi019.stdout:0/291: mknod d5/d7/c61 0 2024-09-12T22:11:26.934 INFO:tasks.workunit.client.0.smithi019.stdout:9/264: read - ff zero size 2024-09-12T22:11:26.934 INFO:tasks.workunit.client.0.smithi019.stdout:8/277: link d5/f23 d5/d16/d19/d32/f5a 0 2024-09-12T22:11:26.934 INFO:tasks.workunit.client.0.smithi019.stdout:7/323: mknod da/d24/d28/d1c/c70 0 2024-09-12T22:11:26.935 INFO:tasks.workunit.client.0.smithi019.stdout:8/278: creat d5/d16/d19/f5b x:0 0 0 2024-09-12T22:11:26.936 INFO:tasks.workunit.client.0.smithi019.stdout:2/229: creat d0/d3/df/d18/d2c/d30/d32/f4a x:0 0 0 2024-09-12T22:11:26.937 INFO:tasks.workunit.client.0.smithi019.stdout:1/303: dwrite d1/d2/d18/d29/f3e [0,4194304] 0 2024-09-12T22:11:26.938 INFO:tasks.workunit.client.0.smithi019.stdout:0/292: write d5/d7/f5f [40727,129178] 0 2024-09-12T22:11:26.940 INFO:tasks.workunit.client.0.smithi019.stdout:2/230: readlink d0/d3/d11/d2e/l38 0 2024-09-12T22:11:26.940 INFO:tasks.workunit.client.0.smithi019.stdout:8/279: chown d5/dc/d17/c4a 3318 1 2024-09-12T22:11:26.942 INFO:tasks.workunit.client.0.smithi019.stdout:1/304: creat d1/d4/dc/f69 x:0 0 0 2024-09-12T22:11:26.944 INFO:tasks.workunit.client.0.smithi019.stdout:0/293: symlink d5/d7/d25/d52/l62 0 2024-09-12T22:11:26.944 INFO:tasks.workunit.client.0.smithi019.stdout:3/323: dwrite d18/f1b [0,4194304] 0 2024-09-12T22:11:26.947 INFO:tasks.workunit.client.0.smithi019.stdout:7/324: dwrite da/d30/d53/f64 [0,4194304] 0 2024-09-12T22:11:26.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/305: creat d1/d2/d18/d29/d27/f6a x:0 0 0 2024-09-12T22:11:26.949 INFO:tasks.workunit.client.0.smithi019.stdout:3/324: symlink d18/d26/d30/d4a/l61 0 2024-09-12T22:11:26.949 INFO:tasks.workunit.client.0.smithi019.stdout:7/325: dread - da/d24/d28/d1c/d32/f60 zero size 2024-09-12T22:11:26.950 INFO:tasks.workunit.client.0.smithi019.stdout:0/294: mknod d5/d7/d10/d26/c63 0 2024-09-12T22:11:26.951 INFO:tasks.workunit.client.0.smithi019.stdout:8/280: dwrite d5/dc/d26/d43/f57 [0,4194304] 0 2024-09-12T22:11:26.951 INFO:tasks.workunit.client.0.smithi019.stdout:0/295: stat d5/lf 0 2024-09-12T22:11:26.951 INFO:tasks.workunit.client.0.smithi019.stdout:7/326: fsync da/d24/d28/f15 0 2024-09-12T22:11:26.952 INFO:tasks.workunit.client.0.smithi019.stdout:0/296: readlink d5/d7/l5b 0 2024-09-12T22:11:26.954 INFO:tasks.workunit.client.0.smithi019.stdout:6/321: sync 2024-09-12T22:11:26.955 INFO:tasks.workunit.client.0.smithi019.stdout:2/231: truncate d0/d31/d12/f1b 2632009 0 2024-09-12T22:11:26.955 INFO:tasks.workunit.client.0.smithi019.stdout:0/297: truncate d5/d7/d2c/f47 3600777 0 2024-09-12T22:11:26.956 INFO:tasks.workunit.client.0.smithi019.stdout:1/306: dread d1/d4/dc/f28 [0,4194304] 0 2024-09-12T22:11:26.957 INFO:tasks.workunit.client.0.smithi019.stdout:3/325: dread f8 [0,4194304] 0 2024-09-12T22:11:26.957 INFO:tasks.workunit.client.0.smithi019.stdout:6/322: write d9/dc/f44 [857558,75195] 0 2024-09-12T22:11:26.957 INFO:tasks.workunit.client.0.smithi019.stdout:4/281: dread d9/d17/f1d [0,4194304] 0 2024-09-12T22:11:26.958 INFO:tasks.workunit.client.0.smithi019.stdout:0/298: dread - d5/d7/d2c/d44/f45 zero size 2024-09-12T22:11:26.959 INFO:tasks.workunit.client.0.smithi019.stdout:6/323: mkdir d9/dc/d20/d71 0 2024-09-12T22:11:26.959 INFO:tasks.workunit.client.0.smithi019.stdout:0/299: fsync d5/d7/d10/f55 0 2024-09-12T22:11:26.960 INFO:tasks.workunit.client.0.smithi019.stdout:8/281: dwrite d5/dc/ff [0,4194304] 0 2024-09-12T22:11:26.960 INFO:tasks.workunit.client.0.smithi019.stdout:3/326: creat d18/d26/d30/d4a/f62 x:0 0 0 2024-09-12T22:11:26.960 INFO:tasks.workunit.client.0.smithi019.stdout:4/282: creat d9/d14/d31/f5c x:0 0 0 2024-09-12T22:11:26.960 INFO:tasks.workunit.client.0.smithi019.stdout:2/232: mknod d0/d3/df/d18/d2c/d2d/c4b 0 2024-09-12T22:11:26.961 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:26.960+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:26.964 INFO:tasks.workunit.client.0.smithi019.stdout:8/282: mkdir d5/dc/d26/d5c 0 2024-09-12T22:11:26.964 INFO:tasks.workunit.client.0.smithi019.stdout:3/327: symlink d18/l63 0 2024-09-12T22:11:26.964 INFO:tasks.workunit.client.0.smithi019.stdout:7/327: dread da/d19/f50 [0,4194304] 0 2024-09-12T22:11:26.964 INFO:tasks.workunit.client.0.smithi019.stdout:4/283: rmdir d9/d14/d33 39 2024-09-12T22:11:26.964 INFO:tasks.workunit.client.0.smithi019.stdout:0/300: rmdir d5/d50 0 2024-09-12T22:11:26.964 INFO:tasks.workunit.client.0.smithi019.stdout:5/325: dread d0/d1d/d4f/f2b [0,4194304] 0 2024-09-12T22:11:26.965 INFO:tasks.workunit.client.0.smithi019.stdout:2/233: mkdir d0/d3/df/d18/d2c/d4c 0 2024-09-12T22:11:26.965 INFO:tasks.workunit.client.0.smithi019.stdout:3/328: unlink fb 0 2024-09-12T22:11:26.965 INFO:tasks.workunit.client.0.smithi019.stdout:8/283: read - d5/dc/d26/f41 zero size 2024-09-12T22:11:26.965 INFO:tasks.workunit.client.0.smithi019.stdout:7/328: chown da/d19/d25 181779 1 2024-09-12T22:11:26.965 INFO:tasks.workunit.client.0.smithi019.stdout:4/284: stat d9/d14/d33/d4e/c5a 0 2024-09-12T22:11:26.966 INFO:tasks.workunit.client.0.smithi019.stdout:5/326: symlink d0/d1d/l71 0 2024-09-12T22:11:26.966 INFO:tasks.workunit.client.0.smithi019.stdout:0/301: truncate d5/d7/f11 6352744 0 2024-09-12T22:11:26.966 INFO:tasks.workunit.client.0.smithi019.stdout:2/234: write d0/d3/d21/d36/f39 [4120225,53010] 0 2024-09-12T22:11:26.966 INFO:tasks.workunit.client.0.smithi019.stdout:7/329: creat da/d19/d25/d39/f71 x:0 0 0 2024-09-12T22:11:26.967 INFO:tasks.workunit.client.0.smithi019.stdout:8/284: mknod d5/dc/d26/d4b/c5d 0 2024-09-12T22:11:26.967 INFO:tasks.workunit.client.0.smithi019.stdout:3/329: chown d18/d26/d30/d4e/c55 1892 1 2024-09-12T22:11:26.967 INFO:tasks.workunit.client.0.smithi019.stdout:5/327: mknod d0/d26/d6f/c72 0 2024-09-12T22:11:26.967 INFO:tasks.workunit.client.0.smithi019.stdout:0/302: write d5/d7/f11 [630773,75439] 0 2024-09-12T22:11:26.967 INFO:tasks.workunit.client.0.smithi019.stdout:7/330: chown da/d24/c6f 3202 1 2024-09-12T22:11:26.968 INFO:tasks.workunit.client.0.smithi019.stdout:3/330: mkdir d18/d26/d30/d64 0 2024-09-12T22:11:26.968 INFO:tasks.workunit.client.0.smithi019.stdout:0/303: fsync d5/d7/d25/f4f 0 2024-09-12T22:11:26.969 INFO:tasks.workunit.client.0.smithi019.stdout:5/328: write d0/d4e/d50/f62 [195679,93122] 0 2024-09-12T22:11:26.970 INFO:tasks.workunit.client.0.smithi019.stdout:6/324: write d9/d3d/d6f/f65 [1207750,129806] 0 2024-09-12T22:11:26.971 INFO:tasks.workunit.client.0.smithi019.stdout:5/329: fdatasync d0/d1d/d4f/f4b 0 2024-09-12T22:11:26.971 INFO:tasks.workunit.client.0.smithi019.stdout:8/285: link d5/c3d d5/d16/d19/c5e 0 2024-09-12T22:11:26.971 INFO:tasks.workunit.client.0.smithi019.stdout:0/304: mknod d5/d7/de/c64 0 2024-09-12T22:11:26.973 INFO:tasks.workunit.client.0.smithi019.stdout:3/331: read d18/d1d/f2a [44246,8359] 0 2024-09-12T22:11:26.973 INFO:tasks.workunit.client.0.smithi019.stdout:5/330: rmdir d0/d26/d6f 39 2024-09-12T22:11:26.974 INFO:tasks.workunit.client.0.smithi019.stdout:6/325: dread - d9/d3d/f3c zero size 2024-09-12T22:11:26.975 INFO:tasks.workunit.client.0.smithi019.stdout:8/286: write d5/d53/f55 [67516,85933] 0 2024-09-12T22:11:26.977 INFO:tasks.workunit.client.0.smithi019.stdout:1/307: dwrite d1/d2/d18/d35/f3a [0,4194304] 0 2024-09-12T22:11:26.977 INFO:tasks.workunit.client.0.smithi019.stdout:5/331: creat d0/d26/d3a/f73 x:0 0 0 2024-09-12T22:11:26.978 INFO:tasks.workunit.client.0.smithi019.stdout:4/285: dwrite f7 [0,4194304] 0 2024-09-12T22:11:26.978 INFO:tasks.workunit.client.0.smithi019.stdout:6/326: symlink d9/dc/d20/d30/d5b/l72 0 2024-09-12T22:11:26.979 INFO:tasks.workunit.client.0.smithi019.stdout:3/332: creat d18/d26/d30/d4e/f65 x:0 0 0 2024-09-12T22:11:26.979 INFO:tasks.workunit.client.0.smithi019.stdout:8/287: chown d5/dc/d26/d43 132 1 2024-09-12T22:11:26.980 INFO:tasks.workunit.client.0.smithi019.stdout:7/331: dwrite da/d30/d53/f59 [0,4194304] 0 2024-09-12T22:11:26.980 INFO:tasks.workunit.client.0.smithi019.stdout:0/305: dwrite d5/d7/f11 [0,4194304] 0 2024-09-12T22:11:26.981 INFO:tasks.workunit.client.0.smithi019.stdout:3/333: write d18/d1d/f5d [416506,52103] 0 2024-09-12T22:11:26.981 INFO:tasks.workunit.client.0.smithi019.stdout:6/327: write d9/d3d/d4f/f53 [1895695,74710] 0 2024-09-12T22:11:26.982 INFO:tasks.workunit.client.0.smithi019.stdout:8/288: write d5/f6 [2117264,15868] 0 2024-09-12T22:11:26.983 INFO:tasks.workunit.client.0.smithi019.stdout:1/308: creat d1/d4/dc/df/d53/d55/f6b x:0 0 0 2024-09-12T22:11:26.983 INFO:tasks.workunit.client.0.smithi019.stdout:7/332: symlink da/d19/d25/d39/l72 0 2024-09-12T22:11:26.984 INFO:tasks.workunit.client.0.smithi019.stdout:3/334: write d18/d26/d30/d4e/f59 [351832,33988] 0 2024-09-12T22:11:26.984 INFO:tasks.workunit.client.0.smithi019.stdout:1/309: readlink d1/d4/dc/df/l21 0 2024-09-12T22:11:26.985 INFO:tasks.workunit.client.0.smithi019.stdout:4/286: rename d9/l44 to d9/d14/d31/d3f/l5d 0 2024-09-12T22:11:26.985 INFO:tasks.workunit.client.0.smithi019.stdout:8/289: creat d5/dc/f5f x:0 0 0 2024-09-12T22:11:26.985 INFO:tasks.workunit.client.0.smithi019.stdout:1/310: symlink d1/d4/l6c 0 2024-09-12T22:11:26.986 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:26.986 INFO:tasks.workunit.client.0.smithi019.stdout:3/335: truncate d18/d26/d30/d4e/f65 437628 0 2024-09-12T22:11:26.986 INFO:tasks.workunit.client.0.smithi019.stdout:8/290: chown d5/f42 252088319 1 2024-09-12T22:11:26.987 INFO:tasks.workunit.client.0.smithi019.stdout:1/311: stat d1/d4/f31 0 2024-09-12T22:11:26.988 INFO:tasks.workunit.client.0.smithi019.stdout:7/333: dwrite da/d30/f6a [0,4194304] 0 2024-09-12T22:11:26.990 INFO:tasks.workunit.client.0.smithi019.stdout:7/334: mkdir da/d24/d28/d1c/d32/d5e/d73 0 2024-09-12T22:11:26.991 INFO:tasks.workunit.client.0.smithi019.stdout:1/312: dread d1/d4/dc/df/d61/f58 [0,4194304] 0 2024-09-12T22:11:26.991 INFO:tasks.workunit.client.0.smithi019.stdout:4/287: dwrite d9/d14/d31/d3f/f42 [0,4194304] 0 2024-09-12T22:11:26.996 INFO:tasks.workunit.client.0.smithi019.stdout:7/335: dwrite da/d24/d28/d1c/f20 [0,4194304] 0 2024-09-12T22:11:26.997 INFO:tasks.workunit.client.0.smithi019.stdout:1/313: dwrite d1/d2/d18/d29/d51/f5c [0,4194304] 0 2024-09-12T22:11:26.998 INFO:tasks.workunit.client.0.smithi019.stdout:7/336: rename da/d30/f56 to da/d24/f74 0 2024-09-12T22:11:26.998 INFO:tasks.workunit.client.0.smithi019.stdout:1/314: mknod d1/d4/dc/df/d2c/d5d/c6d 0 2024-09-12T22:11:26.999 INFO:tasks.workunit.client.0.smithi019.stdout:7/337: creat da/d19/d25/d39/d51/f75 x:0 0 0 2024-09-12T22:11:26.999 INFO:tasks.workunit.client.0.smithi019.stdout:1/315: chown d1/d4/dc/df/d61/f1b 24 1 2024-09-12T22:11:27.000 INFO:tasks.workunit.client.0.smithi019.stdout:1/316: chown d1/l3c 196111 1 2024-09-12T22:11:27.000 INFO:tasks.workunit.client.0.smithi019.stdout:1/317: chown d1/d2/d18/d35/c67 2 1 2024-09-12T22:11:27.001 INFO:tasks.workunit.client.0.smithi019.stdout:1/318: mkdir d1/d4/d6e 0 2024-09-12T22:11:27.003 INFO:tasks.workunit.client.0.smithi019.stdout:1/319: link d1/d2/d18/d29/d27/c40 d1/c6f 0 2024-09-12T22:11:27.003 INFO:tasks.workunit.client.0.smithi019.stdout:1/320: write d1/d4/dc/df/d61/f44 [2393333,101738] 0 2024-09-12T22:11:27.003 INFO:tasks.workunit.client.0.smithi019.stdout:1/321: dread - d1/d37/f4c zero size 2024-09-12T22:11:27.003 INFO:tasks.workunit.client.0.smithi019.stdout:1/322: mkdir d1/d2/d18/d70 0 2024-09-12T22:11:27.004 INFO:tasks.workunit.client.0.smithi019.stdout:1/323: symlink d1/d4/d6e/l71 0 2024-09-12T22:11:27.009 INFO:tasks.workunit.client.0.smithi019.stdout:1/324: dwrite d1/d37/f65 [0,4194304] 0 2024-09-12T22:11:27.009 INFO:tasks.workunit.client.0.smithi019.stdout:0/306: dread d5/d7/d2c/f47 [0,4194304] 0 2024-09-12T22:11:27.010 INFO:tasks.workunit.client.0.smithi019.stdout:1/325: symlink d1/d4/d6e/l72 0 2024-09-12T22:11:27.011 INFO:tasks.workunit.client.0.smithi019.stdout:1/326: mknod d1/c73 0 2024-09-12T22:11:27.011 INFO:tasks.workunit.client.0.smithi019.stdout:0/307: write d5/d7/d10/d26/d2a/f37 [3652304,114329] 0 2024-09-12T22:11:27.011 INFO:tasks.workunit.client.0.smithi019.stdout:0/308: stat d5/c5a 0 2024-09-12T22:11:27.011 INFO:tasks.workunit.client.0.smithi019.stdout:1/327: write d1/d2/d18/d29/d27/f23 [1383181,76744] 0 2024-09-12T22:11:27.013 INFO:tasks.workunit.client.0.smithi019.stdout:9/265: dread d12/f1f [0,4194304] 0 2024-09-12T22:11:27.013 INFO:tasks.workunit.client.0.smithi019.stdout:1/328: creat d1/d4/dc/df/f74 x:0 0 0 2024-09-12T22:11:27.013 INFO:tasks.workunit.client.0.smithi019.stdout:9/266: write d12/d1b/d20/d25/f49 [209059,63358] 0 2024-09-12T22:11:27.014 INFO:tasks.workunit.client.0.smithi019.stdout:1/329: creat d1/d2/d18/d59/f75 x:0 0 0 2024-09-12T22:11:27.014 INFO:tasks.workunit.client.0.smithi019.stdout:9/267: mkdir d12/d1b/d20/d59 0 2024-09-12T22:11:27.015 INFO:tasks.workunit.client.0.smithi019.stdout:0/309: dwrite d5/d7/f11 [4194304,4194304] 0 2024-09-12T22:11:27.015 INFO:tasks.workunit.client.0.smithi019.stdout:0/310: truncate d5/f41 1289173 0 2024-09-12T22:11:27.018 INFO:tasks.workunit.client.0.smithi019.stdout:9/268: symlink d12/d1b/d20/d37/l5a 0 2024-09-12T22:11:27.019 INFO:tasks.workunit.client.0.smithi019.stdout:9/269: mkdir d12/d1b/d20/d59/d5b 0 2024-09-12T22:11:27.021 INFO:tasks.workunit.client.0.smithi019.stdout:9/270: creat d12/d1b/d20/f5c x:0 0 0 2024-09-12T22:11:27.022 INFO:tasks.workunit.client.0.smithi019.stdout:9/271: creat d12/d1b/d20/d25/f5d x:0 0 0 2024-09-12T22:11:27.022 INFO:tasks.workunit.client.0.smithi019.stdout:5/332: sync 2024-09-12T22:11:27.022 INFO:tasks.workunit.client.0.smithi019.stdout:7/338: sync 2024-09-12T22:11:27.022 INFO:tasks.workunit.client.0.smithi019.stdout:6/328: truncate f4 3403471 0 2024-09-12T22:11:27.023 INFO:tasks.workunit.client.0.smithi019.stdout:9/272: creat d12/d1b/d40/f5e x:0 0 0 2024-09-12T22:11:27.023 INFO:tasks.workunit.client.0.smithi019.stdout:5/333: read - d0/d24/d58/f66 zero size 2024-09-12T22:11:27.023 INFO:tasks.workunit.client.0.smithi019.stdout:7/339: creat da/f76 x:0 0 0 2024-09-12T22:11:27.023 INFO:tasks.workunit.client.0.smithi019.stdout:6/329: creat d9/d3d/f73 x:0 0 0 2024-09-12T22:11:27.024 INFO:tasks.workunit.client.0.smithi019.stdout:9/273: unlink fb 0 2024-09-12T22:11:27.024 INFO:tasks.workunit.client.0.smithi019.stdout:7/340: dread - da/d19/f62 zero size 2024-09-12T22:11:27.024 INFO:tasks.workunit.client.0.smithi019.stdout:3/336: write d18/d1d/f2b [1216743,100674] 0 2024-09-12T22:11:27.024 INFO:tasks.workunit.client.0.smithi019.stdout:5/334: creat d0/d26/d6f/f74 x:0 0 0 2024-09-12T22:11:27.024 INFO:tasks.workunit.client.0.smithi019.stdout:6/330: chown d9/d3d/d4f/f62 111336 1 2024-09-12T22:11:27.025 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.023+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.025 INFO:tasks.workunit.client.0.smithi019.stdout:9/274: symlink d12/d1b/d40/d52/l5f 0 2024-09-12T22:11:27.026 INFO:tasks.workunit.client.0.smithi019.stdout:9/275: dread - d12/d1b/d40/f58 zero size 2024-09-12T22:11:27.028 INFO:tasks.workunit.client.0.smithi019.stdout:9/276: mkdir d12/d1b/d20/d29/d56/d60 0 2024-09-12T22:11:27.030 INFO:tasks.workunit.client.0.smithi019.stdout:9/277: creat d12/d48/f61 x:0 0 0 2024-09-12T22:11:27.030 INFO:tasks.workunit.client.0.smithi019.stdout:6/331: dwrite d9/d3d/d4f/f5e [0,4194304] 0 2024-09-12T22:11:27.031 INFO:tasks.workunit.client.0.smithi019.stdout:5/335: dwrite d0/d1d/d3d/f3e [0,4194304] 0 2024-09-12T22:11:27.031 INFO:tasks.workunit.client.0.smithi019.stdout:9/278: write d12/d1b/d20/d37/f39 [3677249,49546] 0 2024-09-12T22:11:27.032 INFO:tasks.workunit.client.0.smithi019.stdout:5/336: truncate d0/d1d/f33 439705 0 2024-09-12T22:11:27.032 INFO:tasks.workunit.client.0.smithi019.stdout:6/332: truncate d9/dc/d20/d30/d5b/f6d 448732 0 2024-09-12T22:11:27.033 INFO:tasks.workunit.client.0.smithi019.stdout:4/288: dwrite d9/f27 [0,4194304] 0 2024-09-12T22:11:27.036 INFO:tasks.workunit.client.0.smithi019.stdout:0/311: write d5/d7/d2c/f47 [2331376,78483] 0 2024-09-12T22:11:27.036 INFO:tasks.workunit.client.0.smithi019.stdout:3/337: truncate d18/f28 2911365 0 2024-09-12T22:11:27.036 INFO:tasks.workunit.client.0.smithi019.stdout:6/333: creat d9/dc/f74 x:0 0 0 2024-09-12T22:11:27.036 INFO:tasks.workunit.client.0.smithi019.stdout:4/289: mkdir d9/d14/d57/d5e 0 2024-09-12T22:11:27.037 INFO:tasks.workunit.client.0.smithi019.stdout:3/338: readlink d18/d1d/l22 0 2024-09-12T22:11:27.038 INFO:tasks.workunit.client.0.smithi019.stdout:6/334: fdatasync d9/dc/f36 0 2024-09-12T22:11:27.041 INFO:tasks.workunit.client.0.smithi019.stdout:4/290: write d9/d14/d31/d3f/f48 [623160,66631] 0 2024-09-12T22:11:27.041 INFO:tasks.workunit.client.0.smithi019.stdout:3/339: symlink d18/d26/d30/l66 0 2024-09-12T22:11:27.041 INFO:tasks.workunit.client.0.smithi019.stdout:5/337: dwrite d0/f17 [0,4194304] 0 2024-09-12T22:11:27.041 INFO:tasks.workunit.client.0.smithi019.stdout:3/340: chown d18/c40 238204111 1 2024-09-12T22:11:27.042 INFO:tasks.workunit.client.0.smithi019.stdout:5/338: rmdir d0/d26/d3a 39 2024-09-12T22:11:27.042 INFO:tasks.workunit.client.0.smithi019.stdout:4/291: chown d9/d14/d31/d3f/f48 87977 1 2024-09-12T22:11:27.044 INFO:tasks.workunit.client.0.smithi019.stdout:9/279: dwrite f0 [0,4194304] 0 2024-09-12T22:11:27.044 INFO:tasks.workunit.client.0.smithi019.stdout:0/312: dwrite d5/f22 [4194304,4194304] 0 2024-09-12T22:11:27.044 INFO:tasks.workunit.client.0.smithi019.stdout:4/292: mkdir d9/d14/d57/d5f 0 2024-09-12T22:11:27.045 INFO:tasks.workunit.client.0.smithi019.stdout:0/313: stat d5/c19 0 2024-09-12T22:11:27.045 INFO:tasks.workunit.client.0.smithi019.stdout:4/293: rename d9/d14 to d9/d14/d57/d5f/d60 22 2024-09-12T22:11:27.046 INFO:tasks.workunit.client.0.smithi019.stdout:9/280: mkdir d12/d1b/d40/d52/d62 0 2024-09-12T22:11:27.046 INFO:tasks.workunit.client.0.smithi019.stdout:4/294: stat d9/d14/d33/l55 0 2024-09-12T22:11:27.047 INFO:tasks.workunit.client.0.smithi019.stdout:0/314: rename d5/d7/de/f53 to d5/d7/d10/d26/d2a/f65 0 2024-09-12T22:11:27.050 INFO:tasks.workunit.client.0.smithi019.stdout:6/335: truncate d9/dc/d20/d30/f37 486981 0 2024-09-12T22:11:27.050 INFO:tasks.workunit.client.0.smithi019.stdout:9/281: mknod d12/d1b/d20/d29/c63 0 2024-09-12T22:11:27.050 INFO:tasks.workunit.client.0.smithi019.stdout:4/295: symlink d9/l61 0 2024-09-12T22:11:27.050 INFO:tasks.workunit.client.0.smithi019.stdout:5/339: truncate d0/d1d/f31 2496146 0 2024-09-12T22:11:27.050 INFO:tasks.workunit.client.0.smithi019.stdout:0/315: mknod d5/d7/d10/d26/c66 0 2024-09-12T22:11:27.052 INFO:tasks.workunit.client.0.smithi019.stdout:9/282: chown d12/d1b/d20/f2a 5673683 1 2024-09-12T22:11:27.053 INFO:tasks.workunit.client.0.smithi019.stdout:6/336: getdents d9 0 2024-09-12T22:11:27.053 INFO:tasks.workunit.client.0.smithi019.stdout:5/340: unlink d0/fe 0 2024-09-12T22:11:27.054 INFO:tasks.workunit.client.0.smithi019.stdout:4/296: truncate d9/d14/d31/d3f/f48 1608542 0 2024-09-12T22:11:27.054 INFO:tasks.workunit.client.0.smithi019.stdout:9/283: mkdir d12/d1b/d20/d64 0 2024-09-12T22:11:27.055 INFO:tasks.workunit.client.0.smithi019.stdout:6/337: write d9/dc/f23 [923607,58348] 0 2024-09-12T22:11:27.055 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:27.056 INFO:tasks.workunit.client.0.smithi019.stdout:4/297: symlink d9/d14/d57/l62 0 2024-09-12T22:11:27.056 INFO:tasks.workunit.client.0.smithi019.stdout:6/338: chown l7 932712125 1 2024-09-12T22:11:27.057 INFO:tasks.workunit.client.0.smithi019.stdout:9/284: creat d12/d1b/d40/d52/f65 x:0 0 0 2024-09-12T22:11:27.057 INFO:tasks.workunit.client.0.smithi019.stdout:4/298: symlink d9/db/d2b/l63 0 2024-09-12T22:11:27.058 INFO:tasks.workunit.client.0.smithi019.stdout:0/316: dwrite d5/f1e [0,4194304] 0 2024-09-12T22:11:27.060 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:27.060 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:27.061 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:27.061 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:27.061 INFO:tasks.workunit.client.0.smithi019.stdout:9/285: read d12/d1b/f1c [535507,52548] 0 2024-09-12T22:11:27.065 INFO:tasks.workunit.client.0.smithi019.stdout:5/341: dwrite d0/d26/d3a/f68 [0,4194304] 0 2024-09-12T22:11:27.065 INFO:tasks.workunit.client.0.smithi019.stdout:2/235: dread d0/d31/d12/f1b [0,4194304] 0 2024-09-12T22:11:27.066 INFO:tasks.workunit.client.0.smithi019.stdout:1/330: sync 2024-09-12T22:11:27.066 INFO:tasks.workunit.client.0.smithi019.stdout:8/291: sync 2024-09-12T22:11:27.066 INFO:tasks.workunit.client.0.smithi019.stdout:5/342: readlink d0/d24/l67 0 2024-09-12T22:11:27.067 INFO:tasks.workunit.client.0.smithi019.stdout:6/339: dread d9/dc/f44 [0,4194304] 0 2024-09-12T22:11:27.067 INFO:tasks.workunit.client.0.smithi019.stdout:7/341: dread da/f11 [0,4194304] 0 2024-09-12T22:11:27.068 INFO:tasks.workunit.client.0.smithi019.stdout:5/343: dread - d0/d1d/d4f/f4d zero size 2024-09-12T22:11:27.069 INFO:tasks.workunit.client.0.smithi019.stdout:4/299: dwrite d9/d14/f38 [4194304,4194304] 0 2024-09-12T22:11:27.069 INFO:tasks.workunit.client.0.smithi019.stdout:9/286: dread d12/d1b/d20/d37/f39 [0,4194304] 0 2024-09-12T22:11:27.070 INFO:tasks.workunit.client.0.smithi019.stdout:4/300: fsync d9/fc 0 2024-09-12T22:11:27.070 INFO:tasks.workunit.client.0.smithi019.stdout:5/344: write d0/d1d/d3d/f69 [848895,9655] 0 2024-09-12T22:11:27.070 INFO:tasks.workunit.client.0.smithi019.stdout:7/342: write da/d24/d28/d1c/d32/f3c [891006,115734] 0 2024-09-12T22:11:27.071 INFO:tasks.workunit.client.0.smithi019.stdout:8/292: mkdir d5/dc/d26/d5c/d60 0 2024-09-12T22:11:27.072 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:27.073 INFO:tasks.workunit.client.0.smithi019.stdout:2/236: getdents d0/d3/d21/d36/d44 0 2024-09-12T22:11:27.073 INFO:tasks.workunit.client.0.smithi019.stdout:1/331: getdents d1/d2/d18/d59 0 2024-09-12T22:11:27.073 INFO:tasks.workunit.client.0.smithi019.stdout:4/301: mknod d9/d14/d57/d5e/c64 0 2024-09-12T22:11:27.073 INFO:tasks.workunit.client.0.smithi019.stdout:7/343: getdents da/d30/d68 0 2024-09-12T22:11:27.074 INFO:tasks.workunit.client.0.smithi019.stdout:8/293: getdents d5/dc/d26/d43 0 2024-09-12T22:11:27.074 INFO:tasks.workunit.client.0.smithi019.stdout:7/344: fdatasync da/d19/d25/d39/f49 0 2024-09-12T22:11:27.074 INFO:tasks.workunit.client.0.smithi019.stdout:1/332: write d1/d2/d18/d29/d27/f39 [6824463,75560] 0 2024-09-12T22:11:27.074 INFO:tasks.workunit.client.0.smithi019.stdout:4/302: mkdir d9/d14/d31/d65 0 2024-09-12T22:11:27.075 INFO:tasks.workunit.client.0.smithi019.stdout:8/294: mknod d5/dc/c61 0 2024-09-12T22:11:27.076 INFO:tasks.workunit.client.0.smithi019.stdout:4/303: chown d9/d4c/c56 437175 1 2024-09-12T22:11:27.076 INFO:tasks.workunit.client.0.smithi019.stdout:8/295: dread - d5/dc/d26/f41 zero size 2024-09-12T22:11:27.078 INFO:tasks.workunit.client.0.smithi019.stdout:1/333: link d1/l3c d1/d4/dc/df/d53/l76 0 2024-09-12T22:11:27.078 INFO:tasks.workunit.client.0.smithi019.stdout:5/345: dwrite d0/d1d/d4f/d47/f5d [0,4194304] 0 2024-09-12T22:11:27.078 INFO:tasks.workunit.client.0.smithi019.stdout:3/341: dread d18/f34 [0,4194304] 0 2024-09-12T22:11:27.079 INFO:tasks.workunit.client.0.smithi019.stdout:8/296: unlink d5/d16/d19/d29/l59 0 2024-09-12T22:11:27.080 INFO:tasks.workunit.client.0.smithi019.stdout:8/297: readlink d5/d16/d19/d29/l46 0 2024-09-12T22:11:27.080 INFO:tasks.workunit.client.0.smithi019.stdout:1/334: mkdir d1/d4/dc/d77 0 2024-09-12T22:11:27.080 INFO:tasks.workunit.client.0.smithi019.stdout:5/346: mknod d0/d26/d5f/c75 0 2024-09-12T22:11:27.080 INFO:tasks.workunit.client.0.smithi019.stdout:3/342: creat d18/d26/d30/f67 x:0 0 0 2024-09-12T22:11:27.081 INFO:tasks.workunit.client.0.smithi019.stdout:9/287: truncate d12/d1b/d20/d25/f4c 1843463 0 2024-09-12T22:11:27.081 INFO:tasks.workunit.client.0.smithi019.stdout:4/304: dread d9/d14/d31/d3f/f42 [0,4194304] 0 2024-09-12T22:11:27.081 INFO:tasks.workunit.client.0.smithi019.stdout:1/335: unlink d1/d4/f1f 0 2024-09-12T22:11:27.082 INFO:tasks.workunit.client.0.smithi019.stdout:5/347: write d0/f29 [156442,289] 0 2024-09-12T22:11:27.082 INFO:tasks.workunit.client.0.smithi019.stdout:8/298: write d5/dc/d26/f3a [4032768,115762] 0 2024-09-12T22:11:27.082 INFO:tasks.workunit.client.0.smithi019.stdout:9/288: chown fe 108275 1 2024-09-12T22:11:27.083 INFO:tasks.workunit.client.0.smithi019.stdout:5/348: readlink d0/lc 0 2024-09-12T22:11:27.083 INFO:tasks.workunit.client.0.smithi019.stdout:3/343: creat d18/d26/d30/d4a/f68 x:0 0 0 2024-09-12T22:11:27.083 INFO:tasks.workunit.client.0.smithi019.stdout:9/289: readlink d12/l18 0 2024-09-12T22:11:27.083 INFO:tasks.workunit.client.0.smithi019.stdout:1/336: chown d1/d2/d18/d29/d27/f23 15010075 1 2024-09-12T22:11:27.084 INFO:tasks.workunit.client.0.smithi019.stdout:2/237: dread d0/d31/d12/d15/f33 [0,4194304] 0 2024-09-12T22:11:27.084 INFO:tasks.workunit.client.0.smithi019.stdout:5/349: mkdir d0/d4e/d50/d76 0 2024-09-12T22:11:27.084 INFO:tasks.workunit.client.0.smithi019.stdout:4/305: rename d9/d14/d31/d65 to d9/d14/d33/d4e/d66 0 2024-09-12T22:11:27.086 INFO:tasks.workunit.client.0.smithi019.stdout:9/290: symlink d12/d1b/l66 0 2024-09-12T22:11:27.086 INFO:tasks.workunit.client.0.smithi019.stdout:4/306: rmdir d9/d17 39 2024-09-12T22:11:27.086 INFO:tasks.workunit.client.0.smithi019.stdout:5/350: rmdir d0/d1d/d3d 39 2024-09-12T22:11:27.086 INFO:tasks.workunit.client.0.smithi019.stdout:1/337: write d1/d4/dc/df/d61/f52 [262972,125187] 0 2024-09-12T22:11:27.086 INFO:tasks.workunit.client.0.smithi019.stdout:2/238: link d0/ce d0/d3/df/c4d 0 2024-09-12T22:11:27.090 INFO:tasks.workunit.client.0.smithi019.stdout:1/338: fdatasync d1/d2/d18/d35/f3a 0 2024-09-12T22:11:27.090 INFO:tasks.workunit.client.0.smithi019.stdout:2/239: symlink d0/d31/d12/d3b/l4e 0 2024-09-12T22:11:27.091 INFO:tasks.workunit.client.0.smithi019.stdout:9/291: link f6 d12/d1b/d20/d29/d56/d60/f67 0 2024-09-12T22:11:27.092 INFO:tasks.workunit.client.0.smithi019.stdout:0/317: dread d5/d7/f4a [0,4194304] 0 2024-09-12T22:11:27.093 INFO:tasks.workunit.client.0.smithi019.stdout:8/299: dwrite d5/dc/d26/d43/f4c [0,4194304] 0 2024-09-12T22:11:27.093 INFO:tasks.workunit.client.0.smithi019.stdout:6/340: write d9/dc/d20/d30/f37 [591257,74182] 0 2024-09-12T22:11:27.095 INFO:tasks.workunit.client.0.smithi019.stdout:3/344: dwrite d18/f3e [0,4194304] 0 2024-09-12T22:11:27.095 INFO:tasks.workunit.client.0.smithi019.stdout:6/341: stat d9/dc/c18 0 2024-09-12T22:11:27.095 INFO:tasks.workunit.client.0.smithi019.stdout:9/292: chown d12/l13 711731 1 2024-09-12T22:11:27.095 INFO:tasks.workunit.client.0.smithi019.stdout:9/293: fdatasync f9 0 2024-09-12T22:11:27.096 INFO:tasks.workunit.client.0.smithi019.stdout:0/318: write d5/d7/d10/f5e [377768,1384] 0 2024-09-12T22:11:27.098 INFO:tasks.workunit.client.0.smithi019.stdout:3/345: write f9 [4404173,94890] 0 2024-09-12T22:11:27.098 INFO:tasks.workunit.client.0.smithi019.stdout:2/240: read d0/d31/d4/f3f [481934,122390] 0 2024-09-12T22:11:27.098 INFO:tasks.workunit.client.0.smithi019.stdout:4/307: dwrite d9/d14/d31/f5c [0,4194304] 0 2024-09-12T22:11:27.099 INFO:tasks.workunit.client.0.smithi019.stdout:2/241: stat d0/d31/d4/d7/l47 0 2024-09-12T22:11:27.102 INFO:tasks.workunit.client.0.smithi019.stdout:0/319: creat d5/d7/d10/f67 x:0 0 0 2024-09-12T22:11:27.102 INFO:tasks.workunit.client.0.smithi019.stdout:8/300: rename d5/dc/d26/d43/c52 to d5/c62 0 2024-09-12T22:11:27.103 INFO:tasks.workunit.client.0.smithi019.stdout:4/308: unlink d9/d14/d31/l40 0 2024-09-12T22:11:27.103 INFO:tasks.workunit.client.0.smithi019.stdout:3/346: dread - d18/d26/f36 zero size 2024-09-12T22:11:27.103 INFO:tasks.workunit.client.0.smithi019.stdout:1/339: dread d1/d4/f31 [0,4194304] 0 2024-09-12T22:11:27.104 INFO:tasks.workunit.client.0.smithi019.stdout:9/294: link d12/d1b/d40/f5e d12/d1b/d20/d29/d56/d60/f68 0 2024-09-12T22:11:27.104 INFO:tasks.workunit.client.0.smithi019.stdout:6/342: dwrite d9/d3d/d4f/f62 [4194304,4194304] 0 2024-09-12T22:11:27.105 INFO:tasks.workunit.client.0.smithi019.stdout:7/345: dread da/d24/d28/d1c/d32/f5c [0,4194304] 0 2024-09-12T22:11:27.106 INFO:tasks.workunit.client.0.smithi019.stdout:4/309: mknod d9/c67 0 2024-09-12T22:11:27.106 INFO:tasks.workunit.client.0.smithi019.stdout:0/320: creat d5/d7/d10/f68 x:0 0 0 2024-09-12T22:11:27.107 INFO:tasks.workunit.client.0.smithi019.stdout:6/343: rename d9/d3d/f73 to d9/dc/d20/d4b/f75 0 2024-09-12T22:11:27.107 INFO:tasks.workunit.client.0.smithi019.stdout:1/340: symlink d1/d4/dc/df/l78 0 2024-09-12T22:11:27.107 INFO:tasks.workunit.client.0.smithi019.stdout:8/301: rmdir d5/dc/d26/d5c/d60 0 2024-09-12T22:11:27.108 INFO:tasks.workunit.client.0.smithi019.stdout:3/347: getdents d18 0 2024-09-12T22:11:27.108 INFO:tasks.workunit.client.0.smithi019.stdout:2/242: dwrite d0/d31/d4/f22 [4194304,4194304] 0 2024-09-12T22:11:27.109 INFO:tasks.workunit.client.0.smithi019.stdout:4/310: creat d9/d58/f68 x:0 0 0 2024-09-12T22:11:27.109 INFO:tasks.workunit.client.0.smithi019.stdout:0/321: rename d5/c28 to d5/d7/d25/d52/c69 0 2024-09-12T22:11:27.109 INFO:tasks.workunit.client.0.smithi019.stdout:6/344: creat d9/d3d/d4f/d59/f76 x:0 0 0 2024-09-12T22:11:27.110 INFO:tasks.workunit.client.0.smithi019.stdout:0/322: dread - d5/d7/de/f54 zero size 2024-09-12T22:11:27.111 INFO:tasks.workunit.client.0.smithi019.stdout:6/345: read - d9/d3d/f6e zero size 2024-09-12T22:11:27.111 INFO:tasks.workunit.client.0.smithi019.stdout:1/341: rename d1/d4/dc/df/d61/f58 to d1/d4/dc/df/d53/d55/d56/f79 0 2024-09-12T22:11:27.113 INFO:tasks.workunit.client.0.smithi019.stdout:9/295: dread d12/f55 [0,4194304] 0 2024-09-12T22:11:27.114 INFO:tasks.workunit.client.0.smithi019.stdout:1/342: creat d1/d2/d18/d70/f7a x:0 0 0 2024-09-12T22:11:27.116 INFO:tasks.workunit.client.0.smithi019.stdout:5/351: dread d0/d1d/d3d/f48 [0,4194304] 0 2024-09-12T22:11:27.116 INFO:tasks.workunit.client.0.smithi019.stdout:8/302: dwrite d5/d16/d19/d29/f4d [4194304,4194304] 0 2024-09-12T22:11:27.116 INFO:tasks.workunit.client.0.smithi019.stdout:3/348: dwrite d18/d26/d30/d4e/f59 [0,4194304] 0 2024-09-12T22:11:27.116 INFO:tasks.workunit.client.0.smithi019.stdout:9/296: write d12/d1b/d40/d52/f65 [56900,45673] 0 2024-09-12T22:11:27.117 INFO:tasks.workunit.client.0.smithi019.stdout:5/352: write d0/d26/f2d [564079,95800] 0 2024-09-12T22:11:27.117 INFO:tasks.workunit.client.0.smithi019.stdout:8/303: write d5/dc/d17/f2b [1438459,15829] 0 2024-09-12T22:11:27.118 INFO:tasks.workunit.client.0.smithi019.stdout:9/297: truncate d12/d1b/f32 2120976 0 2024-09-12T22:11:27.119 INFO:tasks.workunit.client.0.smithi019.stdout:7/346: truncate da/d19/f46 1701939 0 2024-09-12T22:11:27.120 INFO:tasks.workunit.client.0.smithi019.stdout:1/343: truncate d1/d2/d18/d35/f3a 7505691 0 2024-09-12T22:11:27.120 INFO:tasks.workunit.client.0.smithi019.stdout:3/349: unlink d18/d1d/l2c 0 2024-09-12T22:11:27.120 INFO:tasks.workunit.client.0.smithi019.stdout:9/298: fdatasync d12/d1b/f38 0 2024-09-12T22:11:27.120 INFO:tasks.workunit.client.0.smithi019.stdout:5/353: link d0/d4e/d50/f6c d0/d24/d58/f77 0 2024-09-12T22:11:27.121 INFO:tasks.workunit.client.0.smithi019.stdout:8/304: rename d5/fd to d5/d16/f63 0 2024-09-12T22:11:27.123 INFO:tasks.workunit.client.0.smithi019.stdout:8/305: mknod d5/dc/c64 0 2024-09-12T22:11:27.123 INFO:tasks.workunit.client.0.smithi019.stdout:3/350: rmdir d18/d26/d30/d4a 39 2024-09-12T22:11:27.123 INFO:tasks.workunit.client.0.smithi019.stdout:3/351: rename f3 to d18/d1d/f69 0 2024-09-12T22:11:27.124 INFO:tasks.workunit.client.0.smithi019.stdout:0/323: dread d5/d7/de/f31 [0,4194304] 0 2024-09-12T22:11:27.124 INFO:tasks.workunit.client.0.smithi019.stdout:9/299: dread f0 [0,4194304] 0 2024-09-12T22:11:27.125 INFO:tasks.workunit.client.0.smithi019.stdout:0/324: rename d5/d7/d25 to d5/d7/d2c/d44/d6a 0 2024-09-12T22:11:27.126 INFO:tasks.workunit.client.0.smithi019.stdout:0/325: fsync d5/d7/d10/f55 0 2024-09-12T22:11:27.127 INFO:tasks.workunit.client.0.smithi019.stdout:0/326: stat d5/d7/d2c/d44/f45 0 2024-09-12T22:11:27.129 INFO:tasks.workunit.client.0.smithi019.stdout:0/327: write d5/d7/d10/d26/f3e [1822722,90722] 0 2024-09-12T22:11:27.130 INFO:tasks.workunit.client.0.smithi019.stdout:1/344: dread d1/d2/d18/d29/d27/f23 [0,4194304] 0 2024-09-12T22:11:27.130 INFO:tasks.workunit.client.0.smithi019.stdout:9/300: dwrite f9 [0,4194304] 0 2024-09-12T22:11:27.131 INFO:tasks.workunit.client.0.smithi019.stdout:0/328: fdatasync d5/d7/d10/d26/d2a/f2b 0 2024-09-12T22:11:27.134 INFO:tasks.workunit.client.0.smithi019.stdout:1/345: unlink d1/d2/d18/d59/f4d 0 2024-09-12T22:11:27.134 INFO:tasks.workunit.client.0.smithi019.stdout:0/329: rename d5/d7/c61 to d5/d7/d10/d26/c6b 0 2024-09-12T22:11:27.135 INFO:tasks.workunit.client.0.smithi019.stdout:1/346: fdatasync d1/d2/d18/d35/f3a 0 2024-09-12T22:11:27.135 INFO:tasks.workunit.client.0.smithi019.stdout:0/330: mknod d5/d7/d10/d26/d2a/c6c 0 2024-09-12T22:11:27.137 INFO:tasks.workunit.client.0.smithi019.stdout:1/347: rename d1/d2 to d1/d2/d18/d59/d7b 22 2024-09-12T22:11:27.137 INFO:tasks.workunit.client.0.smithi019.stdout:2/243: dread d0/d31/d4/f24 [0,4194304] 0 2024-09-12T22:11:27.137 INFO:tasks.workunit.client.0.smithi019.stdout:0/331: creat d5/d7/d2c/d44/d6a/d52/f6d x:0 0 0 2024-09-12T22:11:27.138 INFO:tasks.workunit.client.0.smithi019.stdout:9/301: dwrite d12/d1b/d40/d52/f65 [0,4194304] 0 2024-09-12T22:11:27.139 INFO:tasks.workunit.client.0.smithi019.stdout:9/302: stat d12/d1b/l22 0 2024-09-12T22:11:27.139 INFO:tasks.workunit.client.0.smithi019.stdout:4/311: dread d9/ff [0,4194304] 0 2024-09-12T22:11:27.141 INFO:tasks.workunit.client.0.smithi019.stdout:3/352: unlink d18/d1d/f69 0 2024-09-12T22:11:27.142 INFO:tasks.workunit.client.0.smithi019.stdout:2/244: mknod d0/d31/d12/d3b/c4f 0 2024-09-12T22:11:27.143 INFO:tasks.workunit.client.0.smithi019.stdout:1/348: symlink d1/d4/dc/df/l7c 0 2024-09-12T22:11:27.144 INFO:tasks.workunit.client.0.smithi019.stdout:2/245: fdatasync d0/d31/d4/d7/f45 0 2024-09-12T22:11:27.145 INFO:tasks.workunit.client.0.smithi019.stdout:4/312: truncate d9/fc 8290139 0 2024-09-12T22:11:27.145 INFO:tasks.workunit.client.0.smithi019.stdout:9/303: fsync d12/f30 0 2024-09-12T22:11:27.145 INFO:tasks.workunit.client.0.smithi019.stdout:1/349: symlink d1/d4/d6e/l7d 0 2024-09-12T22:11:27.145 INFO:tasks.workunit.client.0.smithi019.stdout:6/346: dread d9/f22 [0,4194304] 0 2024-09-12T22:11:27.145 INFO:tasks.workunit.client.0.smithi019.stdout:2/246: readlink d0/d3/df/d18/l3c 0 2024-09-12T22:11:27.145 INFO:tasks.workunit.client.0.smithi019.stdout:6/347: stat d9/dc 0 2024-09-12T22:11:27.146 INFO:tasks.workunit.client.0.smithi019.stdout:8/306: dread d5/dc/d17/f2b [0,4194304] 0 2024-09-12T22:11:27.146 INFO:tasks.workunit.client.0.smithi019.stdout:7/347: dread da/d24/d28/d1c/d32/f3c [0,4194304] 0 2024-09-12T22:11:27.146 INFO:tasks.workunit.client.0.smithi019.stdout:3/353: dread f8 [0,4194304] 0 2024-09-12T22:11:27.146 INFO:tasks.workunit.client.0.smithi019.stdout:1/350: chown d1/d2/d18/d70/f7a 0 1 2024-09-12T22:11:27.147 INFO:tasks.workunit.client.0.smithi019.stdout:7/348: chown da/d19/d25 985257 1 2024-09-12T22:11:27.147 INFO:tasks.workunit.client.0.smithi019.stdout:6/348: mknod d9/d3d/d4f/c77 0 2024-09-12T22:11:27.148 INFO:tasks.workunit.client.0.smithi019.stdout:1/351: mknod d1/d2/d18/d70/c7e 0 2024-09-12T22:11:27.149 INFO:tasks.workunit.client.0.smithi019.stdout:6/349: mkdir d9/dc/d20/d4b/d64/d78 0 2024-09-12T22:11:27.149 INFO:tasks.workunit.client.0.smithi019.stdout:9/304: fdatasync d12/d1b/d40/d52/f65 0 2024-09-12T22:11:27.149 INFO:tasks.workunit.client.0.smithi019.stdout:7/349: dread da/d19/f50 [0,4194304] 0 2024-09-12T22:11:27.150 INFO:tasks.workunit.client.0.smithi019.stdout:6/350: mkdir d9/d3d/d4f/d59/d79 0 2024-09-12T22:11:27.150 INFO:tasks.workunit.client.0.smithi019.stdout:3/354: getdents d18/d26/d30/d4a 0 2024-09-12T22:11:27.151 INFO:tasks.workunit.client.0.smithi019.stdout:9/305: mkdir d12/d48/d69 0 2024-09-12T22:11:27.151 INFO:tasks.workunit.client.0.smithi019.stdout:3/355: readlink d18/l33 0 2024-09-12T22:11:27.151 INFO:tasks.workunit.client.0.smithi019.stdout:8/307: rename d5/d16/d19/d32/f5a to d5/dc/f65 0 2024-09-12T22:11:27.152 INFO:tasks.workunit.client.0.smithi019.stdout:3/356: symlink d18/d26/l6a 0 2024-09-12T22:11:27.152 INFO:tasks.workunit.client.0.smithi019.stdout:8/308: mkdir d5/d53/d66 0 2024-09-12T22:11:27.152 INFO:tasks.workunit.client.0.smithi019.stdout:9/306: mknod d12/d1b/d20/d29/d56/d60/c6a 0 2024-09-12T22:11:27.154 INFO:tasks.workunit.client.0.smithi019.stdout:8/309: write d5/dc/d26/f36 [622696,66843] 0 2024-09-12T22:11:27.154 INFO:tasks.workunit.client.0.smithi019.stdout:3/357: write d18/d26/d30/d4e/f65 [375573,114697] 0 2024-09-12T22:11:27.155 INFO:tasks.workunit.client.0.smithi019.stdout:1/352: dwrite d1/d4/dc/f19 [0,4194304] 0 2024-09-12T22:11:27.156 INFO:tasks.workunit.client.0.smithi019.stdout:0/332: dread d5/f16 [4194304,4194304] 0 2024-09-12T22:11:27.156 INFO:tasks.workunit.client.0.smithi019.stdout:3/358: write d18/d26/f4b [42012,62676] 0 2024-09-12T22:11:27.157 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.156+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.157 INFO:tasks.workunit.client.0.smithi019.stdout:0/333: unlink d5/d7/d10/d26/c63 0 2024-09-12T22:11:27.158 INFO:tasks.workunit.client.0.smithi019.stdout:3/359: symlink d18/d26/d30/d4e/l6b 0 2024-09-12T22:11:27.159 INFO:tasks.workunit.client.0.smithi019.stdout:0/334: write d5/d7/f11 [286045,26583] 0 2024-09-12T22:11:27.160 INFO:tasks.workunit.client.0.smithi019.stdout:8/310: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:27.160 INFO:tasks.workunit.client.0.smithi019.stdout:0/335: write d5/f4c [808634,66508] 0 2024-09-12T22:11:27.160 INFO:tasks.workunit.client.0.smithi019.stdout:8/311: stat d5/d16/c33 0 2024-09-12T22:11:27.161 INFO:tasks.workunit.client.0.smithi019.stdout:8/312: stat d5/dc/d17/l18 0 2024-09-12T22:11:27.163 INFO:tasks.workunit.client.0.smithi019.stdout:1/353: dwrite d1/d4/dc/f28 [0,4194304] 0 2024-09-12T22:11:27.165 INFO:tasks.workunit.client.0.smithi019.stdout:0/336: dwrite d5/f22 [4194304,4194304] 0 2024-09-12T22:11:27.169 INFO:tasks.workunit.client.0.smithi019.stdout:8/313: dwrite d5/dc/d26/f3a [0,4194304] 0 2024-09-12T22:11:27.170 INFO:tasks.workunit.client.0.smithi019.stdout:1/354: dwrite d1/d37/f64 [0,4194304] 0 2024-09-12T22:11:27.172 INFO:tasks.workunit.client.0.smithi019.stdout:1/355: symlink d1/d2/d18/d59/l7f 0 2024-09-12T22:11:27.172 INFO:tasks.workunit.client.0.smithi019.stdout:8/314: rename d5/d53/f55 to d5/dc/d17/f67 0 2024-09-12T22:11:27.172 INFO:tasks.workunit.client.0.smithi019.stdout:3/360: sync 2024-09-12T22:11:27.172 INFO:tasks.workunit.client.0.smithi019.stdout:9/307: sync 2024-09-12T22:11:27.172 INFO:tasks.workunit.client.0.smithi019.stdout:5/354: sync 2024-09-12T22:11:27.173 INFO:tasks.workunit.client.0.smithi019.stdout:5/355: dread - d0/d24/d58/f77 zero size 2024-09-12T22:11:27.174 INFO:tasks.workunit.client.0.smithi019.stdout:0/337: dwrite d5/d7/d10/d26/f3e [4194304,4194304] 0 2024-09-12T22:11:27.174 INFO:tasks.workunit.client.0.smithi019.stdout:9/308: truncate f6 1278380 0 2024-09-12T22:11:27.175 INFO:tasks.workunit.client.0.smithi019.stdout:8/315: write d5/fa [4677235,107696] 0 2024-09-12T22:11:27.175 INFO:tasks.workunit.client.0.smithi019.stdout:1/356: rename d1/d2/d18/d29/d27/l4b to d1/d2/d18/d29/d27/l80 0 2024-09-12T22:11:27.177 INFO:tasks.workunit.client.0.smithi019.stdout:8/316: mknod d5/d16/d19/d29/c68 0 2024-09-12T22:11:27.177 INFO:tasks.workunit.client.0.smithi019.stdout:5/356: creat d0/d4e/f78 x:0 0 0 2024-09-12T22:11:27.177 INFO:tasks.workunit.client.0.smithi019.stdout:1/357: symlink d1/d4/dc/df/d53/d55/l81 0 2024-09-12T22:11:27.178 INFO:tasks.workunit.client.0.smithi019.stdout:3/361: dwrite d18/f34 [0,4194304] 0 2024-09-12T22:11:27.179 INFO:tasks.workunit.client.0.smithi019.stdout:3/362: write f16 [7048611,57730] 0 2024-09-12T22:11:27.179 INFO:tasks.workunit.client.0.smithi019.stdout:1/358: mknod d1/d4/dc/df/d61/c82 0 2024-09-12T22:11:27.180 INFO:tasks.workunit.client.0.smithi019.stdout:1/359: fdatasync d1/d4/dc/df/f74 0 2024-09-12T22:11:27.181 INFO:tasks.workunit.client.0.smithi019.stdout:1/360: mkdir d1/d83 0 2024-09-12T22:11:27.189 INFO:tasks.workunit.client.0.smithi019.stdout:4/313: dread d9/db/d2b/f30 [4194304,4194304] 0 2024-09-12T22:11:27.190 INFO:tasks.workunit.client.0.smithi019.stdout:4/314: mkdir d9/d14/d57/d69 0 2024-09-12T22:11:27.190 INFO:tasks.workunit.client.0.smithi019.stdout:0/338: read d5/d7/f12 [195599,95233] 0 2024-09-12T22:11:27.191 INFO:tasks.workunit.client.0.smithi019.stdout:0/339: chown d5/d7/d2c/d44/d6a/d52 2476100 1 2024-09-12T22:11:27.191 INFO:tasks.workunit.client.0.smithi019.stdout:4/315: write d9/db/d2b/f30 [920670,98285] 0 2024-09-12T22:11:27.195 INFO:tasks.workunit.client.0.smithi019.stdout:1/361: rename d1/d4 to d1/d2/d18/d35/d84 0 2024-09-12T22:11:27.197 INFO:tasks.workunit.client.0.smithi019.stdout:4/316: dwrite d9/db/f24 [0,4194304] 0 2024-09-12T22:11:27.197 INFO:tasks.workunit.client.0.smithi019.stdout:0/340: dwrite d5/d7/de/f39 [0,4194304] 0 2024-09-12T22:11:27.197 INFO:tasks.workunit.client.0.smithi019.stdout:2/247: dread d0/d3/df/f2a [0,4194304] 0 2024-09-12T22:11:27.198 INFO:tasks.workunit.client.0.smithi019.stdout:1/362: rmdir d1/d2/d18/d35/d84/dc/df/d61 39 2024-09-12T22:11:27.198 INFO:tasks.workunit.client.0.smithi019.stdout:0/341: write d5/f1e [46086,85882] 0 2024-09-12T22:11:27.200 INFO:tasks.workunit.client.0.smithi019.stdout:2/248: creat d0/d3/df/d18/d2c/f50 x:0 0 0 2024-09-12T22:11:27.201 INFO:tasks.workunit.client.0.smithi019.stdout:1/363: creat d1/d2/d18/d29/d51/f85 x:0 0 0 2024-09-12T22:11:27.202 INFO:tasks.workunit.client.0.smithi019.stdout:2/249: write d0/d3/df/f37 [1595154,42557] 0 2024-09-12T22:11:27.204 INFO:tasks.workunit.client.0.smithi019.stdout:1/364: symlink d1/d2/d18/d59/l86 0 2024-09-12T22:11:27.204 INFO:tasks.workunit.client.0.smithi019.stdout:2/250: chown d0/d31/d12/d3b 241580 1 2024-09-12T22:11:27.205 INFO:tasks.workunit.client.0.smithi019.stdout:4/317: dwrite d9/f54 [0,4194304] 0 2024-09-12T22:11:27.205 INFO:tasks.workunit.client.0.smithi019.stdout:8/317: dread d5/d16/d19/f34 [0,4194304] 0 2024-09-12T22:11:27.206 INFO:tasks.workunit.client.0.smithi019.stdout:7/350: dread da/d24/f2c [0,4194304] 0 2024-09-12T22:11:27.207 INFO:tasks.workunit.client.0.smithi019.stdout:1/365: symlink d1/d2/d18/d59/l87 0 2024-09-12T22:11:27.207 INFO:tasks.workunit.client.0.smithi019.stdout:0/342: dwrite d5/d7/de/f54 [0,4194304] 0 2024-09-12T22:11:27.207 INFO:tasks.workunit.client.0.smithi019.stdout:1/366: readlink d1/d2/d18/d59/l86 0 2024-09-12T22:11:27.208 INFO:tasks.workunit.client.0.smithi019.stdout:3/363: sync 2024-09-12T22:11:27.208 INFO:tasks.workunit.client.0.smithi019.stdout:4/318: mkdir d9/db/d2b/d6a 0 2024-09-12T22:11:27.209 INFO:tasks.workunit.client.0.smithi019.stdout:2/251: mkdir d0/d3/d11/d2e/d34/d51 0 2024-09-12T22:11:27.209 INFO:tasks.workunit.client.0.smithi019.stdout:7/351: mknod da/d19/d25/c77 0 2024-09-12T22:11:27.209 INFO:tasks.workunit.client.0.smithi019.stdout:8/318: mkdir d5/d53/d66/d69 0 2024-09-12T22:11:27.210 INFO:tasks.workunit.client.0.smithi019.stdout:7/352: rmdir da/d24 39 2024-09-12T22:11:27.210 INFO:tasks.workunit.client.0.smithi019.stdout:1/367: stat d1/d2/d18/d35/d84/dc/df/d61/f1b 0 2024-09-12T22:11:27.210 INFO:tasks.workunit.client.0.smithi019.stdout:5/357: dread d0/d1d/f20 [0,4194304] 0 2024-09-12T22:11:27.210 INFO:tasks.workunit.client.0.smithi019.stdout:3/364: creat d18/d26/d30/d4e/f6c x:0 0 0 2024-09-12T22:11:27.211 INFO:tasks.workunit.client.0.smithi019.stdout:4/319: creat d9/d14/d33/f6b x:0 0 0 2024-09-12T22:11:27.211 INFO:tasks.workunit.client.0.smithi019.stdout:6/351: dread d9/dc/d20/f21 [0,4194304] 0 2024-09-12T22:11:27.213 INFO:tasks.workunit.client.0.smithi019.stdout:7/353: write da/d19/d25/d39/f71 [547162,82216] 0 2024-09-12T22:11:27.213 INFO:tasks.workunit.client.0.smithi019.stdout:4/320: chown d9/c51 1908107369 1 2024-09-12T22:11:27.213 INFO:tasks.workunit.client.0.smithi019.stdout:3/365: creat d18/d1d/d35/f6d x:0 0 0 2024-09-12T22:11:27.213 INFO:tasks.workunit.client.0.smithi019.stdout:1/368: write d1/d2/d18/d35/d84/dc/df/d61/f1b [351090,54988] 0 2024-09-12T22:11:27.214 INFO:tasks.workunit.client.0.smithi019.stdout:6/352: mkdir d9/dc/d20/d4b/d7a 0 2024-09-12T22:11:27.215 INFO:tasks.workunit.client.0.smithi019.stdout:8/319: dread d5/dc/d17/f2b [0,4194304] 0 2024-09-12T22:11:27.215 INFO:tasks.workunit.client.0.smithi019.stdout:2/252: dread d0/d3/df/f37 [0,4194304] 0 2024-09-12T22:11:27.215 INFO:tasks.workunit.client.0.smithi019.stdout:4/321: mkdir d9/d6c 0 2024-09-12T22:11:27.216 INFO:tasks.workunit.client.0.smithi019.stdout:0/343: dwrite d5/d7/d10/f4d [0,4194304] 0 2024-09-12T22:11:27.216 INFO:tasks.workunit.client.0.smithi019.stdout:3/366: dread f17 [0,4194304] 0 2024-09-12T22:11:27.216 INFO:tasks.workunit.client.0.smithi019.stdout:1/369: dread - d1/d2/d18/d35/d84/dc/df/d53/d55/f6b zero size 2024-09-12T22:11:27.217 INFO:tasks.workunit.client.0.smithi019.stdout:0/344: read d5/f22 [7491619,104219] 0 2024-09-12T22:11:27.218 INFO:tasks.workunit.client.0.smithi019.stdout:0/345: stat d5/c14 0 2024-09-12T22:11:27.218 INFO:tasks.workunit.client.0.smithi019.stdout:3/367: read - d18/d26/d30/d4a/f62 zero size 2024-09-12T22:11:27.218 INFO:tasks.workunit.client.0.smithi019.stdout:8/320: creat d5/dc/d26/d43/f6a x:0 0 0 2024-09-12T22:11:27.219 INFO:tasks.workunit.client.0.smithi019.stdout:2/253: mkdir d0/d3/df/d52 0 2024-09-12T22:11:27.219 INFO:tasks.workunit.client.0.smithi019.stdout:4/322: mknod d9/d14/d31/c6d 0 2024-09-12T22:11:27.219 INFO:tasks.workunit.client.0.smithi019.stdout:6/353: mknod d9/dc/d20/d4b/d7a/c7b 0 2024-09-12T22:11:27.220 INFO:tasks.workunit.client.0.smithi019.stdout:8/321: dread - d5/dc/f5f zero size 2024-09-12T22:11:27.220 INFO:tasks.workunit.client.0.smithi019.stdout:6/354: fdatasync d9/d3d/f2f 0 2024-09-12T22:11:27.220 INFO:tasks.workunit.client.0.smithi019.stdout:3/368: creat d18/d26/d30/d4a/f6e x:0 0 0 2024-09-12T22:11:27.220 INFO:tasks.workunit.client.0.smithi019.stdout:0/346: dread - d5/d7/d10/f55 zero size 2024-09-12T22:11:27.220 INFO:tasks.workunit.client.0.smithi019.stdout:8/322: fsync d5/d16/d19/f5b 0 2024-09-12T22:11:27.221 INFO:tasks.workunit.client.0.smithi019.stdout:7/354: dwrite da/d19/d25/d39/f61 [0,4194304] 0 2024-09-12T22:11:27.221 INFO:tasks.workunit.client.0.smithi019.stdout:4/323: truncate d9/d14/d33/f46 371008 0 2024-09-12T22:11:27.222 INFO:tasks.workunit.client.0.smithi019.stdout:8/323: fsync d5/dc/d26/d43/f57 0 2024-09-12T22:11:27.223 INFO:tasks.workunit.client.0.smithi019.stdout:6/355: mknod d9/d3d/d4f/d59/d79/c7c 0 2024-09-12T22:11:27.224 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.223+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.225 INFO:tasks.workunit.client.0.smithi019.stdout:3/369: write d18/d26/d30/f67 [604427,37510] 0 2024-09-12T22:11:27.225 INFO:tasks.workunit.client.0.smithi019.stdout:7/355: symlink da/d24/d28/d1c/l78 0 2024-09-12T22:11:27.226 INFO:tasks.workunit.client.0.smithi019.stdout:0/347: truncate d5/d7/de/f3c 1666691 0 2024-09-12T22:11:27.226 INFO:tasks.workunit.client.0.smithi019.stdout:1/370: dread d1/d2/d18/f1c [0,4194304] 0 2024-09-12T22:11:27.227 INFO:tasks.workunit.client.0.smithi019.stdout:9/309: dread d12/d1b/f32 [0,4194304] 0 2024-09-12T22:11:27.227 INFO:tasks.workunit.client.0.smithi019.stdout:7/356: mkdir da/d19/d79 0 2024-09-12T22:11:27.228 INFO:tasks.workunit.client.0.smithi019.stdout:8/324: link d5/dc/c11 d5/dc/d26/d5c/c6b 0 2024-09-12T22:11:27.229 INFO:tasks.workunit.client.0.smithi019.stdout:3/370: rename d18/d26/d30/d4a/l61 to d18/d26/d30/d4e/l6f 0 2024-09-12T22:11:27.229 INFO:tasks.workunit.client.0.smithi019.stdout:2/254: dwrite d0/d31/d12/f1b [0,4194304] 0 2024-09-12T22:11:27.229 INFO:tasks.workunit.client.0.smithi019.stdout:0/348: dread - d5/d7/d2c/d44/d6a/d46/f60 zero size 2024-09-12T22:11:27.231 INFO:tasks.workunit.client.0.smithi019.stdout:4/324: dwrite d9/d14/d33/f4b [0,4194304] 0 2024-09-12T22:11:27.233 INFO:tasks.workunit.client.0.smithi019.stdout:4/325: chown d9/l4d 1225 1 2024-09-12T22:11:27.233 INFO:tasks.workunit.client.0.smithi019.stdout:7/357: write da/d19/d25/d39/d51/f6c [707398,29896] 0 2024-09-12T22:11:27.234 INFO:tasks.workunit.client.0.smithi019.stdout:1/371: rename d1/d2/d18/d29/d27/l3d to d1/d2/d18/d29/d27/l88 0 2024-09-12T22:11:27.236 INFO:tasks.workunit.client.0.smithi019.stdout:6/356: dwrite d9/dc/f74 [0,4194304] 0 2024-09-12T22:11:27.237 INFO:tasks.workunit.client.0.smithi019.stdout:3/371: unlink d18/d1d/c29 0 2024-09-12T22:11:27.237 INFO:tasks.workunit.client.0.smithi019.stdout:7/358: read da/d24/d28/f57 [2085165,141] 0 2024-09-12T22:11:27.237 INFO:tasks.workunit.client.0.smithi019.stdout:9/310: dread d12/d1b/f38 [0,4194304] 0 2024-09-12T22:11:27.241 INFO:tasks.workunit.client.0.smithi019.stdout:0/349: mknod d5/d7/d10/d26/c6e 0 2024-09-12T22:11:27.241 INFO:tasks.workunit.client.0.smithi019.stdout:8/325: dwrite d5/f15 [4194304,4194304] 0 2024-09-12T22:11:27.241 INFO:tasks.workunit.client.0.smithi019.stdout:6/357: write d9/d3d/d6f/f67 [282421,109867] 0 2024-09-12T22:11:27.241 INFO:tasks.workunit.client.0.smithi019.stdout:5/358: dread d0/f4 [0,4194304] 0 2024-09-12T22:11:27.241 INFO:tasks.workunit.client.0.smithi019.stdout:7/359: creat da/d24/d28/d1c/f7a x:0 0 0 2024-09-12T22:11:27.242 INFO:tasks.workunit.client.0.smithi019.stdout:4/326: dwrite f7 [0,4194304] 0 2024-09-12T22:11:27.242 INFO:tasks.workunit.client.0.smithi019.stdout:7/360: stat da/d19/f50 0 2024-09-12T22:11:27.242 INFO:tasks.workunit.client.0.smithi019.stdout:6/358: unlink d9/dc/d20/f21 0 2024-09-12T22:11:27.242 INFO:tasks.workunit.client.0.smithi019.stdout:5/359: write d0/f5 [1538619,30046] 0 2024-09-12T22:11:27.243 INFO:tasks.workunit.client.0.smithi019.stdout:7/361: chown da/d24/d28/d1c/d32/d5e 1520866 1 2024-09-12T22:11:27.243 INFO:tasks.workunit.client.0.smithi019.stdout:9/311: rename d12/d1b/f38 to d12/d1b/d20/d29/d56/d60/f6b 0 2024-09-12T22:11:27.244 INFO:tasks.workunit.client.0.smithi019.stdout:6/359: mkdir d9/dc/d20/d4b/d64/d7d 0 2024-09-12T22:11:27.244 INFO:tasks.workunit.client.0.smithi019.stdout:8/326: getdents d5/d16/d19 0 2024-09-12T22:11:27.245 INFO:tasks.workunit.client.0.smithi019.stdout:4/327: link d9/d14/d33/f4b d9/d14/d33/f6e 0 2024-09-12T22:11:27.245 INFO:tasks.workunit.client.0.smithi019.stdout:0/350: link d5/d7/d10/d26/d2a/f5d d5/d7/d10/d26/f6f 0 2024-09-12T22:11:27.246 INFO:tasks.workunit.client.0.smithi019.stdout:7/362: symlink da/d24/d28/l7b 0 2024-09-12T22:11:27.246 INFO:tasks.workunit.client.0.smithi019.stdout:4/328: dread - d9/d17/f2c zero size 2024-09-12T22:11:27.247 INFO:tasks.workunit.client.0.smithi019.stdout:8/327: rename d5/dc/d26/l3f to d5/d16/d19/l6c 0 2024-09-12T22:11:27.247 INFO:tasks.workunit.client.0.smithi019.stdout:7/363: creat da/f7c x:0 0 0 2024-09-12T22:11:27.247 INFO:tasks.workunit.client.0.smithi019.stdout:8/328: chown d5/d53/d66/d69 91 1 2024-09-12T22:11:27.248 INFO:tasks.workunit.client.0.smithi019.stdout:4/329: mkdir d9/d14/d57/d69/d6f 0 2024-09-12T22:11:27.248 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:27.248 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:27.249 INFO:tasks.workunit.client.0.smithi019.stdout:5/360: dwrite d0/d1d/d4f/d47/f52 [0,4194304] 0 2024-09-12T22:11:27.250 INFO:tasks.workunit.client.0.smithi019.stdout:8/329: truncate d5/dc/f5f 174798 0 2024-09-12T22:11:27.250 INFO:tasks.workunit.client.0.smithi019.stdout:3/372: dread d18/d26/d30/f67 [0,4194304] 0 2024-09-12T22:11:27.250 INFO:tasks.workunit.client.0.smithi019.stdout:7/364: truncate da/d24/d28/d1c/d32/f60 194430 0 2024-09-12T22:11:27.251 INFO:tasks.workunit.client.0.smithi019.stdout:9/312: truncate f5 3052782 0 2024-09-12T22:11:27.252 INFO:tasks.workunit.client.0.smithi019.stdout:7/365: mknod da/d24/c7d 0 2024-09-12T22:11:27.252 INFO:tasks.workunit.client.0.smithi019.stdout:3/373: unlink d18/d26/d30/d4a/l5b 0 2024-09-12T22:11:27.252 INFO:tasks.workunit.client.0.smithi019.stdout:7/366: sync 2024-09-12T22:11:27.252 INFO:tasks.workunit.client.0.smithi019.stdout:5/361: rmdir d0/d4e/d50/d76 0 2024-09-12T22:11:27.252 INFO:tasks.workunit.client.0.smithi019.stdout:5/362: fsync d0/d4e/f78 0 2024-09-12T22:11:27.252 INFO:tasks.workunit.client.0.smithi019.stdout:3/374: truncate f17 910312 0 2024-09-12T22:11:27.253 INFO:tasks.workunit.client.0.smithi019.stdout:9/313: rmdir d12/d48/d69 0 2024-09-12T22:11:27.253 INFO:tasks.workunit.client.0.smithi019.stdout:3/375: write d18/d26/f4b [17807,75941] 0 2024-09-12T22:11:27.253 INFO:tasks.workunit.client.0.smithi019.stdout:9/314: unlink d12/d1b/d20/d37/f4b 0 2024-09-12T22:11:27.254 INFO:tasks.workunit.client.0.smithi019.stdout:6/360: dread d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:27.255 INFO:tasks.workunit.client.0.smithi019.stdout:9/315: symlink d12/d1b/d20/d37/l6c 0 2024-09-12T22:11:27.256 INFO:tasks.workunit.client.0.smithi019.stdout:3/376: rename d18/l33 to d18/d26/d30/d64/l70 0 2024-09-12T22:11:27.257 INFO:tasks.workunit.client.0.smithi019.stdout:0/351: write d5/d7/de/f3c [2094521,795] 0 2024-09-12T22:11:27.258 INFO:tasks.workunit.client.0.smithi019.stdout:7/367: dwrite da/d30/d53/f59 [0,4194304] 0 2024-09-12T22:11:27.260 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:27.261 INFO:tasks.workunit.client.0.smithi019.stdout:5/363: truncate d0/d24/f5b 3713195 0 2024-09-12T22:11:27.263 INFO:tasks.workunit.client.0.smithi019.stdout:4/330: dwrite d9/f3b [0,4194304] 0 2024-09-12T22:11:27.263 INFO:tasks.workunit.client.0.smithi019.stdout:7/368: chown da/d24/l4f 667340220 1 2024-09-12T22:11:27.263 INFO:tasks.workunit.client.0.smithi019.stdout:0/352: rename d5/d7/de/f48 to d5/f70 0 2024-09-12T22:11:27.263 INFO:tasks.workunit.client.0.smithi019.stdout:5/364: mknod d0/d26/c79 0 2024-09-12T22:11:27.263 INFO:tasks.workunit.client.0.smithi019.stdout:3/377: mkdir d18/d26/d30/d71 0 2024-09-12T22:11:27.264 INFO:tasks.workunit.client.0.smithi019.stdout:5/365: mkdir d0/d24/d7a 0 2024-09-12T22:11:27.265 INFO:tasks.workunit.client.0.smithi019.stdout:4/331: truncate d9/d14/d33/f46 1371240 0 2024-09-12T22:11:27.266 INFO:tasks.workunit.client.0.smithi019.stdout:3/378: chown d18/c40 6426 1 2024-09-12T22:11:27.266 INFO:tasks.workunit.client.0.smithi019.stdout:5/366: fsync d0/f1b 0 2024-09-12T22:11:27.268 INFO:tasks.workunit.client.0.smithi019.stdout:1/372: dread d1/d2/d18/d35/f3a [4194304,4194304] 0 2024-09-12T22:11:27.268 INFO:tasks.workunit.client.0.smithi019.stdout:7/369: getdents da/d24/d28/d1c/d32/d5e 0 2024-09-12T22:11:27.269 INFO:tasks.workunit.client.0.smithi019.stdout:0/353: link d5/d7/de/f54 d5/d7/d10/d26/f71 0 2024-09-12T22:11:27.269 INFO:tasks.workunit.client.0.smithi019.stdout:5/367: unlink d0/d24/d58/f77 0 2024-09-12T22:11:27.269 INFO:tasks.workunit.client.0.smithi019.stdout:3/379: symlink d18/l72 0 2024-09-12T22:11:27.269 INFO:tasks.workunit.client.0.smithi019.stdout:0/354: sync 2024-09-12T22:11:27.269 INFO:tasks.workunit.client.0.smithi019.stdout:4/332: symlink d9/d14/d31/d3f/l70 0 2024-09-12T22:11:27.269 INFO:tasks.workunit.client.0.smithi019.stdout:0/355: chown d5/d7/de 949 1 2024-09-12T22:11:27.270 INFO:tasks.workunit.client.0.smithi019.stdout:1/373: rmdir d1/d2/d18/d35/d84/dc/df 39 2024-09-12T22:11:27.270 INFO:tasks.workunit.client.0.smithi019.stdout:7/370: mknod da/d24/d28/d1c/d32/c7e 0 2024-09-12T22:11:27.270 INFO:tasks.workunit.client.0.smithi019.stdout:9/316: dread f11 [0,4194304] 0 2024-09-12T22:11:27.271 INFO:tasks.workunit.client.0.smithi019.stdout:6/361: dwrite d9/dc/d20/d30/f37 [0,4194304] 0 2024-09-12T22:11:27.272 INFO:tasks.workunit.client.0.smithi019.stdout:6/362: fsync d9/d3d/d4f/f62 0 2024-09-12T22:11:27.272 INFO:tasks.workunit.client.0.smithi019.stdout:0/356: dread - d5/d7/d10/d26/f6f zero size 2024-09-12T22:11:27.273 INFO:tasks.workunit.client.0.smithi019.stdout:4/333: getdents d9/d4c 0 2024-09-12T22:11:27.276 INFO:tasks.workunit.client.0.smithi019.stdout:8/330: dread d5/dc/ff [0,4194304] 0 2024-09-12T22:11:27.278 INFO:tasks.workunit.client.0.smithi019.stdout:3/380: dwrite d18/d26/d30/d4e/f6c [0,4194304] 0 2024-09-12T22:11:27.278 INFO:tasks.workunit.client.0.smithi019.stdout:9/317: link d12/f15 d12/d48/f6d 0 2024-09-12T22:11:27.278 INFO:tasks.workunit.client.0.smithi019.stdout:5/368: link d0/f2 d0/d4e/d50/f7b 0 2024-09-12T22:11:27.279 INFO:tasks.workunit.client.0.smithi019.stdout:2/255: dread d0/d3/d11/fc [0,4194304] 0 2024-09-12T22:11:27.280 INFO:tasks.workunit.client.0.smithi019.stdout:0/357: write d5/d7/d10/d26/d2a/f65 [1751552,92918] 0 2024-09-12T22:11:27.281 INFO:tasks.workunit.client.0.smithi019.stdout:2/256: chown d0/d31/d12 78926818 1 2024-09-12T22:11:27.281 INFO:tasks.workunit.client.0.smithi019.stdout:7/371: dwrite da/d19/f41 [0,4194304] 0 2024-09-12T22:11:27.282 INFO:tasks.workunit.client.0.smithi019.stdout:9/318: readlink d12/d1b/d20/d37/l6c 0 2024-09-12T22:11:27.282 INFO:tasks.workunit.client.0.smithi019.stdout:1/374: dwrite d1/d2/d18/d70/f7a [0,4194304] 0 2024-09-12T22:11:27.283 INFO:tasks.workunit.client.0.smithi019.stdout:8/331: creat d5/dc/f6d x:0 0 0 2024-09-12T22:11:27.283 INFO:tasks.workunit.client.0.smithi019.stdout:3/381: creat d18/d26/d30/d4e/f73 x:0 0 0 2024-09-12T22:11:27.283 INFO:tasks.workunit.client.0.smithi019.stdout:8/332: sync 2024-09-12T22:11:27.284 INFO:tasks.workunit.client.0.smithi019.stdout:6/363: dwrite d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:27.284 INFO:tasks.workunit.client.0.smithi019.stdout:7/372: unlink da/d19/l36 0 2024-09-12T22:11:27.284 INFO:tasks.workunit.client.0.smithi019.stdout:0/358: write d5/d7/f4a [2974448,49314] 0 2024-09-12T22:11:27.284 INFO:tasks.workunit.client.0.smithi019.stdout:9/319: stat d12/d1b/d20/l4e 0 2024-09-12T22:11:27.285 INFO:tasks.workunit.client.0.smithi019.stdout:6/364: read - d9/dc/d20/d4b/f2c zero size 2024-09-12T22:11:27.285 INFO:tasks.workunit.client.0.smithi019.stdout:7/373: chown da/d19/d25/d39/d51/f75 627728 1 2024-09-12T22:11:27.287 INFO:tasks.workunit.client.0.smithi019.stdout:8/333: rename d5/d16/d19/f34 to d5/d53/f6e 0 2024-09-12T22:11:27.287 INFO:tasks.workunit.client.0.smithi019.stdout:2/257: truncate d0/d3/df/d18/d2c/f50 47410 0 2024-09-12T22:11:27.288 INFO:tasks.workunit.client.0.smithi019.stdout:8/334: sync 2024-09-12T22:11:27.288 INFO:tasks.workunit.client.0.smithi019.stdout:1/375: mknod d1/d2/d18/d35/d84/d6e/c89 0 2024-09-12T22:11:27.288 INFO:tasks.workunit.client.0.smithi019.stdout:7/374: rmdir da/d19/d25 39 2024-09-12T22:11:27.288 INFO:tasks.workunit.client.0.smithi019.stdout:3/382: creat d18/d26/d30/d71/f74 x:0 0 0 2024-09-12T22:11:27.289 INFO:tasks.workunit.client.0.smithi019.stdout:5/369: write d0/f19 [550117,85789] 0 2024-09-12T22:11:27.290 INFO:tasks.workunit.client.0.smithi019.stdout:6/365: getdents d9/dc/d20/d71 0 2024-09-12T22:11:27.290 INFO:tasks.workunit.client.0.smithi019.stdout:9/320: rename d12/d1b/d20/l3d to d12/d1b/d20/d29/d56/l6e 0 2024-09-12T22:11:27.290 INFO:tasks.workunit.client.0.smithi019.stdout:9/321: sync 2024-09-12T22:11:27.290 INFO:tasks.workunit.client.0.smithi019.stdout:8/335: creat d5/d53/d66/f6f x:0 0 0 2024-09-12T22:11:27.290 INFO:tasks.workunit.client.0.smithi019.stdout:2/258: mknod d0/d3/d11/d2e/c53 0 2024-09-12T22:11:27.291 INFO:tasks.workunit.client.0.smithi019.stdout:5/370: readlink d0/d26/d5f/l6b 0 2024-09-12T22:11:27.291 INFO:tasks.workunit.client.0.smithi019.stdout:4/334: dread d9/d17/f1d [0,4194304] 0 2024-09-12T22:11:27.292 INFO:tasks.workunit.client.0.smithi019.stdout:7/375: unlink da/d19/d25/d39/l72 0 2024-09-12T22:11:27.292 INFO:tasks.workunit.client.0.smithi019.stdout:9/322: chown d12/l13 22 1 2024-09-12T22:11:27.292 INFO:tasks.workunit.client.0.smithi019.stdout:6/366: mkdir d9/dc/d20/d4b/d64/d7e 0 2024-09-12T22:11:27.292 INFO:tasks.workunit.client.0.smithi019.stdout:3/383: rename d18/c20 to d18/d1d/d35/c75 0 2024-09-12T22:11:27.292 INFO:tasks.workunit.client.0.smithi019.stdout:6/367: sync 2024-09-12T22:11:27.293 INFO:tasks.workunit.client.0.smithi019.stdout:1/376: mknod d1/d2/d18/d35/d84/dc/df/c8a 0 2024-09-12T22:11:27.293 INFO:tasks.workunit.client.0.smithi019.stdout:8/336: mknod d5/d16/c70 0 2024-09-12T22:11:27.293 INFO:tasks.workunit.client.0.smithi019.stdout:5/371: creat d0/d4e/d50/f7c x:0 0 0 2024-09-12T22:11:27.293 INFO:tasks.workunit.client.0.smithi019.stdout:4/335: rmdir d9/d14/d31/d3f 39 2024-09-12T22:11:27.293 INFO:tasks.workunit.client.0.smithi019.stdout:2/259: rename d0/d3/df/d18/d2c/f50 to d0/d3/df/d18/d2c/d2d/f54 0 2024-09-12T22:11:27.294 INFO:tasks.workunit.client.0.smithi019.stdout:3/384: mknod d18/d1d/c76 0 2024-09-12T22:11:27.295 INFO:tasks.workunit.client.0.smithi019.stdout:2/260: readlink d0/d3/df/d18/l3c 0 2024-09-12T22:11:27.300 INFO:tasks.workunit.client.0.smithi019.stdout:6/368: dwrite d9/f4e [0,4194304] 0 2024-09-12T22:11:27.300 INFO:tasks.workunit.client.0.smithi019.stdout:7/376: dwrite da/d24/d28/f15 [0,4194304] 0 2024-09-12T22:11:27.304 INFO:tasks.workunit.client.0.smithi019.stdout:8/337: getdents d5/d16/d19 0 2024-09-12T22:11:27.305 INFO:tasks.workunit.client.0.smithi019.stdout:0/359: truncate d5/f6 2030310 0 2024-09-12T22:11:27.306 INFO:tasks.workunit.client.0.smithi019.stdout:6/369: dread - d9/d3d/d6f/f5c zero size 2024-09-12T22:11:27.308 INFO:tasks.workunit.client.0.smithi019.stdout:5/372: dwrite d0/d24/f36 [0,4194304] 0 2024-09-12T22:11:27.308 INFO:tasks.workunit.client.0.smithi019.stdout:4/336: dwrite d9/d58/f68 [0,4194304] 0 2024-09-12T22:11:27.311 INFO:tasks.workunit.client.0.smithi019.stdout:1/377: dwrite d1/d2/d18/d35/d84/dc/df/d2c/f63 [0,4194304] 0 2024-09-12T22:11:27.311 INFO:tasks.workunit.client.0.smithi019.stdout:3/385: dwrite d18/d1d/f5d [0,4194304] 0 2024-09-12T22:11:27.313 INFO:tasks.workunit.client.0.smithi019.stdout:8/338: stat d5/d16/d19/c5e 0 2024-09-12T22:11:27.313 INFO:tasks.workunit.client.0.smithi019.stdout:0/360: fdatasync d5/f22 0 2024-09-12T22:11:27.313 INFO:tasks.workunit.client.0.smithi019.stdout:2/261: dwrite d0/d3/d11/f10 [4194304,4194304] 0 2024-09-12T22:11:27.314 INFO:tasks.workunit.client.0.smithi019.stdout:6/370: dread d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:27.314 INFO:tasks.workunit.client.0.smithi019.stdout:3/386: readlink d18/l21 0 2024-09-12T22:11:27.314 INFO:tasks.workunit.client.0.smithi019.stdout:7/377: rmdir da/d30/d68 0 2024-09-12T22:11:27.315 INFO:tasks.workunit.client.0.smithi019.stdout:1/378: chown d1/c6f 1595676387 1 2024-09-12T22:11:27.315 INFO:tasks.workunit.client.0.smithi019.stdout:5/373: chown d0/d1d/d4f/f64 18 1 2024-09-12T22:11:27.315 INFO:tasks.workunit.client.0.smithi019.stdout:8/339: creat d5/d16/d19/f71 x:0 0 0 2024-09-12T22:11:27.316 INFO:tasks.workunit.client.0.smithi019.stdout:7/378: write da/d19/d25/f2e [4845894,21848] 0 2024-09-12T22:11:27.316 INFO:tasks.workunit.client.0.smithi019.stdout:6/371: mknod d9/dc/d20/d4b/d64/d7e/c7f 0 2024-09-12T22:11:27.316 INFO:tasks.workunit.client.0.smithi019.stdout:0/361: symlink d5/d7/d2c/d44/d6a/d52/l72 0 2024-09-12T22:11:27.317 INFO:tasks.workunit.client.0.smithi019.stdout:5/374: chown d0/d1d/c3b 52 1 2024-09-12T22:11:27.319 INFO:tasks.workunit.client.0.smithi019.stdout:1/379: rmdir d1/d2/d18/d35/d84/dc/d77 0 2024-09-12T22:11:27.320 INFO:tasks.workunit.client.0.smithi019.stdout:7/379: write da/d19/d25/d39/f71 [580140,99245] 0 2024-09-12T22:11:27.321 INFO:tasks.workunit.client.0.smithi019.stdout:6/372: read d9/dc/d20/f1a [359565,98887] 0 2024-09-12T22:11:27.323 INFO:tasks.workunit.client.0.smithi019.stdout:0/362: rename d5/d7/f3b to d5/d7/d2c/d44/d6a/d46/f73 0 2024-09-12T22:11:27.325 INFO:tasks.workunit.client.0.smithi019.stdout:3/387: truncate d18/d26/d30/d4e/f59 1599570 0 2024-09-12T22:11:27.325 INFO:tasks.workunit.client.0.smithi019.stdout:7/380: write da/d24/d28/f15 [1202600,10585] 0 2024-09-12T22:11:27.325 INFO:tasks.workunit.client.0.smithi019.stdout:4/337: dwrite d9/d14/d31/f5c [0,4194304] 0 2024-09-12T22:11:27.326 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.325+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.326 INFO:tasks.workunit.client.0.smithi019.stdout:2/262: dwrite d0/d31/d4/d7/f45 [0,4194304] 0 2024-09-12T22:11:27.328 INFO:tasks.workunit.client.0.smithi019.stdout:1/380: creat d1/d2/d18/d35/d84/dc/df/d53/d66/f8b x:0 0 0 2024-09-12T22:11:27.329 INFO:tasks.workunit.client.0.smithi019.stdout:8/340: dwrite d5/d16/d19/f40 [0,4194304] 0 2024-09-12T22:11:27.329 INFO:tasks.workunit.client.0.smithi019.stdout:4/338: unlink d9/f27 0 2024-09-12T22:11:27.329 INFO:tasks.workunit.client.0.smithi019.stdout:0/363: chown d5/d7/d2c/d44/d6a/d52/l72 14354538 1 2024-09-12T22:11:27.329 INFO:tasks.workunit.client.0.smithi019.stdout:5/375: dwrite d0/f63 [0,4194304] 0 2024-09-12T22:11:27.332 INFO:tasks.workunit.client.0.smithi019.stdout:7/381: creat da/d24/d28/d1c/d32/d5e/d73/f7f x:0 0 0 2024-09-12T22:11:27.332 INFO:tasks.workunit.client.0.smithi019.stdout:8/341: creat d5/dc/d17/f72 x:0 0 0 2024-09-12T22:11:27.332 INFO:tasks.workunit.client.0.smithi019.stdout:1/381: creat d1/d2/d18/d35/d84/dc/df/d53/d66/f8c x:0 0 0 2024-09-12T22:11:27.332 INFO:tasks.workunit.client.0.smithi019.stdout:8/342: chown d5/dc/f6d 116089194 1 2024-09-12T22:11:27.333 INFO:tasks.workunit.client.0.smithi019.stdout:7/382: mknod da/d19/d25/d39/c80 0 2024-09-12T22:11:27.333 INFO:tasks.workunit.client.0.smithi019.stdout:8/343: dread - d5/f51 zero size 2024-09-12T22:11:27.334 INFO:tasks.workunit.client.0.smithi019.stdout:7/383: symlink da/d24/l81 0 2024-09-12T22:11:27.335 INFO:tasks.workunit.client.0.smithi019.stdout:8/344: creat d5/dc/d26/f73 x:0 0 0 2024-09-12T22:11:27.335 INFO:tasks.workunit.client.0.smithi019.stdout:4/339: dwrite d9/f2f [0,4194304] 0 2024-09-12T22:11:27.335 INFO:tasks.workunit.client.0.smithi019.stdout:7/384: rename da/d30 to da/d30/d53/d82 22 2024-09-12T22:11:27.336 INFO:tasks.workunit.client.0.smithi019.stdout:4/340: write d9/d17/f4f [518822,34981] 0 2024-09-12T22:11:27.336 INFO:tasks.workunit.client.0.smithi019.stdout:8/345: mkdir d5/d16/d19/d74 0 2024-09-12T22:11:27.336 INFO:tasks.workunit.client.0.smithi019.stdout:7/385: chown da/d19/f41 265116 1 2024-09-12T22:11:27.337 INFO:tasks.workunit.client.0.smithi019.stdout:2/263: dread d0/d3/df/d18/d2c/d2d/f54 [0,4194304] 0 2024-09-12T22:11:27.337 INFO:tasks.workunit.client.0.smithi019.stdout:6/373: truncate d9/dc/d20/f32 499435 0 2024-09-12T22:11:27.338 INFO:tasks.workunit.client.0.smithi019.stdout:5/376: truncate d0/d24/f36 335769 0 2024-09-12T22:11:27.338 INFO:tasks.workunit.client.0.smithi019.stdout:0/364: write d5/d7/f11 [716985,98315] 0 2024-09-12T22:11:27.338 INFO:tasks.workunit.client.0.smithi019.stdout:9/323: dread fe [4194304,4194304] 0 2024-09-12T22:11:27.339 INFO:tasks.workunit.client.0.smithi019.stdout:2/264: chown d0/d31/d12/d15/f33 9 1 2024-09-12T22:11:27.339 INFO:tasks.workunit.client.0.smithi019.stdout:4/341: fsync d9/ff 0 2024-09-12T22:11:27.339 INFO:tasks.workunit.client.0.smithi019.stdout:7/386: unlink da/d24/d28/d1c/d32/d5e/c63 0 2024-09-12T22:11:27.339 INFO:tasks.workunit.client.0.smithi019.stdout:1/382: dwrite d1/d2/d18/d35/d84/dc/df/d53/d66/f8c [0,4194304] 0 2024-09-12T22:11:27.340 INFO:tasks.workunit.client.0.smithi019.stdout:5/377: write d0/f4 [3790602,65257] 0 2024-09-12T22:11:27.341 INFO:tasks.workunit.client.0.smithi019.stdout:4/342: fdatasync d9/db/d2b/f30 0 2024-09-12T22:11:27.341 INFO:tasks.workunit.client.0.smithi019.stdout:0/365: creat d5/d7/d2c/d44/f74 x:0 0 0 2024-09-12T22:11:27.343 INFO:tasks.workunit.client.0.smithi019.stdout:1/383: read d1/d37/f64 [798806,84587] 0 2024-09-12T22:11:27.345 INFO:tasks.workunit.client.0.smithi019.stdout:5/378: creat d0/d24/f7d x:0 0 0 2024-09-12T22:11:27.345 INFO:tasks.workunit.client.0.smithi019.stdout:2/265: rename d0/d3/d11/f19 to d0/d31/d12/d3b/f55 0 2024-09-12T22:11:27.345 INFO:tasks.workunit.client.0.smithi019.stdout:0/366: rmdir d5/d7/d10/d26/d2a 39 2024-09-12T22:11:27.346 INFO:tasks.workunit.client.0.smithi019.stdout:4/343: mknod d9/d14/d33/d4e/d66/c71 0 2024-09-12T22:11:27.347 INFO:tasks.workunit.client.0.smithi019.stdout:2/266: chown d0/d3/d21 958457 1 2024-09-12T22:11:27.348 INFO:tasks.workunit.client.0.smithi019.stdout:5/379: creat d0/d24/d7a/f7e x:0 0 0 2024-09-12T22:11:27.348 INFO:tasks.workunit.client.0.smithi019.stdout:8/346: dwrite d5/dc/d26/f41 [0,4194304] 0 2024-09-12T22:11:27.348 INFO:tasks.workunit.client.0.smithi019.stdout:1/384: symlink d1/d2/d18/d35/d84/d6e/l8d 0 2024-09-12T22:11:27.349 INFO:tasks.workunit.client.0.smithi019.stdout:0/367: creat d5/d7/d2c/f75 x:0 0 0 2024-09-12T22:11:27.350 INFO:tasks.workunit.client.0.smithi019.stdout:9/324: dread d12/d1b/d20/d25/f49 [0,4194304] 0 2024-09-12T22:11:27.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/374: dwrite d9/dc/d20/d30/d5b/f63 [0,4194304] 0 2024-09-12T22:11:27.350 INFO:tasks.workunit.client.0.smithi019.stdout:8/347: dread - d5/d16/d19/f5b zero size 2024-09-12T22:11:27.351 INFO:tasks.workunit.client.0.smithi019.stdout:2/267: mkdir d0/d3/df/d18/d2c/d56 0 2024-09-12T22:11:27.351 INFO:tasks.workunit.client.0.smithi019.stdout:7/387: dwrite da/d19/f41 [0,4194304] 0 2024-09-12T22:11:27.351 INFO:tasks.workunit.client.0.smithi019.stdout:0/368: stat d5/d7/de/f31 0 2024-09-12T22:11:27.351 INFO:tasks.workunit.client.0.smithi019.stdout:5/380: write d0/d1d/f20 [2143776,47384] 0 2024-09-12T22:11:27.355 INFO:tasks.workunit.client.0.smithi019.stdout:9/325: creat d12/d1b/d40/f6f x:0 0 0 2024-09-12T22:11:27.355 INFO:tasks.workunit.client.0.smithi019.stdout:2/268: chown d0/d3/d11/d2e/c53 9 1 2024-09-12T22:11:27.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/375: creat d9/dc/d20/d4b/d7a/f80 x:0 0 0 2024-09-12T22:11:27.355 INFO:tasks.workunit.client.0.smithi019.stdout:5/381: creat d0/d26/d42/f7f x:0 0 0 2024-09-12T22:11:27.355 INFO:tasks.workunit.client.0.smithi019.stdout:1/385: creat d1/d2/d18/d35/d84/dc/df/d2c/d5d/f8e x:0 0 0 2024-09-12T22:11:27.356 INFO:tasks.workunit.client.0.smithi019.stdout:7/388: chown da/d19/d25/f2e 10 1 2024-09-12T22:11:27.356 INFO:tasks.workunit.client.0.smithi019.stdout:0/369: mkdir d5/d7/d2c/d44/d6a/d76 0 2024-09-12T22:11:27.356 INFO:tasks.workunit.client.0.smithi019.stdout:9/326: write d12/f17 [3698492,22941] 0 2024-09-12T22:11:27.356 INFO:tasks.workunit.client.0.smithi019.stdout:6/376: stat d9/dc/d20/d4b/f75 0 2024-09-12T22:11:27.356 INFO:tasks.workunit.client.0.smithi019.stdout:2/269: creat d0/d3/df/d18/d2c/d2d/f57 x:0 0 0 2024-09-12T22:11:27.357 INFO:tasks.workunit.client.0.smithi019.stdout:7/389: write da/d19/d25/d39/d51/f75 [284845,20954] 0 2024-09-12T22:11:27.357 INFO:tasks.workunit.client.0.smithi019.stdout:5/382: symlink d0/d26/d5f/l80 0 2024-09-12T22:11:27.357 INFO:tasks.workunit.client.0.smithi019.stdout:9/327: creat d12/d1b/d40/f70 x:0 0 0 2024-09-12T22:11:27.357 INFO:tasks.workunit.client.0.smithi019.stdout:6/377: symlink d9/dc/d20/d4b/d64/d7d/l81 0 2024-09-12T22:11:27.357 INFO:tasks.workunit.client.0.smithi019.stdout:2/270: fsync d0/d31/d12/d15/f33 0 2024-09-12T22:11:27.357 INFO:tasks.workunit.client.0.smithi019.stdout:5/383: read - d0/d1d/f44 zero size 2024-09-12T22:11:27.358 INFO:tasks.workunit.client.0.smithi019.stdout:1/386: chown d1/d2/d18/d35/d84/dc/df/d53/d55/d56/l57 26 1 2024-09-12T22:11:27.358 INFO:tasks.workunit.client.0.smithi019.stdout:6/378: chown d9/dc/d20/d4b/f28 167947190 1 2024-09-12T22:11:27.359 INFO:tasks.workunit.client.0.smithi019.stdout:5/384: chown d0/c21 1593 1 2024-09-12T22:11:27.359 INFO:tasks.workunit.client.0.smithi019.stdout:7/390: link da/d24/d28/f15 da/f83 0 2024-09-12T22:11:27.360 INFO:tasks.workunit.client.0.smithi019.stdout:2/271: symlink d0/d31/l58 0 2024-09-12T22:11:27.360 INFO:tasks.workunit.client.0.smithi019.stdout:8/348: dread d5/dc/d26/f3a [0,4194304] 0 2024-09-12T22:11:27.360 INFO:tasks.workunit.client.0.smithi019.stdout:4/344: dread d9/d14/d33/d4e/f53 [0,4194304] 0 2024-09-12T22:11:27.361 INFO:tasks.workunit.client.0.smithi019.stdout:3/388: dread d18/d1d/f2a [0,4194304] 0 2024-09-12T22:11:27.361 INFO:tasks.workunit.client.0.smithi019.stdout:0/370: dwrite d5/f41 [0,4194304] 0 2024-09-12T22:11:27.361 INFO:tasks.workunit.client.0.smithi019.stdout:1/387: chown d1/d2/d18/d35/d84/dc/df/d2c/d5d/c6d 30 1 2024-09-12T22:11:27.362 INFO:tasks.workunit.client.0.smithi019.stdout:2/272: write d0/d3/d11/f10 [1328413,14172] 0 2024-09-12T22:11:27.362 INFO:tasks.workunit.client.0.smithi019.stdout:7/391: stat da/d19/d25/d39/d51/c67 0 2024-09-12T22:11:27.362 INFO:tasks.workunit.client.0.smithi019.stdout:6/379: creat d9/d6b/f82 x:0 0 0 2024-09-12T22:11:27.362 INFO:tasks.workunit.client.0.smithi019.stdout:9/328: rename d12/d1b/d20/c54 to d12/d1b/d20/d29/c71 0 2024-09-12T22:11:27.362 INFO:tasks.workunit.client.0.smithi019.stdout:2/273: fdatasync d0/d31/d12/f1b 0 2024-09-12T22:11:27.363 INFO:tasks.workunit.client.0.smithi019.stdout:0/371: readlink d5/d7/l51 0 2024-09-12T22:11:27.364 INFO:tasks.workunit.client.0.smithi019.stdout:8/349: mknod d5/dc/c75 0 2024-09-12T22:11:27.364 INFO:tasks.workunit.client.0.smithi019.stdout:1/388: readlink d1/d2/d18/d35/d84/dc/df/l21 0 2024-09-12T22:11:27.364 INFO:tasks.workunit.client.0.smithi019.stdout:6/380: creat d9/d3d/d6f/f83 x:0 0 0 2024-09-12T22:11:27.366 INFO:tasks.workunit.client.0.smithi019.stdout:2/274: write d0/d31/d12/f17 [2051474,59383] 0 2024-09-12T22:11:27.366 INFO:tasks.workunit.client.0.smithi019.stdout:8/350: mkdir d5/dc/d26/d76 0 2024-09-12T22:11:27.366 INFO:tasks.workunit.client.0.smithi019.stdout:4/345: link d9/d17/l5b d9/db/l72 0 2024-09-12T22:11:27.366 INFO:tasks.workunit.client.0.smithi019.stdout:5/385: getdents d0/d26/d5f 0 2024-09-12T22:11:27.366 INFO:tasks.workunit.client.0.smithi019.stdout:0/372: write d5/d7/f12 [679668,62190] 0 2024-09-12T22:11:27.366 INFO:tasks.workunit.client.0.smithi019.stdout:2/275: sync 2024-09-12T22:11:27.367 INFO:tasks.workunit.client.0.smithi019.stdout:6/381: write d9/d3d/f61 [9482,129925] 0 2024-09-12T22:11:27.367 INFO:tasks.workunit.client.0.smithi019.stdout:0/373: readlink d5/d7/l49 0 2024-09-12T22:11:27.367 INFO:tasks.workunit.client.0.smithi019.stdout:4/346: mkdir d9/d73 0 2024-09-12T22:11:27.367 INFO:tasks.workunit.client.0.smithi019.stdout:5/386: write d0/f3 [2767030,116096] 0 2024-09-12T22:11:27.368 INFO:tasks.workunit.client.0.smithi019.stdout:2/276: mknod d0/d31/d12/d3b/c59 0 2024-09-12T22:11:27.368 INFO:tasks.workunit.client.0.smithi019.stdout:9/329: dwrite d12/f1a [0,4194304] 0 2024-09-12T22:11:27.369 INFO:tasks.workunit.client.0.smithi019.stdout:5/387: chown d0/l2c 137 1 2024-09-12T22:11:27.372 INFO:tasks.workunit.client.0.smithi019.stdout:2/277: chown d0/d31/d4/d7/f45 3 1 2024-09-12T22:11:27.372 INFO:tasks.workunit.client.0.smithi019.stdout:6/382: rename d9/dc/d20/d30 to d9/dc/d20/d30/d5b/d84 22 2024-09-12T22:11:27.372 INFO:tasks.workunit.client.0.smithi019.stdout:5/388: write d0/f19 [448229,43595] 0 2024-09-12T22:11:27.373 INFO:tasks.workunit.client.0.smithi019.stdout:2/278: read d0/d3/d11/f10 [4865093,120706] 0 2024-09-12T22:11:27.373 INFO:tasks.workunit.client.0.smithi019.stdout:9/330: getdents d12/d1b/d40 0 2024-09-12T22:11:27.374 INFO:tasks.workunit.client.0.smithi019.stdout:5/389: rmdir d0/d1d 39 2024-09-12T22:11:27.375 INFO:tasks.workunit.client.0.smithi019.stdout:8/351: dwrite d5/dc/d26/f41 [0,4194304] 0 2024-09-12T22:11:27.375 INFO:tasks.workunit.client.0.smithi019.stdout:1/389: dread d1/d2/d18/d35/d84/dc/df/d61/f52 [0,4194304] 0 2024-09-12T22:11:27.376 INFO:tasks.workunit.client.0.smithi019.stdout:9/331: dread - d12/d1b/d40/f5e zero size 2024-09-12T22:11:27.376 INFO:tasks.workunit.client.0.smithi019.stdout:5/390: chown d0/d24/d7a 123 1 2024-09-12T22:11:27.376 INFO:tasks.workunit.client.0.smithi019.stdout:2/279: write d0/f42 [1553,44601] 0 2024-09-12T22:11:27.377 INFO:tasks.workunit.client.0.smithi019.stdout:4/347: dwrite d9/d58/f68 [0,4194304] 0 2024-09-12T22:11:27.378 INFO:tasks.workunit.client.0.smithi019.stdout:0/374: dwrite d5/d7/d2c/d44/d6a/d46/f5c [0,4194304] 0 2024-09-12T22:11:27.378 INFO:tasks.workunit.client.0.smithi019.stdout:9/332: chown d12/d1b/d20/d59 1179211735 1 2024-09-12T22:11:27.378 INFO:tasks.workunit.client.0.smithi019.stdout:2/280: fdatasync d0/d31/d12/f1b 0 2024-09-12T22:11:27.378 INFO:tasks.workunit.client.0.smithi019.stdout:5/391: read - d0/d4e/d50/f7c zero size 2024-09-12T22:11:27.380 INFO:tasks.workunit.client.0.smithi019.stdout:6/383: rename d9/c10 to d9/dc/d20/d4b/d64/c85 0 2024-09-12T22:11:27.382 INFO:tasks.workunit.client.0.smithi019.stdout:6/384: write d9/dc/d20/f14 [864058,119520] 0 2024-09-12T22:11:27.382 INFO:tasks.workunit.client.0.smithi019.stdout:5/392: getdents d0/d26/d5f 0 2024-09-12T22:11:27.382 INFO:tasks.workunit.client.0.smithi019.stdout:4/348: rename d9/c51 to d9/d14/d33/d4e/d66/c74 0 2024-09-12T22:11:27.382 INFO:tasks.workunit.client.0.smithi019.stdout:4/349: sync 2024-09-12T22:11:27.383 INFO:tasks.workunit.client.0.smithi019.stdout:8/352: link d5/dc/d26/l3b d5/l77 0 2024-09-12T22:11:27.383 INFO:tasks.workunit.client.0.smithi019.stdout:8/353: sync 2024-09-12T22:11:27.383 INFO:tasks.workunit.client.0.smithi019.stdout:1/390: dread d1/d2/d18/d35/d84/dc/df/d53/d66/f8c [0,4194304] 0 2024-09-12T22:11:27.384 INFO:tasks.workunit.client.0.smithi019.stdout:2/281: rename d0/d31/d4/f24 to d0/d3/df/d18/d2c/f5a 0 2024-09-12T22:11:27.384 INFO:tasks.workunit.client.0.smithi019.stdout:6/385: fsync d9/dc/f44 0 2024-09-12T22:11:27.386 INFO:tasks.workunit.client.0.smithi019.stdout:4/350: symlink d9/db/d2b/d6a/l75 0 2024-09-12T22:11:27.393 INFO:tasks.workunit.client.0.smithi019.stdout:9/333: dwrite fe [0,4194304] 0 2024-09-12T22:11:27.393 INFO:tasks.workunit.client.0.smithi019.stdout:4/351: fsync d9/fc 0 2024-09-12T22:11:27.393 INFO:tasks.workunit.client.0.smithi019.stdout:1/391: fdatasync d1/d2/d18/d35/d84/dc/df/d2c/d5d/f8e 0 2024-09-12T22:11:27.393 INFO:tasks.workunit.client.0.smithi019.stdout:5/393: dwrite d0/f19 [0,4194304] 0 2024-09-12T22:11:27.393 INFO:tasks.workunit.client.0.smithi019.stdout:7/392: dread da/d30/d53/f64 [0,4194304] 0 2024-09-12T22:11:27.395 INFO:tasks.workunit.client.0.smithi019.stdout:7/393: dread - da/f76 zero size 2024-09-12T22:11:27.395 INFO:tasks.workunit.client.0.smithi019.stdout:8/354: dwrite d5/dc/d17/f72 [0,4194304] 0 2024-09-12T22:11:27.396 INFO:tasks.workunit.client.0.smithi019.stdout:0/375: dwrite d5/f16 [8388608,4194304] 0 2024-09-12T22:11:27.396 INFO:tasks.workunit.client.0.smithi019.stdout:4/352: readlink d9/d17/l5b 0 2024-09-12T22:11:27.396 INFO:tasks.workunit.client.0.smithi019.stdout:2/282: dwrite d0/d31/d12/d15/f33 [0,4194304] 0 2024-09-12T22:11:27.398 INFO:tasks.workunit.client.0.smithi019.stdout:9/334: rename d12/c14 to d12/d1b/d20/d59/c72 0 2024-09-12T22:11:27.398 INFO:tasks.workunit.client.0.smithi019.stdout:0/376: mknod d5/d7/de/c77 0 2024-09-12T22:11:27.398 INFO:tasks.workunit.client.0.smithi019.stdout:8/355: symlink d5/d16/d19/l78 0 2024-09-12T22:11:27.399 INFO:tasks.workunit.client.0.smithi019.stdout:5/394: write d0/d1d/d4f/f1a [977125,27969] 0 2024-09-12T22:11:27.401 INFO:tasks.workunit.client.0.smithi019.stdout:0/377: rmdir d5/d7/de 39 2024-09-12T22:11:27.402 INFO:tasks.workunit.client.0.smithi019.stdout:9/335: readlink d12/d1b/d20/l4f 0 2024-09-12T22:11:27.402 INFO:tasks.workunit.client.0.smithi019.stdout:2/283: chown d0/d31/d12/d3b/f55 178029 1 2024-09-12T22:11:27.402 INFO:tasks.workunit.client.0.smithi019.stdout:3/389: dread d18/f1b [0,4194304] 0 2024-09-12T22:11:27.402 INFO:tasks.workunit.client.0.smithi019.stdout:6/386: dwrite d9/f22 [4194304,4194304] 0 2024-09-12T22:11:27.402 INFO:tasks.workunit.client.0.smithi019.stdout:5/395: mknod d0/d26/d6f/c81 0 2024-09-12T22:11:27.402 INFO:tasks.workunit.client.0.smithi019.stdout:3/390: fdatasync f15 0 2024-09-12T22:11:27.403 INFO:tasks.workunit.client.0.smithi019.stdout:7/394: creat da/d24/d28/d1c/d32/d5e/d73/f84 x:0 0 0 2024-09-12T22:11:27.403 INFO:tasks.workunit.client.0.smithi019.stdout:9/336: chown d12/d1b/f1c 774852 1 2024-09-12T22:11:27.403 INFO:tasks.workunit.client.0.smithi019.stdout:2/284: write d0/d31/d4/d7/f45 [987338,113271] 0 2024-09-12T22:11:27.403 INFO:tasks.workunit.client.0.smithi019.stdout:0/378: fsync d5/d7/d10/d26/f71 0 2024-09-12T22:11:27.404 INFO:tasks.workunit.client.0.smithi019.stdout:6/387: rmdir d9/d3d/d6f 39 2024-09-12T22:11:27.404 INFO:tasks.workunit.client.0.smithi019.stdout:7/395: chown da/d19/l21 1434921589 1 2024-09-12T22:11:27.404 INFO:tasks.workunit.client.0.smithi019.stdout:6/388: sync 2024-09-12T22:11:27.405 INFO:tasks.workunit.client.0.smithi019.stdout:2/285: creat d0/d3/d11/f5b x:0 0 0 2024-09-12T22:11:27.405 INFO:tasks.workunit.client.0.smithi019.stdout:3/391: read d18/d1d/f2f [111630,50240] 0 2024-09-12T22:11:27.405 INFO:tasks.workunit.client.0.smithi019.stdout:4/353: dread d9/d14/f38 [0,4194304] 0 2024-09-12T22:11:27.405 INFO:tasks.workunit.client.0.smithi019.stdout:0/379: mknod d5/d7/d10/c78 0 2024-09-12T22:11:27.405 INFO:tasks.workunit.client.0.smithi019.stdout:8/356: dread d5/dc/d17/f67 [0,4194304] 0 2024-09-12T22:11:27.406 INFO:tasks.workunit.client.0.smithi019.stdout:0/380: write d5/d7/f5f [527378,13612] 0 2024-09-12T22:11:27.406 INFO:tasks.workunit.client.0.smithi019.stdout:7/396: symlink da/d19/l85 0 2024-09-12T22:11:27.407 INFO:tasks.workunit.client.0.smithi019.stdout:5/396: link d0/d24/c38 d0/d1d/d3d/c82 0 2024-09-12T22:11:27.407 INFO:tasks.workunit.client.0.smithi019.stdout:8/357: write d5/d53/d66/f6f [989112,125982] 0 2024-09-12T22:11:27.407 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:27.407 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:27.408 INFO:tasks.workunit.client.0.smithi019.stdout:4/354: mkdir d9/d4c/d76 0 2024-09-12T22:11:27.408 INFO:tasks.workunit.client.0.smithi019.stdout:6/389: rename d9/d3d/d6f/f83 to d9/d3d/d6f/f86 0 2024-09-12T22:11:27.408 INFO:tasks.workunit.client.0.smithi019.stdout:2/286: mkdir d0/d31/d12/d3b/d5c 0 2024-09-12T22:11:27.408 INFO:tasks.workunit.client.0.smithi019.stdout:0/381: mknod d5/d7/d2c/c79 0 2024-09-12T22:11:27.408 INFO:tasks.workunit.client.0.smithi019.stdout:5/397: dread - d0/d24/d58/f66 zero size 2024-09-12T22:11:27.409 INFO:tasks.workunit.client.0.smithi019.stdout:4/355: creat d9/d58/f77 x:0 0 0 2024-09-12T22:11:27.409 INFO:tasks.workunit.client.0.smithi019.stdout:8/358: creat d5/dc/d26/d4b/f79 x:0 0 0 2024-09-12T22:11:27.409 INFO:tasks.workunit.client.0.smithi019.stdout:8/359: sync 2024-09-12T22:11:27.410 INFO:tasks.workunit.client.0.smithi019.stdout:5/398: mknod d0/d26/d6f/c83 0 2024-09-12T22:11:27.410 INFO:tasks.workunit.client.0.smithi019.stdout:6/390: creat d9/dc/d20/d4b/d64/d7e/f87 x:0 0 0 2024-09-12T22:11:27.410 INFO:tasks.workunit.client.0.smithi019.stdout:8/360: mkdir d5/dc/d26/d43/d49/d7a 0 2024-09-12T22:11:27.411 INFO:tasks.workunit.client.0.smithi019.stdout:7/397: link da/d24/d28/d1c/c3e da/d24/d28/d1c/c86 0 2024-09-12T22:11:27.412 INFO:tasks.workunit.client.0.smithi019.stdout:0/382: getdents d5/d7/d10/d26/d2a 0 2024-09-12T22:11:27.412 INFO:tasks.workunit.client.0.smithi019.stdout:2/287: rename d0/d31/d12/d15/l3e to d0/d31/d12/d3b/l5d 0 2024-09-12T22:11:27.412 INFO:tasks.workunit.client.0.smithi019.stdout:5/399: mknod d0/d1d/d4f/d47/d57/c84 0 2024-09-12T22:11:27.413 INFO:tasks.workunit.client.0.smithi019.stdout:9/337: read d12/f23 [71496,24832] 0 2024-09-12T22:11:27.413 INFO:tasks.workunit.client.0.smithi019.stdout:8/361: mknod d5/d16/d19/d32/c7b 0 2024-09-12T22:11:27.415 INFO:tasks.workunit.client.0.smithi019.stdout:5/400: creat d0/d4e/d50/f85 x:0 0 0 2024-09-12T22:11:27.416 INFO:tasks.workunit.client.0.smithi019.stdout:2/288: read d0/d3/df/d18/d2c/f5a [116957,54187] 0 2024-09-12T22:11:27.416 INFO:tasks.workunit.client.0.smithi019.stdout:8/362: rmdir d5/dc/d26/d5c 39 2024-09-12T22:11:27.416 INFO:tasks.workunit.client.0.smithi019.stdout:4/356: dread d9/d14/d33/f4b [0,4194304] 0 2024-09-12T22:11:27.416 INFO:tasks.workunit.client.0.smithi019.stdout:9/338: rename d12/d1b/c4a to d12/d1b/d40/c73 0 2024-09-12T22:11:27.417 INFO:tasks.workunit.client.0.smithi019.stdout:1/392: dread d1/f14 [0,4194304] 0 2024-09-12T22:11:27.418 INFO:tasks.workunit.client.0.smithi019.stdout:7/398: dread da/d19/d25/d39/d51/f6c [0,4194304] 0 2024-09-12T22:11:27.419 INFO:tasks.workunit.client.0.smithi019.stdout:6/391: dwrite d9/dc/f74 [4194304,4194304] 0 2024-09-12T22:11:27.420 INFO:tasks.workunit.client.0.smithi019.stdout:5/401: rename d0/l2c to d0/d26/d3a/l86 0 2024-09-12T22:11:27.421 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:27.421 INFO:tasks.workunit.client.0.smithi019.stdout:9/339: mkdir d12/d1b/d20/d29/d74 0 2024-09-12T22:11:27.421 INFO:tasks.workunit.client.0.smithi019.stdout:8/363: write d5/d16/d19/f31 [3242376,122554] 0 2024-09-12T22:11:27.422 INFO:tasks.workunit.client.0.smithi019.stdout:0/383: dwrite d5/d7/d10/f5e [0,4194304] 0 2024-09-12T22:11:27.422 INFO:tasks.workunit.client.0.smithi019.stdout:1/393: creat d1/d2/d18/d35/d84/dc/df/d53/d55/f8f x:0 0 0 2024-09-12T22:11:27.423 INFO:tasks.workunit.client.0.smithi019.stdout:9/340: mkdir d12/d1b/d40/d52/d75 0 2024-09-12T22:11:27.424 INFO:tasks.workunit.client.0.smithi019.stdout:8/364: chown d5/d16/d19/d32/c7b 17206 1 2024-09-12T22:11:27.424 INFO:tasks.workunit.client.0.smithi019.stdout:5/402: creat d0/d24/d58/f87 x:0 0 0 2024-09-12T22:11:27.424 INFO:tasks.workunit.client.0.smithi019.stdout:1/394: chown d1/f11 86177 1 2024-09-12T22:11:27.424 INFO:tasks.workunit.client.0.smithi019.stdout:9/341: stat d12/d1b/d40/f70 0 2024-09-12T22:11:27.425 INFO:tasks.workunit.client.0.smithi019.stdout:8/365: chown d5/dc/c75 76529755 1 2024-09-12T22:11:27.425 INFO:tasks.workunit.client.0.smithi019.stdout:6/392: getdents d9/dc/d20/d4b/d64/d7d 0 2024-09-12T22:11:27.425 INFO:tasks.workunit.client.0.smithi019.stdout:0/384: mknod d5/d7/d2c/d44/d6a/d76/c7a 0 2024-09-12T22:11:27.426 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.425+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.427 INFO:tasks.workunit.client.0.smithi019.stdout:2/289: dwrite d0/d31/d4/f22 [0,4194304] 0 2024-09-12T22:11:27.427 INFO:tasks.workunit.client.0.smithi019.stdout:8/366: write d5/dc/f2e [1603683,71453] 0 2024-09-12T22:11:27.428 INFO:tasks.workunit.client.0.smithi019.stdout:6/393: creat d9/dc/d20/d71/f88 x:0 0 0 2024-09-12T22:11:27.429 INFO:tasks.workunit.client.0.smithi019.stdout:0/385: creat d5/d7/d2c/d44/d6a/d52/f7b x:0 0 0 2024-09-12T22:11:27.429 INFO:tasks.workunit.client.0.smithi019.stdout:8/367: unlink d5/d16/d19/f71 0 2024-09-12T22:11:27.429 INFO:tasks.workunit.client.0.smithi019.stdout:1/395: truncate d1/d2/d18/d35/d84/dc/df/d61/f34 1041008 0 2024-09-12T22:11:27.430 INFO:tasks.workunit.client.0.smithi019.stdout:9/342: rename d12/d1b/d20/d37/f53 to d12/d1b/d20/d37/f76 0 2024-09-12T22:11:27.430 INFO:tasks.workunit.client.0.smithi019.stdout:0/386: write d5/f16 [12335389,29894] 0 2024-09-12T22:11:27.431 INFO:tasks.workunit.client.0.smithi019.stdout:7/399: dwrite da/d24/d28/d1c/d32/d5e/d73/f84 [0,4194304] 0 2024-09-12T22:11:27.431 INFO:tasks.workunit.client.0.smithi019.stdout:9/343: write d12/f45 [980211,50648] 0 2024-09-12T22:11:27.433 INFO:tasks.workunit.client.0.smithi019.stdout:6/394: write d9/d3d/d6f/f65 [1283793,8687] 0 2024-09-12T22:11:27.433 INFO:tasks.workunit.client.0.smithi019.stdout:7/400: stat da/d30 0 2024-09-12T22:11:27.433 INFO:tasks.workunit.client.0.smithi019.stdout:1/396: chown d1/d2/d18/d29/l5b 15 1 2024-09-12T22:11:27.433 INFO:tasks.workunit.client.0.smithi019.stdout:5/403: read d0/d1d/d4f/d47/f5d [1869949,14795] 0 2024-09-12T22:11:27.434 INFO:tasks.workunit.client.0.smithi019.stdout:0/387: readlink d5/d7/d10/l56 0 2024-09-12T22:11:27.435 INFO:tasks.workunit.client.0.smithi019.stdout:8/368: creat d5/dc/f7c x:0 0 0 2024-09-12T22:11:27.435 INFO:tasks.workunit.client.0.smithi019.stdout:7/401: rmdir da/d24 39 2024-09-12T22:11:27.435 INFO:tasks.workunit.client.0.smithi019.stdout:5/404: write d0/d1d/f20 [2117390,2062] 0 2024-09-12T22:11:27.435 INFO:tasks.workunit.client.0.smithi019.stdout:6/395: unlink d9/d3d/d4f/d59/c69 0 2024-09-12T22:11:27.436 INFO:tasks.workunit.client.0.smithi019.stdout:3/392: dread f16 [4194304,4194304] 0 2024-09-12T22:11:27.436 INFO:tasks.workunit.client.0.smithi019.stdout:1/397: rmdir d1/d2/d18/d29/d51 39 2024-09-12T22:11:27.436 INFO:tasks.workunit.client.0.smithi019.stdout:0/388: unlink d5/d7/d10/d26/f6f 0 2024-09-12T22:11:27.437 INFO:tasks.workunit.client.0.smithi019.stdout:5/405: symlink d0/d1d/d3d/l88 0 2024-09-12T22:11:27.437 INFO:tasks.workunit.client.0.smithi019.stdout:6/396: readlink d9/dc/d20/d30/l60 0 2024-09-12T22:11:27.437 INFO:tasks.workunit.client.0.smithi019.stdout:8/369: unlink d5/d16/l24 0 2024-09-12T22:11:27.438 INFO:tasks.workunit.client.0.smithi019.stdout:5/406: chown d0/d26/d6f/f74 24078 1 2024-09-12T22:11:27.438 INFO:tasks.workunit.client.0.smithi019.stdout:0/389: creat d5/d7/d2c/d44/d6a/d52/f7c x:0 0 0 2024-09-12T22:11:27.438 INFO:tasks.workunit.client.0.smithi019.stdout:8/370: chown d5/d16/d19/d29/l46 61047 1 2024-09-12T22:11:27.438 INFO:tasks.workunit.client.0.smithi019.stdout:6/397: rename d9/d3d/c39 to d9/dc/d20/d4b/d6c/c89 0 2024-09-12T22:11:27.439 INFO:tasks.workunit.client.0.smithi019.stdout:8/371: dread - d5/f51 zero size 2024-09-12T22:11:27.439 INFO:tasks.workunit.client.0.smithi019.stdout:1/398: rename d1/d2/d18/d35/d84/dc/df/d2c/c4e to d1/d2/d18/d35/d84/dc/df/d53/c90 0 2024-09-12T22:11:27.440 INFO:tasks.workunit.client.0.smithi019.stdout:6/398: readlink d9/dc/d20/d30/l45 0 2024-09-12T22:11:27.441 INFO:tasks.workunit.client.0.smithi019.stdout:5/407: link d0/d26/d3a/f68 d0/d26/d42/f89 0 2024-09-12T22:11:27.441 INFO:tasks.workunit.client.0.smithi019.stdout:5/408: chown d0/d4e 786 1 2024-09-12T22:11:27.442 INFO:tasks.workunit.client.0.smithi019.stdout:6/399: symlink d9/dc/d20/l8a 0 2024-09-12T22:11:27.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/393: dwrite d18/d26/d30/f67 [0,4194304] 0 2024-09-12T22:11:27.443 INFO:tasks.workunit.client.0.smithi019.stdout:6/400: fsync d9/fa 0 2024-09-12T22:11:27.444 INFO:tasks.workunit.client.0.smithi019.stdout:5/409: rename d0/d26/d3a/f73 to d0/d26/d6f/f8a 0 2024-09-12T22:11:27.444 INFO:tasks.workunit.client.0.smithi019.stdout:6/401: readlink d9/dc/d20/l4c 0 2024-09-12T22:11:27.444 INFO:tasks.workunit.client.0.smithi019.stdout:5/410: read - d0/d1d/f44 zero size 2024-09-12T22:11:27.444 INFO:tasks.workunit.client.0.smithi019.stdout:3/394: write d18/d26/d30/d4a/f62 [988791,90246] 0 2024-09-12T22:11:27.446 INFO:tasks.workunit.client.0.smithi019.stdout:6/402: symlink d9/d3d/l8b 0 2024-09-12T22:11:27.446 INFO:tasks.workunit.client.0.smithi019.stdout:7/402: dread da/d19/f46 [0,4194304] 0 2024-09-12T22:11:27.446 INFO:tasks.workunit.client.0.smithi019.stdout:0/390: truncate d5/d7/f12 1598781 0 2024-09-12T22:11:27.447 INFO:tasks.workunit.client.0.smithi019.stdout:4/357: dread d9/d14/d31/d3f/f42 [0,4194304] 0 2024-09-12T22:11:27.447 INFO:tasks.workunit.client.0.smithi019.stdout:3/395: write d18/d26/d30/d71/f74 [772364,70936] 0 2024-09-12T22:11:27.448 INFO:tasks.workunit.client.0.smithi019.stdout:6/403: mkdir d9/dc/d20/d4b/d6c/d8c 0 2024-09-12T22:11:27.448 INFO:tasks.workunit.client.0.smithi019.stdout:1/399: truncate d1/d2/d18/d70/f7a 2859029 0 2024-09-12T22:11:27.449 INFO:tasks.workunit.client.0.smithi019.stdout:4/358: creat d9/d4c/f78 x:0 0 0 2024-09-12T22:11:27.449 INFO:tasks.workunit.client.0.smithi019.stdout:6/404: mkdir d9/d3d/d4f/d8d 0 2024-09-12T22:11:27.450 INFO:tasks.workunit.client.0.smithi019.stdout:3/396: getdents d18/d26/d30/d71 0 2024-09-12T22:11:27.450 INFO:tasks.workunit.client.0.smithi019.stdout:4/359: symlink d9/db/d2b/d6a/l79 0 2024-09-12T22:11:27.451 INFO:tasks.workunit.client.0.smithi019.stdout:6/405: rmdir d9/dc/d20/d4b/d64/d7d 39 2024-09-12T22:11:27.451 INFO:tasks.workunit.client.0.smithi019.stdout:1/400: getdents d1/d2/d18/d35 0 2024-09-12T22:11:27.452 INFO:tasks.workunit.client.0.smithi019.stdout:6/406: read - d9/d6b/f82 zero size 2024-09-12T22:11:27.452 INFO:tasks.workunit.client.0.smithi019.stdout:2/290: dread d0/d3/df/d18/d2c/f5a [0,4194304] 0 2024-09-12T22:11:27.452 INFO:tasks.workunit.client.0.smithi019.stdout:3/397: read d18/f28 [1113173,62438] 0 2024-09-12T22:11:27.453 INFO:tasks.workunit.client.0.smithi019.stdout:3/398: symlink d18/l77 0 2024-09-12T22:11:27.454 INFO:tasks.workunit.client.0.smithi019.stdout:3/399: readlink d18/d26/l6a 0 2024-09-12T22:11:27.454 INFO:tasks.workunit.client.0.smithi019.stdout:2/291: read d0/d3/df/f37 [1582404,16862] 0 2024-09-12T22:11:27.454 INFO:tasks.workunit.client.0.smithi019.stdout:6/407: creat d9/dc/d20/d4b/d64/d78/f8e x:0 0 0 2024-09-12T22:11:27.455 INFO:tasks.workunit.client.0.smithi019.stdout:1/401: write d1/d2/d18/d35/d84/dc/df/d61/f34 [381811,112853] 0 2024-09-12T22:11:27.455 INFO:tasks.workunit.client.0.smithi019.stdout:6/408: dread - d9/dc/d20/d4b/f28 zero size 2024-09-12T22:11:27.456 INFO:tasks.workunit.client.0.smithi019.stdout:1/402: symlink d1/d2/d18/d35/l91 0 2024-09-12T22:11:27.456 INFO:tasks.workunit.client.0.smithi019.stdout:3/400: chown d18/d26/d30/d4e/c51 102235 1 2024-09-12T22:11:27.457 INFO:tasks.workunit.client.0.smithi019.stdout:6/409: mkdir d9/dc/d20/d4b/d6c/d8c/d8f 0 2024-09-12T22:11:27.458 INFO:tasks.workunit.client.0.smithi019.stdout:7/403: dread da/d19/f50 [0,4194304] 0 2024-09-12T22:11:27.458 INFO:tasks.workunit.client.0.smithi019.stdout:2/292: getdents d0/d31/d12 0 2024-09-12T22:11:27.458 INFO:tasks.workunit.client.0.smithi019.stdout:9/344: dread d12/f17 [0,4194304] 0 2024-09-12T22:11:27.459 INFO:tasks.workunit.client.0.smithi019.stdout:2/293: chown d0/d31/c28 534537 1 2024-09-12T22:11:27.460 INFO:tasks.workunit.client.0.smithi019.stdout:1/403: truncate d1/d2/d18/d35/d84/dc/f32 770331 0 2024-09-12T22:11:27.461 INFO:tasks.workunit.client.0.smithi019.stdout:6/410: dread d9/dc/d20/d30/d5b/f6d [0,4194304] 0 2024-09-12T22:11:27.462 INFO:tasks.workunit.client.0.smithi019.stdout:9/345: mkdir d12/d1b/d20/d29/d74/d77 0 2024-09-12T22:11:27.463 INFO:tasks.workunit.client.0.smithi019.stdout:8/372: dread d5/dc/d26/f30 [0,4194304] 0 2024-09-12T22:11:27.463 INFO:tasks.workunit.client.0.smithi019.stdout:1/404: read d1/d2/d18/d35/d84/dc/f19 [2012562,67716] 0 2024-09-12T22:11:27.464 INFO:tasks.workunit.client.0.smithi019.stdout:3/401: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:27.464 INFO:tasks.workunit.client.0.smithi019.stdout:0/391: dread d5/d7/d2c/f47 [0,4194304] 0 2024-09-12T22:11:27.464 INFO:tasks.workunit.client.0.smithi019.stdout:1/405: chown d1/d83 130375 1 2024-09-12T22:11:27.465 INFO:tasks.workunit.client.0.smithi019.stdout:8/373: read - d5/dc/d26/d43/f6a zero size 2024-09-12T22:11:27.465 INFO:tasks.workunit.client.0.smithi019.stdout:7/404: rename da/f1d to da/d24/d28/d1c/d32/f87 0 2024-09-12T22:11:27.468 INFO:tasks.workunit.client.0.smithi019.stdout:4/360: dread d9/d14/d31/d3f/f48 [0,4194304] 0 2024-09-12T22:11:27.468 INFO:tasks.workunit.client.0.smithi019.stdout:8/374: unlink d5/dc/f65 0 2024-09-12T22:11:27.468 INFO:tasks.workunit.client.0.smithi019.stdout:1/406: dread d1/d2/d18/d35/d84/dc/df/d61/f1b [0,4194304] 0 2024-09-12T22:11:27.469 INFO:tasks.workunit.client.0.smithi019.stdout:6/411: creat d9/d3d/f90 x:0 0 0 2024-09-12T22:11:27.469 INFO:tasks.workunit.client.0.smithi019.stdout:6/412: fdatasync d9/fa 0 2024-09-12T22:11:27.470 INFO:tasks.workunit.client.0.smithi019.stdout:4/361: chown d9/d14/d57/d5e/c64 5 1 2024-09-12T22:11:27.471 INFO:tasks.workunit.client.0.smithi019.stdout:8/375: mkdir d5/dc/d26/d43/d7d 0 2024-09-12T22:11:27.471 INFO:tasks.workunit.client.0.smithi019.stdout:7/405: sync 2024-09-12T22:11:27.471 INFO:tasks.workunit.client.0.smithi019.stdout:4/362: write d9/f54 [4373501,67244] 0 2024-09-12T22:11:27.473 INFO:tasks.workunit.client.0.smithi019.stdout:5/411: dread d0/d1d/d4f/f2b [0,4194304] 0 2024-09-12T22:11:27.473 INFO:tasks.workunit.client.0.smithi019.stdout:3/402: write d18/d26/d30/f3c [2247108,54212] 0 2024-09-12T22:11:27.473 INFO:tasks.workunit.client.0.smithi019.stdout:9/346: dwrite d12/f15 [0,4194304] 0 2024-09-12T22:11:27.474 INFO:tasks.workunit.client.0.smithi019.stdout:6/413: rename d9/dc/d20/d30/d5b/f63 to d9/dc/d20/d4b/d6c/f91 0 2024-09-12T22:11:27.474 INFO:tasks.workunit.client.0.smithi019.stdout:8/376: creat d5/d16/d19/d32/f7e x:0 0 0 2024-09-12T22:11:27.476 INFO:tasks.workunit.client.0.smithi019.stdout:9/347: chown d12/c16 1426 1 2024-09-12T22:11:27.476 INFO:tasks.workunit.client.0.smithi019.stdout:2/294: read d0/d3/d11/f10 [3118875,42719] 0 2024-09-12T22:11:27.476 INFO:tasks.workunit.client.0.smithi019.stdout:3/403: mknod d18/d26/d30/c78 0 2024-09-12T22:11:27.477 INFO:tasks.workunit.client.0.smithi019.stdout:5/412: creat d0/d1d/d6d/f8b x:0 0 0 2024-09-12T22:11:27.478 INFO:tasks.workunit.client.0.smithi019.stdout:1/407: dwrite d1/d2/d18/d35/d84/dc/df/d2c/f49 [0,4194304] 0 2024-09-12T22:11:27.478 INFO:tasks.workunit.client.0.smithi019.stdout:2/295: dread - d0/d3/d11/d2e/f49 zero size 2024-09-12T22:11:27.479 INFO:tasks.workunit.client.0.smithi019.stdout:7/406: read da/d19/d25/d39/f61 [4131587,76464] 0 2024-09-12T22:11:27.481 INFO:tasks.workunit.client.0.smithi019.stdout:2/296: stat d0/d31/d12/d15/f33 0 2024-09-12T22:11:27.481 INFO:tasks.workunit.client.0.smithi019.stdout:3/404: symlink d18/d26/l79 0 2024-09-12T22:11:27.482 INFO:tasks.workunit.client.0.smithi019.stdout:7/407: chown da/d24/d28/f15 101 1 2024-09-12T22:11:27.482 INFO:tasks.workunit.client.0.smithi019.stdout:4/363: dwrite d9/d58/f77 [0,4194304] 0 2024-09-12T22:11:27.483 INFO:tasks.workunit.client.0.smithi019.stdout:9/348: link d12/d1b/d20/d25/f4c d12/d1b/d20/d25/f78 0 2024-09-12T22:11:27.483 INFO:tasks.workunit.client.0.smithi019.stdout:2/297: stat d0/d3/df 0 2024-09-12T22:11:27.484 INFO:tasks.workunit.client.0.smithi019.stdout:4/364: chown d9/l2a 11290553 1 2024-09-12T22:11:27.484 INFO:tasks.workunit.client.0.smithi019.stdout:8/377: dwrite d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:27.485 INFO:tasks.workunit.client.0.smithi019.stdout:3/405: write d18/f1b [1183208,14010] 0 2024-09-12T22:11:27.487 INFO:tasks.workunit.client.0.smithi019.stdout:7/408: creat da/d19/f88 x:0 0 0 2024-09-12T22:11:27.488 INFO:tasks.workunit.client.0.smithi019.stdout:4/365: unlink d9/d17/l5b 0 2024-09-12T22:11:27.488 INFO:tasks.workunit.client.0.smithi019.stdout:5/413: dwrite d0/d4e/d50/f7c [0,4194304] 0 2024-09-12T22:11:27.489 INFO:tasks.workunit.client.0.smithi019.stdout:9/349: rename d12/d1b/f43 to d12/d1b/d20/d29/d56/f79 0 2024-09-12T22:11:27.489 INFO:tasks.workunit.client.0.smithi019.stdout:3/406: write d18/d26/d30/d71/f74 [1108644,111305] 0 2024-09-12T22:11:27.489 INFO:tasks.workunit.client.0.smithi019.stdout:8/378: mkdir d5/d16/d19/d29/d7f 0 2024-09-12T22:11:27.490 INFO:tasks.workunit.client.0.smithi019.stdout:5/414: dread - d0/d1d/d4f/d47/f4a zero size 2024-09-12T22:11:27.491 INFO:tasks.workunit.client.0.smithi019.stdout:1/408: dwrite d1/d2/d18/d35/d84/dc/f19 [4194304,4194304] 0 2024-09-12T22:11:27.494 INFO:tasks.workunit.client.0.smithi019.stdout:9/350: unlink d12/f47 0 2024-09-12T22:11:27.494 INFO:tasks.workunit.client.0.smithi019.stdout:5/415: chown d0/d1d/f44 0 1 2024-09-12T22:11:27.495 INFO:tasks.workunit.client.0.smithi019.stdout:3/407: rename d18/d26/d30/d4a/c4d to d18/d1d/d35/c7a 0 2024-09-12T22:11:27.495 INFO:tasks.workunit.client.0.smithi019.stdout:2/298: dwrite d0/d3/d21/d36/f39 [0,4194304] 0 2024-09-12T22:11:27.495 INFO:tasks.workunit.client.0.smithi019.stdout:1/409: chown d1/d2/d18/d35/d84/d6e/l71 335261 1 2024-09-12T22:11:27.495 INFO:tasks.workunit.client.0.smithi019.stdout:8/379: write d5/dc/d17/f67 [232496,39055] 0 2024-09-12T22:11:27.495 INFO:tasks.workunit.client.0.smithi019.stdout:0/392: dread d5/d7/d10/f4d [0,4194304] 0 2024-09-12T22:11:27.499 INFO:tasks.workunit.client.0.smithi019.stdout:2/299: fdatasync d0/d31/d4/f3f 0 2024-09-12T22:11:27.499 INFO:tasks.workunit.client.0.smithi019.stdout:7/409: dwrite da/d19/f41 [4194304,4194304] 0 2024-09-12T22:11:27.501 INFO:tasks.workunit.client.0.smithi019.stdout:3/408: rename d18/f19 to d18/d58/f7b 0 2024-09-12T22:11:27.502 INFO:tasks.workunit.client.0.smithi019.stdout:8/380: truncate d5/dc/f7c 502238 0 2024-09-12T22:11:27.503 INFO:tasks.workunit.client.0.smithi019.stdout:2/300: mknod d0/d3/d21/d36/d44/c5e 0 2024-09-12T22:11:27.503 INFO:tasks.workunit.client.0.smithi019.stdout:3/409: symlink d18/d26/d30/d4a/l7c 0 2024-09-12T22:11:27.503 INFO:tasks.workunit.client.0.smithi019.stdout:6/414: dread d9/dc/d20/f14 [0,4194304] 0 2024-09-12T22:11:27.506 INFO:tasks.workunit.client.0.smithi019.stdout:0/393: link d5/d7/d10/d26/d2a/f2b d5/d7/d2c/d44/f7d 0 2024-09-12T22:11:27.506 INFO:tasks.workunit.client.0.smithi019.stdout:6/415: fdatasync d9/dc/f44 0 2024-09-12T22:11:27.506 INFO:tasks.workunit.client.0.smithi019.stdout:1/410: write d1/d2/d18/d35/d84/dc/df/d53/d55/f8f [1014565,99469] 0 2024-09-12T22:11:27.506 INFO:tasks.workunit.client.0.smithi019.stdout:4/366: dwrite f4 [0,4194304] 0 2024-09-12T22:11:27.506 INFO:tasks.workunit.client.0.smithi019.stdout:7/410: truncate da/d30/d53/f66 971186 0 2024-09-12T22:11:27.507 INFO:tasks.workunit.client.0.smithi019.stdout:9/351: dwrite d12/f45 [0,4194304] 0 2024-09-12T22:11:27.507 INFO:tasks.workunit.client.0.smithi019.stdout:5/416: dwrite d0/d1d/d4f/d47/d57/f6e [0,4194304] 0 2024-09-12T22:11:27.507 INFO:tasks.workunit.client.0.smithi019.stdout:3/410: mknod d18/d26/c7d 0 2024-09-12T22:11:27.508 INFO:tasks.workunit.client.0.smithi019.stdout:9/352: fsync f4 0 2024-09-12T22:11:27.508 INFO:tasks.workunit.client.0.smithi019.stdout:6/416: chown d9/d3d/d4f/c77 22468861 1 2024-09-12T22:11:27.509 INFO:tasks.workunit.client.0.smithi019.stdout:9/353: readlink d12/l3e 0 2024-09-12T22:11:27.509 INFO:tasks.workunit.client.0.smithi019.stdout:1/411: readlink d1/d2/d18/d35/d84/dc/df/l62 0 2024-09-12T22:11:27.510 INFO:tasks.workunit.client.0.smithi019.stdout:4/367: truncate d9/ff 2344853 0 2024-09-12T22:11:27.510 INFO:tasks.workunit.client.0.smithi019.stdout:5/417: rmdir d0/d26 39 2024-09-12T22:11:27.510 INFO:tasks.workunit.client.0.smithi019.stdout:0/394: creat d5/d7/d2c/d44/d6a/d76/f7e x:0 0 0 2024-09-12T22:11:27.510 INFO:tasks.workunit.client.0.smithi019.stdout:7/411: unlink da/l31 0 2024-09-12T22:11:27.511 INFO:tasks.workunit.client.0.smithi019.stdout:5/418: symlink d0/l8c 0 2024-09-12T22:11:27.512 INFO:tasks.workunit.client.0.smithi019.stdout:7/412: rmdir da/d24/d28/d1c 39 2024-09-12T22:11:27.513 INFO:tasks.workunit.client.0.smithi019.stdout:3/411: truncate d18/d26/d30/d4e/f59 1798825 0 2024-09-12T22:11:27.513 INFO:tasks.workunit.client.0.smithi019.stdout:1/412: truncate d1/d2/d18/d70/f7a 1569332 0 2024-09-12T22:11:27.514 INFO:tasks.workunit.client.0.smithi019.stdout:5/419: truncate d0/f29 5126499 0 2024-09-12T22:11:27.514 INFO:tasks.workunit.client.0.smithi019.stdout:2/301: dwrite d0/d31/d12/f17 [0,4194304] 0 2024-09-12T22:11:27.514 INFO:tasks.workunit.client.0.smithi019.stdout:4/368: rename d9/d14/d33/d4e/d66/c71 to d9/d6c/c7a 0 2024-09-12T22:11:27.517 INFO:tasks.workunit.client.0.smithi019.stdout:9/354: dread d12/d1b/d20/d29/f2d [0,4194304] 0 2024-09-12T22:11:27.517 INFO:tasks.workunit.client.0.smithi019.stdout:6/417: rename d9/dc/d20/d4b/d64/d7d/l81 to d9/d3d/d4f/d59/l92 0 2024-09-12T22:11:27.517 INFO:tasks.workunit.client.0.smithi019.stdout:5/420: truncate d0/d1d/d4f/d47/f70 186221 0 2024-09-12T22:11:27.517 INFO:tasks.workunit.client.0.smithi019.stdout:1/413: mknod d1/d83/c92 0 2024-09-12T22:11:27.517 INFO:tasks.workunit.client.0.smithi019.stdout:8/381: truncate d5/f6 3412869 0 2024-09-12T22:11:27.518 INFO:tasks.workunit.client.0.smithi019.stdout:3/412: link d18/d1d/d35/f6d d18/f7e 0 2024-09-12T22:11:27.518 INFO:tasks.workunit.client.0.smithi019.stdout:4/369: chown d9/db/d2b/f37 1237 1 2024-09-12T22:11:27.518 INFO:tasks.workunit.client.0.smithi019.stdout:0/395: rename d5/d7/d2c/d44/d6a/d52/f6d to d5/d7/de/f7f 0 2024-09-12T22:11:27.519 INFO:tasks.workunit.client.0.smithi019.stdout:5/421: creat d0/d24/d58/f8d x:0 0 0 2024-09-12T22:11:27.520 INFO:tasks.workunit.client.0.smithi019.stdout:1/414: readlink d1/d2/d18/d35/d84/dc/df/l62 0 2024-09-12T22:11:27.521 INFO:tasks.workunit.client.0.smithi019.stdout:9/355: creat d12/d1b/d20/d29/d56/d60/f7a x:0 0 0 2024-09-12T22:11:27.521 INFO:tasks.workunit.client.0.smithi019.stdout:3/413: write d18/d26/d30/d4e/f52 [921711,37559] 0 2024-09-12T22:11:27.521 INFO:tasks.workunit.client.0.smithi019.stdout:6/418: chown d9/dc/d20/d30/d5b/f5d 1 1 2024-09-12T22:11:27.521 INFO:tasks.workunit.client.0.smithi019.stdout:5/422: creat d0/d26/d5f/f8e x:0 0 0 2024-09-12T22:11:27.521 INFO:tasks.workunit.client.0.smithi019.stdout:0/396: rmdir d5/d7/d2c/d44/d6a/d46 39 2024-09-12T22:11:27.522 INFO:tasks.workunit.client.0.smithi019.stdout:5/423: readlink d0/d26/d3a/l3c 0 2024-09-12T22:11:27.522 INFO:tasks.workunit.client.0.smithi019.stdout:2/302: dread d0/d31/d4/f22 [0,4194304] 0 2024-09-12T22:11:27.523 INFO:tasks.workunit.client.0.smithi019.stdout:7/413: read da/d19/f4a [116714,85102] 0 2024-09-12T22:11:27.523 INFO:tasks.workunit.client.0.smithi019.stdout:5/424: chown d0/f63 79 1 2024-09-12T22:11:27.524 INFO:tasks.workunit.client.0.smithi019.stdout:0/397: truncate d5/d7/d10/f55 411012 0 2024-09-12T22:11:27.527 INFO:tasks.workunit.client.0.smithi019.stdout:5/425: getdents d0 0 2024-09-12T22:11:27.527 INFO:tasks.workunit.client.0.smithi019.stdout:2/303: truncate d0/d3/df/d18/d2c/d2d/f54 546205 0 2024-09-12T22:11:27.527 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.526+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.528 INFO:tasks.workunit.client.0.smithi019.stdout:7/414: rename da/d19/f62 to da/d24/d28/d1c/d32/f89 0 2024-09-12T22:11:27.528 INFO:tasks.workunit.client.0.smithi019.stdout:2/304: fdatasync d0/f42 0 2024-09-12T22:11:27.528 INFO:tasks.workunit.client.0.smithi019.stdout:8/382: dwrite d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:27.528 INFO:tasks.workunit.client.0.smithi019.stdout:5/426: write d0/d26/d3a/f59 [689471,101375] 0 2024-09-12T22:11:27.529 INFO:tasks.workunit.client.0.smithi019.stdout:2/305: dread - d0/d3/df/d18/d2c/d30/d32/f4a zero size 2024-09-12T22:11:27.529 INFO:tasks.workunit.client.0.smithi019.stdout:5/427: write d0/d26/f2d [1416151,111114] 0 2024-09-12T22:11:27.530 INFO:tasks.workunit.client.0.smithi019.stdout:2/306: rmdir d0/d3 39 2024-09-12T22:11:27.531 INFO:tasks.workunit.client.0.smithi019.stdout:8/383: readlink d5/l2d 0 2024-09-12T22:11:27.534 INFO:tasks.workunit.client.0.smithi019.stdout:7/415: dwrite da/d19/d25/d39/d51/f75 [0,4194304] 0 2024-09-12T22:11:27.534 INFO:tasks.workunit.client.0.smithi019.stdout:3/414: truncate f8 3706068 0 2024-09-12T22:11:27.534 INFO:tasks.workunit.client.0.smithi019.stdout:2/307: mknod d0/d3/d11/d2e/d34/d51/c5f 0 2024-09-12T22:11:27.535 INFO:tasks.workunit.client.0.smithi019.stdout:7/416: chown da/d24/d28/d1c/l78 63574 1 2024-09-12T22:11:27.535 INFO:tasks.workunit.client.0.smithi019.stdout:3/415: creat d18/d26/d30/d64/f7f x:0 0 0 2024-09-12T22:11:27.536 INFO:tasks.workunit.client.0.smithi019.stdout:3/416: mkdir d18/d26/d30/d4e/d80 0 2024-09-12T22:11:27.536 INFO:tasks.workunit.client.0.smithi019.stdout:7/417: dread - da/f76 zero size 2024-09-12T22:11:27.537 INFO:tasks.workunit.client.0.smithi019.stdout:3/417: fsync d18/d1d/f3b 0 2024-09-12T22:11:27.538 INFO:tasks.workunit.client.0.smithi019.stdout:6/419: dwrite d9/d3d/d4f/f5e [4194304,4194304] 0 2024-09-12T22:11:27.538 INFO:tasks.workunit.client.0.smithi019.stdout:3/418: mknod d18/c81 0 2024-09-12T22:11:27.539 INFO:tasks.workunit.client.0.smithi019.stdout:7/418: rename da/d24/d28/d1c/f7a to da/d24/d28/d1c/d32/f8a 0 2024-09-12T22:11:27.540 INFO:tasks.workunit.client.0.smithi019.stdout:3/419: mknod d18/d26/d30/d4e/c82 0 2024-09-12T22:11:27.540 INFO:tasks.workunit.client.0.smithi019.stdout:7/419: readlink da/d24/d28/l1e 0 2024-09-12T22:11:27.540 INFO:tasks.workunit.client.0.smithi019.stdout:2/308: dwrite d0/d31/d4/d7/f45 [0,4194304] 0 2024-09-12T22:11:27.541 INFO:tasks.workunit.client.0.smithi019.stdout:2/309: rmdir d0/d3/d11/d2e/d34 39 2024-09-12T22:11:27.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:11:27.542 INFO:tasks.workunit.client.0.smithi019.stdout:7/420: creat da/d24/d28/f8b x:0 0 0 2024-09-12T22:11:27.545 INFO:tasks.workunit.client.0.smithi019.stdout:7/421: getdents da 0 2024-09-12T22:11:27.545 INFO:tasks.workunit.client.0.smithi019.stdout:5/428: truncate d0/d1d/d4f/f1a 2025983 0 2024-09-12T22:11:27.546 INFO:tasks.workunit.client.0.smithi019.stdout:6/420: dwrite d9/d3d/d4f/f5e [0,4194304] 0 2024-09-12T22:11:27.546 INFO:tasks.workunit.client.0.smithi019.stdout:1/415: sync 2024-09-12T22:11:27.549 INFO:tasks.workunit.client.0.smithi019.stdout:6/421: mknod d9/d3d/d4f/d59/c93 0 2024-09-12T22:11:27.551 INFO:tasks.workunit.client.0.smithi019.stdout:3/420: dwrite d18/d58/f7b [0,4194304] 0 2024-09-12T22:11:27.551 INFO:tasks.workunit.client.0.smithi019.stdout:1/416: creat d1/d2/d18/d35/d84/dc/df/f93 x:0 0 0 2024-09-12T22:11:27.552 INFO:tasks.workunit.client.0.smithi019.stdout:1/417: stat d1/d2/d18/d35 0 2024-09-12T22:11:27.552 INFO:tasks.workunit.client.0.smithi019.stdout:0/398: dwrite d5/d7/de/f54 [0,4194304] 0 2024-09-12T22:11:27.553 INFO:tasks.workunit.client.0.smithi019.stdout:3/421: truncate d18/d1d/d35/f6d 62067 0 2024-09-12T22:11:27.554 INFO:tasks.workunit.client.0.smithi019.stdout:1/418: chown d1/d37/f65 1618081 1 2024-09-12T22:11:27.554 INFO:tasks.workunit.client.0.smithi019.stdout:7/422: dwrite da/d24/f74 [0,4194304] 0 2024-09-12T22:11:27.554 INFO:tasks.workunit.client.0.smithi019.stdout:6/422: getdents d9/dc/d20/d4b/d7a 0 2024-09-12T22:11:27.557 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:27.557 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:27.558 INFO:tasks.workunit.client.0.smithi019.stdout:0/399: link d5/d7/d2c/d44/d6a/f59 d5/d7/d2c/d44/d6a/d76/f80 0 2024-09-12T22:11:27.558 INFO:tasks.workunit.client.0.smithi019.stdout:1/419: write d1/d2/f24 [247199,97643] 0 2024-09-12T22:11:27.558 INFO:tasks.workunit.client.0.smithi019.stdout:6/423: rmdir d9/dc/d20/d4b/d6c/d8c 39 2024-09-12T22:11:27.558 INFO:tasks.workunit.client.0.smithi019.stdout:8/384: dread d5/d16/d19/d29/f4d [0,4194304] 0 2024-09-12T22:11:27.559 INFO:tasks.workunit.client.0.smithi019.stdout:7/423: getdents da/d19/d25/d39/d51 0 2024-09-12T22:11:27.559 INFO:tasks.workunit.client.0.smithi019.stdout:0/400: mkdir d5/d7/d2c/d81 0 2024-09-12T22:11:27.560 INFO:tasks.workunit.client.0.smithi019.stdout:8/385: creat d5/dc/d26/d43/d49/d7a/f80 x:0 0 0 2024-09-12T22:11:27.560 INFO:tasks.workunit.client.0.smithi019.stdout:6/424: getdents d9/dc/d20/d30/d5b 0 2024-09-12T22:11:27.561 INFO:tasks.workunit.client.0.smithi019.stdout:0/401: mknod d5/d7/d2c/d44/d6a/d76/c82 0 2024-09-12T22:11:27.561 INFO:tasks.workunit.client.0.smithi019.stdout:1/420: rename d1/d2/d18/d29/d27/f39 to d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f94 0 2024-09-12T22:11:27.564 INFO:tasks.workunit.client.0.smithi019.stdout:7/424: mknod da/d19/d25/d39/d51/c8c 0 2024-09-12T22:11:27.567 INFO:tasks.workunit.client.0.smithi019.stdout:0/402: chown d5/d7/d10/l56 2 1 2024-09-12T22:11:27.567 INFO:tasks.workunit.client.0.smithi019.stdout:9/356: dread f5 [0,4194304] 0 2024-09-12T22:11:27.567 INFO:tasks.workunit.client.0.smithi019.stdout:4/370: dread d9/f54 [0,4194304] 0 2024-09-12T22:11:27.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:27.571 INFO:tasks.workunit.client.0.smithi019.stdout:8/386: dwrite d5/dc/d26/d4b/f79 [0,4194304] 0 2024-09-12T22:11:27.574 INFO:tasks.workunit.client.0.smithi019.stdout:0/403: dwrite d5/d7/de/f3c [0,4194304] 0 2024-09-12T22:11:27.577 INFO:tasks.workunit.client.0.smithi019.stdout:3/422: dread d18/d26/d30/d4e/f65 [0,4194304] 0 2024-09-12T22:11:27.578 INFO:tasks.workunit.client.0.smithi019.stdout:8/387: read d5/dc/f1c [7449137,58508] 0 2024-09-12T22:11:27.578 INFO:tasks.workunit.client.0.smithi019.stdout:8/388: readlink l3 0 2024-09-12T22:11:27.578 INFO:tasks.workunit.client.0.smithi019.stdout:7/425: rename da/d24/d28/d1c/d32/f8a to da/d24/d28/d1c/d32/f8d 0 2024-09-12T22:11:27.579 INFO:tasks.workunit.client.0.smithi019.stdout:0/404: rmdir d5/d7/d10 39 2024-09-12T22:11:27.579 INFO:tasks.workunit.client.0.smithi019.stdout:4/371: fsync d9/f54 0 2024-09-12T22:11:27.579 INFO:tasks.workunit.client.0.smithi019.stdout:9/357: creat d12/d1b/d20/d25/f7b x:0 0 0 2024-09-12T22:11:27.579 INFO:tasks.workunit.client.0.smithi019.stdout:3/423: rmdir d18/d26/d30 39 2024-09-12T22:11:27.579 INFO:tasks.workunit.client.0.smithi019.stdout:1/421: rename d1/d2/d18/d35/d84/c4f to d1/d2/d18/d29/c95 0 2024-09-12T22:11:27.580 INFO:tasks.workunit.client.0.smithi019.stdout:6/425: getdents d9/dc/d20/d4b/d64 0 2024-09-12T22:11:27.580 INFO:tasks.workunit.client.0.smithi019.stdout:7/426: symlink da/d24/l8e 0 2024-09-12T22:11:27.580 INFO:tasks.workunit.client.0.smithi019.stdout:3/424: creat d18/d58/f83 x:0 0 0 2024-09-12T22:11:27.580 INFO:tasks.workunit.client.0.smithi019.stdout:0/405: rmdir d5/d7/d10 39 2024-09-12T22:11:27.581 INFO:tasks.workunit.client.0.smithi019.stdout:9/358: chown d12/d1b/d40/d52/f65 39 1 2024-09-12T22:11:27.581 INFO:tasks.workunit.client.0.smithi019.stdout:1/422: chown d1/d2/d18/d35/d84/l15 1 1 2024-09-12T22:11:27.584 INFO:tasks.workunit.client.0.smithi019.stdout:6/426: dread d9/dc/d20/f14 [0,4194304] 0 2024-09-12T22:11:27.585 INFO:tasks.workunit.client.0.smithi019.stdout:0/406: truncate d5/d7/d2c/d44/d6a/f4f 320016 0 2024-09-12T22:11:27.586 INFO:tasks.workunit.client.0.smithi019.stdout:0/407: write d5/f6 [1339797,117529] 0 2024-09-12T22:11:27.587 INFO:tasks.workunit.client.0.smithi019.stdout:1/423: symlink d1/d37/l96 0 2024-09-12T22:11:27.587 INFO:tasks.workunit.client.0.smithi019.stdout:7/427: rename da/d24/d28/d1c/d32/d5e/d73 to da/d8f 0 2024-09-12T22:11:27.587 INFO:tasks.workunit.client.0.smithi019.stdout:8/389: dwrite d5/dc/d26/d43/d49/d7a/f80 [0,4194304] 0 2024-09-12T22:11:27.587 INFO:tasks.workunit.client.0.smithi019.stdout:6/427: symlink d9/d3d/d4f/l94 0 2024-09-12T22:11:27.587 INFO:tasks.workunit.client.0.smithi019.stdout:9/359: link d12/f17 d12/d48/f7c 0 2024-09-12T22:11:27.587 INFO:tasks.workunit.client.0.smithi019.stdout:4/372: dwrite d9/d14/f34 [0,4194304] 0 2024-09-12T22:11:27.588 INFO:tasks.workunit.client.0.smithi019.stdout:9/360: chown d12/f15 48 1 2024-09-12T22:11:27.588 INFO:tasks.workunit.client.0.smithi019.stdout:4/373: dread - d9/d17/f2c zero size 2024-09-12T22:11:27.588 INFO:tasks.workunit.client.0.smithi019.stdout:5/429: sync 2024-09-12T22:11:27.588 INFO:tasks.workunit.client.0.smithi019.stdout:2/310: sync 2024-09-12T22:11:27.589 INFO:tasks.workunit.client.0.smithi019.stdout:9/361: chown d12/d1b/d20/d25 16557 1 2024-09-12T22:11:27.590 INFO:tasks.workunit.client.0.smithi019.stdout:4/374: truncate d9/f54 4984799 0 2024-09-12T22:11:27.590 INFO:tasks.workunit.client.0.smithi019.stdout:3/425: mknod d18/d26/d30/d4a/c84 0 2024-09-12T22:11:27.590 INFO:tasks.workunit.client.0.smithi019.stdout:9/362: dread - d12/d48/f61 zero size 2024-09-12T22:11:27.590 INFO:tasks.workunit.client.0.smithi019.stdout:1/424: chown d1/d2/d18/d35/d84/dc/df/d2c/d5d/f8e 5119 1 2024-09-12T22:11:27.590 INFO:tasks.workunit.client.0.smithi019.stdout:8/390: rmdir d5/d16 39 2024-09-12T22:11:27.590 INFO:tasks.workunit.client.0.smithi019.stdout:5/430: creat d0/d24/d7a/f8f x:0 0 0 2024-09-12T22:11:27.591 INFO:tasks.workunit.client.0.smithi019.stdout:9/363: rmdir d12/d1b/d20/d29 39 2024-09-12T22:11:27.592 INFO:tasks.workunit.client.0.smithi019.stdout:5/431: write d0/d1d/d4f/d47/f4a [290323,115988] 0 2024-09-12T22:11:27.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/426: rename d18/l63 to d18/d58/l85 0 2024-09-12T22:11:27.594 INFO:tasks.workunit.client.0.smithi019.stdout:0/408: link d5/d7/d10/d26/c6b d5/d7/d2c/d44/d6a/d76/c83 0 2024-09-12T22:11:27.595 INFO:tasks.workunit.client.0.smithi019.stdout:8/391: getdents d5/dc/d26/d5c 0 2024-09-12T22:11:27.595 INFO:tasks.workunit.client.0.smithi019.stdout:3/427: dread d18/d26/d30/d4e/f65 [0,4194304] 0 2024-09-12T22:11:27.597 INFO:tasks.workunit.client.0.smithi019.stdout:4/375: dread d9/d14/d33/d4e/f53 [0,4194304] 0 2024-09-12T22:11:27.597 INFO:tasks.workunit.client.0.smithi019.stdout:8/392: dread - d5/d16/d19/f45 zero size 2024-09-12T22:11:27.597 INFO:tasks.workunit.client.0.smithi019.stdout:6/428: dread d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:27.598 INFO:tasks.workunit.client.0.smithi019.stdout:4/376: stat d9/l2a 0 2024-09-12T22:11:27.598 INFO:tasks.workunit.client.0.smithi019.stdout:1/425: dwrite d1/d2/d18/d59/f75 [0,4194304] 0 2024-09-12T22:11:27.599 INFO:tasks.workunit.client.0.smithi019.stdout:2/311: dwrite d0/d3/df/d18/d2c/d30/d32/f4a [0,4194304] 0 2024-09-12T22:11:27.600 INFO:tasks.workunit.client.0.smithi019.stdout:8/393: chown d5/dc/le 6774461 1 2024-09-12T22:11:27.602 INFO:tasks.workunit.client.0.smithi019.stdout:0/409: creat d5/d7/d2c/d44/d6a/d52/f84 x:0 0 0 2024-09-12T22:11:27.603 INFO:tasks.workunit.client.0.smithi019.stdout:6/429: dread - d9/d6b/f82 zero size 2024-09-12T22:11:27.605 INFO:tasks.workunit.client.0.smithi019.stdout:5/432: dwrite d0/d4e/d50/f60 [0,4194304] 0 2024-09-12T22:11:27.605 INFO:tasks.workunit.client.0.smithi019.stdout:6/430: dread - d9/d3d/d6f/f5c zero size 2024-09-12T22:11:27.607 INFO:tasks.workunit.client.0.smithi019.stdout:6/431: chown d9/dc/d20/f50 1 1 2024-09-12T22:11:27.608 INFO:tasks.workunit.client.0.smithi019.stdout:2/312: dwrite d0/d31/d12/f1b [0,4194304] 0 2024-09-12T22:11:27.615 INFO:tasks.workunit.client.0.smithi019.stdout:8/394: symlink d5/d16/d19/l81 0 2024-09-12T22:11:27.615 INFO:tasks.workunit.client.0.smithi019.stdout:5/433: creat d0/d1d/d3d/f90 x:0 0 0 2024-09-12T22:11:27.619 INFO:tasks.workunit.client.0.smithi019.stdout:6/432: creat d9/d6b/f95 x:0 0 0 2024-09-12T22:11:27.619 INFO:tasks.workunit.client.0.smithi019.stdout:4/377: rename d9/db/c12 to d9/d58/c7b 0 2024-09-12T22:11:27.620 INFO:tasks.workunit.client.0.smithi019.stdout:8/395: mknod d5/d16/d19/d29/c82 0 2024-09-12T22:11:27.620 INFO:tasks.workunit.client.0.smithi019.stdout:2/313: mkdir d0/d3/df/d18/d2c/d56/d60 0 2024-09-12T22:11:27.620 INFO:tasks.workunit.client.0.smithi019.stdout:3/428: write d18/f28 [755126,65143] 0 2024-09-12T22:11:27.620 INFO:tasks.workunit.client.0.smithi019.stdout:7/428: fdatasync da/f76 0 2024-09-12T22:11:27.621 INFO:tasks.workunit.client.0.smithi019.stdout:6/433: mknod d9/dc/d20/d4b/c96 0 2024-09-12T22:11:27.621 INFO:tasks.workunit.client.0.smithi019.stdout:0/410: getdents d5/d7/d2c 0 2024-09-12T22:11:27.621 INFO:tasks.workunit.client.0.smithi019.stdout:1/426: rename d1/d2/d18/d35/d84/d6e/l72 to d1/d2/d18/l97 0 2024-09-12T22:11:27.621 INFO:tasks.workunit.client.0.smithi019.stdout:2/314: creat d0/d3/df/f61 x:0 0 0 2024-09-12T22:11:27.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/434: rename d0/lc to d0/d1d/d4f/d47/l91 0 2024-09-12T22:11:27.622 INFO:tasks.workunit.client.0.smithi019.stdout:1/427: rmdir d1/d2 39 2024-09-12T22:11:27.622 INFO:tasks.workunit.client.0.smithi019.stdout:7/429: stat da/d19/d25/d39/d51/f75 0 2024-09-12T22:11:27.622 INFO:tasks.workunit.client.0.smithi019.stdout:6/434: write d9/dc/d20/d30/f37 [5009383,57549] 0 2024-09-12T22:11:27.623 INFO:tasks.workunit.client.0.smithi019.stdout:0/411: write d5/d7/d2c/d44/f45 [971926,10003] 0 2024-09-12T22:11:27.623 INFO:tasks.workunit.client.0.smithi019.stdout:4/378: dread d9/d14/f1c [0,4194304] 0 2024-09-12T22:11:27.623 INFO:tasks.workunit.client.0.smithi019.stdout:8/396: rename d5/dc/f1c to d5/d16/f83 0 2024-09-12T22:11:27.624 INFO:tasks.workunit.client.0.smithi019.stdout:7/430: unlink da/d19/d25/d39/f61 0 2024-09-12T22:11:27.624 INFO:tasks.workunit.client.0.smithi019.stdout:2/315: rmdir d0/d3/d21/d36/d44 39 2024-09-12T22:11:27.624 INFO:tasks.workunit.client.0.smithi019.stdout:0/412: readlink d5/d7/d10/l56 0 2024-09-12T22:11:27.624 INFO:tasks.workunit.client.0.smithi019.stdout:1/428: mkdir d1/d2/d18/d35/d84/d98 0 2024-09-12T22:11:27.625 INFO:tasks.workunit.client.0.smithi019.stdout:8/397: unlink d5/dc/l12 0 2024-09-12T22:11:27.625 INFO:tasks.workunit.client.0.smithi019.stdout:6/435: symlink d9/dc/d20/d4b/d6c/d8c/l97 0 2024-09-12T22:11:27.625 INFO:tasks.workunit.client.0.smithi019.stdout:2/316: chown d0/d31/d12/d3b/l4e 8809961 1 2024-09-12T22:11:27.626 INFO:tasks.workunit.client.0.smithi019.stdout:0/413: mknod d5/d7/d2c/d44/d6a/d52/c85 0 2024-09-12T22:11:27.626 INFO:tasks.workunit.client.0.smithi019.stdout:1/429: write d1/d37/f4c [642917,58577] 0 2024-09-12T22:11:27.627 INFO:tasks.workunit.client.0.smithi019.stdout:8/398: truncate d5/dc/f6d 439382 0 2024-09-12T22:11:27.627 INFO:tasks.workunit.client.0.smithi019.stdout:7/431: write da/d19/d25/d39/d51/f6c [869433,40694] 0 2024-09-12T22:11:27.628 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.627+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.628 INFO:tasks.workunit.client.0.smithi019.stdout:2/317: creat d0/d31/d12/d3b/d5c/f62 x:0 0 0 2024-09-12T22:11:27.628 INFO:tasks.workunit.client.0.smithi019.stdout:3/429: dwrite d18/f1b [0,4194304] 0 2024-09-12T22:11:27.629 INFO:tasks.workunit.client.0.smithi019.stdout:8/399: write d5/dc/f6d [1155675,104372] 0 2024-09-12T22:11:27.630 INFO:tasks.workunit.client.0.smithi019.stdout:9/364: sync 2024-09-12T22:11:27.631 INFO:tasks.workunit.client.0.smithi019.stdout:3/430: readlink d18/d26/d30/d4e/l6b 0 2024-09-12T22:11:27.631 INFO:tasks.workunit.client.0.smithi019.stdout:4/379: dread d9/d14/d33/f6e [0,4194304] 0 2024-09-12T22:11:27.633 INFO:tasks.workunit.client.0.smithi019.stdout:7/432: creat da/d19/d79/f90 x:0 0 0 2024-09-12T22:11:27.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/400: chown d5/dc/d26/d43/c48 50 1 2024-09-12T22:11:27.634 INFO:tasks.workunit.client.0.smithi019.stdout:1/430: creat d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f99 x:0 0 0 2024-09-12T22:11:27.634 INFO:tasks.workunit.client.0.smithi019.stdout:3/431: chown d18/d26/d30/d4e/c55 7485705 1 2024-09-12T22:11:27.635 INFO:tasks.workunit.client.0.smithi019.stdout:6/436: dwrite d9/d6b/f95 [0,4194304] 0 2024-09-12T22:11:27.635 INFO:tasks.workunit.client.0.smithi019.stdout:8/401: dread - d5/d16/d19/f5b zero size 2024-09-12T22:11:27.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/414: truncate d5/d7/d10/d26/d2a/f5d 473148 0 2024-09-12T22:11:27.635 INFO:tasks.workunit.client.0.smithi019.stdout:4/380: unlink d9/d14/d33/c49 0 2024-09-12T22:11:27.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/415: chown d5 51 1 2024-09-12T22:11:27.636 INFO:tasks.workunit.client.0.smithi019.stdout:5/435: dread - d0/d4e/d50/f6c zero size 2024-09-12T22:11:27.638 INFO:tasks.workunit.client.0.smithi019.stdout:1/431: write d1/d2/d18/d35/d84/dc/df/d53/d55/f8f [1079139,2218] 0 2024-09-12T22:11:27.638 INFO:tasks.workunit.client.0.smithi019.stdout:4/381: read d9/d14/d31/d3f/f42 [1527047,124677] 0 2024-09-12T22:11:27.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/436: readlink d0/d26/d5f/l6b 0 2024-09-12T22:11:27.639 INFO:tasks.workunit.client.0.smithi019.stdout:2/318: dwrite d0/d31/d12/d3b/d5c/f62 [0,4194304] 0 2024-09-12T22:11:27.640 INFO:tasks.workunit.client.0.smithi019.stdout:7/433: rename da/d19/d25/d39/f45 to da/f91 0 2024-09-12T22:11:27.641 INFO:tasks.workunit.client.0.smithi019.stdout:5/437: dread - d0/d4e/d50/f85 zero size 2024-09-12T22:11:27.642 INFO:tasks.workunit.client.0.smithi019.stdout:8/402: mknod d5/d53/d66/d69/c84 0 2024-09-12T22:11:27.645 INFO:tasks.workunit.client.0.smithi019.stdout:9/365: dwrite d12/d1b/d20/d25/f49 [0,4194304] 0 2024-09-12T22:11:27.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/416: rename d5/f1e to d5/d7/d2c/d81/f86 0 2024-09-12T22:11:27.645 INFO:tasks.workunit.client.0.smithi019.stdout:4/382: link f4 d9/d14/d57/f7c 0 2024-09-12T22:11:27.645 INFO:tasks.workunit.client.0.smithi019.stdout:8/403: read - d5/f51 zero size 2024-09-12T22:11:27.645 INFO:tasks.workunit.client.0.smithi019.stdout:9/366: write d12/d1b/d20/f5c [104986,12694] 0 2024-09-12T22:11:27.645 INFO:tasks.workunit.client.0.smithi019.stdout:9/367: chown d12/l18 60 1 2024-09-12T22:11:27.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/404: symlink d5/dc/d17/l85 0 2024-09-12T22:11:27.647 INFO:tasks.workunit.client.0.smithi019.stdout:6/437: truncate d9/dc/f74 1200709 0 2024-09-12T22:11:27.647 INFO:tasks.workunit.client.0.smithi019.stdout:0/417: mkdir d5/d87 0 2024-09-12T22:11:27.647 INFO:tasks.workunit.client.0.smithi019.stdout:5/438: getdents d0/d26/d3a 0 2024-09-12T22:11:27.648 INFO:tasks.workunit.client.0.smithi019.stdout:2/319: rename d0/d3/d21/d36/d44/c48 to d0/d3/d11/d2e/d34/c63 0 2024-09-12T22:11:27.649 INFO:tasks.workunit.client.0.smithi019.stdout:8/405: mknod d5/c86 0 2024-09-12T22:11:27.650 INFO:tasks.workunit.client.0.smithi019.stdout:5/439: write d0/f63 [4489402,112465] 0 2024-09-12T22:11:27.650 INFO:tasks.workunit.client.0.smithi019.stdout:2/320: chown d0/d3/df/d18/d2c 77302831 1 2024-09-12T22:11:27.651 INFO:tasks.workunit.client.0.smithi019.stdout:2/321: sync 2024-09-12T22:11:27.652 INFO:tasks.workunit.client.0.smithi019.stdout:7/434: dwrite da/d8f/f7f [0,4194304] 0 2024-09-12T22:11:27.652 INFO:tasks.workunit.client.0.smithi019.stdout:4/383: dwrite d9/d4c/f78 [0,4194304] 0 2024-09-12T22:11:27.653 INFO:tasks.workunit.client.0.smithi019.stdout:0/418: write d5/d7/d2c/d44/d6a/d46/f5c [1843851,59270] 0 2024-09-12T22:11:27.654 INFO:tasks.workunit.client.0.smithi019.stdout:8/406: symlink d5/dc/l87 0 2024-09-12T22:11:27.654 INFO:tasks.workunit.client.0.smithi019.stdout:3/432: dread d18/f28 [0,4194304] 0 2024-09-12T22:11:27.655 INFO:tasks.workunit.client.0.smithi019.stdout:4/384: unlink d9/c3e 0 2024-09-12T22:11:27.655 INFO:tasks.workunit.client.0.smithi019.stdout:2/322: mkdir d0/d3/d11/d2e/d64 0 2024-09-12T22:11:27.656 INFO:tasks.workunit.client.0.smithi019.stdout:8/407: mknod d5/dc/d17/c88 0 2024-09-12T22:11:27.656 INFO:tasks.workunit.client.0.smithi019.stdout:5/440: write d0/d24/d58/f87 [634157,2338] 0 2024-09-12T22:11:27.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/368: dwrite d12/f1f [0,4194304] 0 2024-09-12T22:11:27.658 INFO:tasks.workunit.client.0.smithi019.stdout:0/419: write d5/d7/d2c/d44/f45 [1942854,81623] 0 2024-09-12T22:11:27.658 INFO:tasks.workunit.client.0.smithi019.stdout:3/433: mkdir d18/d26/d30/d71/d86 0 2024-09-12T22:11:27.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/408: read d5/dc/d26/f36 [2409289,34097] 0 2024-09-12T22:11:27.659 INFO:tasks.workunit.client.0.smithi019.stdout:7/435: rename da/d19/d25/d39/d51/c67 to da/d19/d25/c92 0 2024-09-12T22:11:27.660 INFO:tasks.workunit.client.0.smithi019.stdout:2/323: creat d0/d3/d11/d2e/d64/f65 x:0 0 0 2024-09-12T22:11:27.660 INFO:tasks.workunit.client.0.smithi019.stdout:0/420: mkdir d5/d88 0 2024-09-12T22:11:27.660 INFO:tasks.workunit.client.0.smithi019.stdout:0/421: sync 2024-09-12T22:11:27.660 INFO:tasks.workunit.client.0.smithi019.stdout:5/441: symlink d0/d26/l92 0 2024-09-12T22:11:27.662 INFO:tasks.workunit.client.0.smithi019.stdout:3/434: chown d18/d26/d30/f67 7379 1 2024-09-12T22:11:27.663 INFO:tasks.workunit.client.0.smithi019.stdout:5/442: symlink d0/d24/l93 0 2024-09-12T22:11:27.664 INFO:tasks.workunit.client.0.smithi019.stdout:7/436: symlink da/d19/d25/d39/d51/l93 0 2024-09-12T22:11:27.664 INFO:tasks.workunit.client.0.smithi019.stdout:9/369: rename f6 to d12/d1b/f7d 0 2024-09-12T22:11:27.664 INFO:tasks.workunit.client.0.smithi019.stdout:4/385: dwrite d9/d4c/f78 [0,4194304] 0 2024-09-12T22:11:27.666 INFO:tasks.workunit.client.0.smithi019.stdout:2/324: rename d0/d31/d12/d3b/f55 to d0/d3/f66 0 2024-09-12T22:11:27.666 INFO:tasks.workunit.client.0.smithi019.stdout:3/435: truncate d18/d1d/d35/f6d 447846 0 2024-09-12T22:11:27.668 INFO:tasks.workunit.client.0.smithi019.stdout:7/437: write da/d8f/f84 [3615963,68335] 0 2024-09-12T22:11:27.668 INFO:tasks.workunit.client.0.smithi019.stdout:2/325: mkdir d0/d67 0 2024-09-12T22:11:27.671 INFO:tasks.workunit.client.0.smithi019.stdout:0/422: dwrite d5/d7/f30 [0,4194304] 0 2024-09-12T22:11:27.671 INFO:tasks.workunit.client.0.smithi019.stdout:8/409: dwrite d5/dc/d26/d4b/f79 [0,4194304] 0 2024-09-12T22:11:27.671 INFO:tasks.workunit.client.0.smithi019.stdout:2/326: readlink d0/l3d 0 2024-09-12T22:11:27.671 INFO:tasks.workunit.client.0.smithi019.stdout:2/327: sync 2024-09-12T22:11:27.674 INFO:tasks.workunit.client.0.smithi019.stdout:5/443: dwrite d0/d24/d7a/f7e [0,4194304] 0 2024-09-12T22:11:27.674 INFO:tasks.workunit.client.0.smithi019.stdout:7/438: getdents da 0 2024-09-12T22:11:27.676 INFO:tasks.workunit.client.0.smithi019.stdout:6/438: dread d9/d3d/f2f [0,4194304] 0 2024-09-12T22:11:27.676 INFO:tasks.workunit.client.0.smithi019.stdout:6/439: sync 2024-09-12T22:11:27.676 INFO:tasks.workunit.client.0.smithi019.stdout:8/410: unlink d5/d53/d66/d69/c84 0 2024-09-12T22:11:27.677 INFO:tasks.workunit.client.0.smithi019.stdout:2/328: mknod d0/d3/df/d18/d2c/c68 0 2024-09-12T22:11:27.677 INFO:tasks.workunit.client.0.smithi019.stdout:3/436: dwrite d18/f28 [0,4194304] 0 2024-09-12T22:11:27.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/423: symlink d5/d7/d2c/d44/d6a/d46/l89 0 2024-09-12T22:11:27.679 INFO:tasks.workunit.client.0.smithi019.stdout:7/439: mkdir da/d24/d28/d1c/d32/d94 0 2024-09-12T22:11:27.679 INFO:tasks.workunit.client.0.smithi019.stdout:7/440: fsync da/f7c 0 2024-09-12T22:11:27.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/424: mkdir d5/d7/d10/d26/d8a 0 2024-09-12T22:11:27.680 INFO:tasks.workunit.client.0.smithi019.stdout:7/441: write da/d19/f4a [1862137,128957] 0 2024-09-12T22:11:27.681 INFO:tasks.workunit.client.0.smithi019.stdout:7/442: chown da/f47 313148 1 2024-09-12T22:11:27.682 INFO:tasks.workunit.client.0.smithi019.stdout:7/443: chown da/d19/d25/d39/d51/l93 438784144 1 2024-09-12T22:11:27.683 INFO:tasks.workunit.client.0.smithi019.stdout:7/444: mkdir da/d24/d28/d1c/d32/d5e/d95 0 2024-09-12T22:11:27.685 INFO:tasks.workunit.client.0.smithi019.stdout:7/445: symlink da/d19/d25/l96 0 2024-09-12T22:11:27.685 INFO:tasks.workunit.client.0.smithi019.stdout:7/446: mknod da/d24/d28/d1c/d32/d5e/c97 0 2024-09-12T22:11:27.686 INFO:tasks.workunit.client.0.smithi019.stdout:7/447: fsync da/d8f/f7f 0 2024-09-12T22:11:27.686 INFO:tasks.workunit.client.0.smithi019.stdout:7/448: fsync da/f7c 0 2024-09-12T22:11:27.686 INFO:tasks.workunit.client.0.smithi019.stdout:7/449: creat da/d24/d28/f98 x:0 0 0 2024-09-12T22:11:27.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/386: fsync d9/d4c/f78 0 2024-09-12T22:11:27.688 INFO:tasks.workunit.client.0.smithi019.stdout:7/450: rmdir da/d24/d28/d1c/d32/d5e/d95 0 2024-09-12T22:11:27.690 INFO:tasks.workunit.client.0.smithi019.stdout:4/387: rename d9/d14/d57/d5f to d9/db/d2b/d6a/d7d 0 2024-09-12T22:11:27.693 INFO:tasks.workunit.client.0.smithi019.stdout:3/437: dread d18/d26/f4b [0,4194304] 0 2024-09-12T22:11:27.693 INFO:tasks.workunit.client.0.smithi019.stdout:8/411: truncate d5/dc/d17/f72 2676889 0 2024-09-12T22:11:27.693 INFO:tasks.workunit.client.0.smithi019.stdout:9/370: dread d12/d1b/f1c [0,4194304] 0 2024-09-12T22:11:27.696 INFO:tasks.workunit.client.0.smithi019.stdout:1/432: dread d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f79 [0,4194304] 0 2024-09-12T22:11:27.696 INFO:tasks.workunit.client.0.smithi019.stdout:6/440: dread d9/dc/f74 [0,4194304] 0 2024-09-12T22:11:27.697 INFO:tasks.workunit.client.0.smithi019.stdout:8/412: creat d5/d53/f89 x:0 0 0 2024-09-12T22:11:27.697 INFO:tasks.workunit.client.0.smithi019.stdout:7/451: dwrite da/d24/d28/d1c/f23 [4194304,4194304] 0 2024-09-12T22:11:27.697 INFO:tasks.workunit.client.0.smithi019.stdout:3/438: rmdir d18/d26/d30/d4a 39 2024-09-12T22:11:27.698 INFO:tasks.workunit.client.0.smithi019.stdout:9/371: rmdir d12/d1b/d40/d52/d75 0 2024-09-12T22:11:27.698 INFO:tasks.workunit.client.0.smithi019.stdout:1/433: chown d1/d2/d18/d35/d84/dc/df/d61 1 1 2024-09-12T22:11:27.698 INFO:tasks.workunit.client.0.smithi019.stdout:7/452: rmdir da/d24/d28/d1c/d32 39 2024-09-12T22:11:27.699 INFO:tasks.workunit.client.0.smithi019.stdout:8/413: mkdir d5/dc/d8a 0 2024-09-12T22:11:27.699 INFO:tasks.workunit.client.0.smithi019.stdout:9/372: fdatasync f11 0 2024-09-12T22:11:27.699 INFO:tasks.workunit.client.0.smithi019.stdout:3/439: symlink d18/d26/d30/d4a/l87 0 2024-09-12T22:11:27.699 INFO:tasks.workunit.client.0.smithi019.stdout:6/441: rename d9/dc/c3b to d9/dc/c98 0 2024-09-12T22:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:27.701 INFO:tasks.workunit.client.0.smithi019.stdout:9/373: stat d12/d1b/d20/d29/c63 0 2024-09-12T22:11:27.702 INFO:tasks.workunit.client.0.smithi019.stdout:7/453: mkdir da/d24/d28/d1c/d32/d99 0 2024-09-12T22:11:27.702 INFO:tasks.workunit.client.0.smithi019.stdout:8/414: symlink d5/dc/d26/d43/d49/l8b 0 2024-09-12T22:11:27.703 INFO:tasks.workunit.client.0.smithi019.stdout:9/374: rename d12/d1b/d20 to d12/d1b/d20/d37/d7e 22 2024-09-12T22:11:27.703 INFO:tasks.workunit.client.0.smithi019.stdout:7/454: readlink da/d19/l1f 0 2024-09-12T22:11:27.704 INFO:tasks.workunit.client.0.smithi019.stdout:9/375: readlink d12/l34 0 2024-09-12T22:11:27.704 INFO:tasks.workunit.client.0.smithi019.stdout:2/329: dread d0/d3/d11/f10 [4194304,4194304] 0 2024-09-12T22:11:27.704 INFO:tasks.workunit.client.0.smithi019.stdout:8/415: chown d5/d16/d19/c2f 30274737 1 2024-09-12T22:11:27.705 INFO:tasks.workunit.client.0.smithi019.stdout:7/455: unlink da/d19/l85 0 2024-09-12T22:11:27.706 INFO:tasks.workunit.client.0.smithi019.stdout:9/376: creat d12/d1b/d20/d37/f7f x:0 0 0 2024-09-12T22:11:27.706 INFO:tasks.workunit.client.0.smithi019.stdout:8/416: fsync d5/dc/f5f 0 2024-09-12T22:11:27.707 INFO:tasks.workunit.client.0.smithi019.stdout:2/330: symlink d0/d3/df/d18/d2c/d56/d60/l69 0 2024-09-12T22:11:27.707 INFO:tasks.workunit.client.0.smithi019.stdout:3/440: dwrite f9 [0,4194304] 0 2024-09-12T22:11:27.707 INFO:tasks.workunit.client.0.smithi019.stdout:8/417: chown d5/d16/d19/c5e 6632 1 2024-09-12T22:11:27.708 INFO:tasks.workunit.client.0.smithi019.stdout:5/444: dread d0/d1d/d3d/f48 [0,4194304] 0 2024-09-12T22:11:27.708 INFO:tasks.workunit.client.0.smithi019.stdout:9/377: write d12/d1b/d20/d37/f7f [516931,122221] 0 2024-09-12T22:11:27.710 INFO:tasks.workunit.client.0.smithi019.stdout:8/418: symlink d5/l8c 0 2024-09-12T22:11:27.710 INFO:tasks.workunit.client.0.smithi019.stdout:2/331: mknod d0/d3/df/d18/c6a 0 2024-09-12T22:11:27.710 INFO:tasks.workunit.client.0.smithi019.stdout:5/445: stat d0/d1d/d3d 0 2024-09-12T22:11:27.710 INFO:tasks.workunit.client.0.smithi019.stdout:3/441: unlink d18/d26/c44 0 2024-09-12T22:11:27.711 INFO:tasks.workunit.client.0.smithi019.stdout:4/388: dread d9/d58/f68 [0,4194304] 0 2024-09-12T22:11:27.711 INFO:tasks.workunit.client.0.smithi019.stdout:9/378: creat d12/d1b/d20/d29/d56/f80 x:0 0 0 2024-09-12T22:11:27.711 INFO:tasks.workunit.client.0.smithi019.stdout:9/379: sync 2024-09-12T22:11:27.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:27.713 INFO:tasks.workunit.client.0.smithi019.stdout:8/419: truncate d5/f23 331738 0 2024-09-12T22:11:27.713 INFO:tasks.workunit.client.0.smithi019.stdout:4/389: creat d9/d6c/f7e x:0 0 0 2024-09-12T22:11:27.713 INFO:tasks.workunit.client.0.smithi019.stdout:2/332: read d0/d31/d12/d15/f33 [2618409,106021] 0 2024-09-12T22:11:27.713 INFO:tasks.workunit.client.0.smithi019.stdout:8/420: write d5/d16/d19/f40 [4762860,129222] 0 2024-09-12T22:11:27.713 INFO:tasks.workunit.client.0.smithi019.stdout:4/390: dread - d9/d14/d33/f6b zero size 2024-09-12T22:11:27.714 INFO:tasks.workunit.client.0.smithi019.stdout:4/391: sync 2024-09-12T22:11:27.714 INFO:tasks.workunit.client.0.smithi019.stdout:8/421: write d5/d16/d19/f45 [952036,80366] 0 2024-09-12T22:11:27.716 INFO:tasks.workunit.client.0.smithi019.stdout:8/422: mkdir d5/dc/d8d 0 2024-09-12T22:11:27.716 INFO:tasks.workunit.client.0.smithi019.stdout:8/423: sync 2024-09-12T22:11:27.716 INFO:tasks.workunit.client.0.smithi019.stdout:3/442: dread d18/f7e [0,4194304] 0 2024-09-12T22:11:27.717 INFO:tasks.workunit.client.0.smithi019.stdout:6/442: dread d9/dc/ff [0,4194304] 0 2024-09-12T22:11:27.717 INFO:tasks.workunit.client.0.smithi019.stdout:8/424: stat d5/dc/d17/f72 0 2024-09-12T22:11:27.717 INFO:tasks.workunit.client.0.smithi019.stdout:7/456: truncate da/d19/d25/f2e 3118875 0 2024-09-12T22:11:27.719 INFO:tasks.workunit.client.0.smithi019.stdout:8/425: unlink d5/fa 0 2024-09-12T22:11:27.719 INFO:tasks.workunit.client.0.smithi019.stdout:2/333: dwrite d0/d31/d12/d15/f23 [0,4194304] 0 2024-09-12T22:11:27.719 INFO:tasks.workunit.client.0.smithi019.stdout:3/443: rename d18/d1d/d35/f6d to d18/d26/d30/d64/f88 0 2024-09-12T22:11:27.719 INFO:tasks.workunit.client.0.smithi019.stdout:6/443: dread - d9/dc/d20/d4b/f2c zero size 2024-09-12T22:11:27.720 INFO:tasks.workunit.client.0.smithi019.stdout:7/457: write da/f5b [742041,49145] 0 2024-09-12T22:11:27.721 INFO:tasks.workunit.client.0.smithi019.stdout:0/425: dread d5/d7/d10/d26/d2a/f37 [0,4194304] 0 2024-09-12T22:11:27.722 INFO:tasks.workunit.client.0.smithi019.stdout:9/380: truncate d12/d1b/d20/d37/f39 2897660 0 2024-09-12T22:11:27.722 INFO:tasks.workunit.client.0.smithi019.stdout:2/334: chown d0/d31/d12/f17 1930167 1 2024-09-12T22:11:27.722 INFO:tasks.workunit.client.0.smithi019.stdout:4/392: write f4 [4919526,126783] 0 2024-09-12T22:11:27.722 INFO:tasks.workunit.client.0.smithi019.stdout:6/444: rmdir d9/dc 39 2024-09-12T22:11:27.723 INFO:tasks.workunit.client.0.smithi019.stdout:7/458: creat da/d8f/f9a x:0 0 0 2024-09-12T22:11:27.725 INFO:tasks.workunit.client.0.smithi019.stdout:2/335: mkdir d0/d3/df/d6b 0 2024-09-12T22:11:27.725 INFO:tasks.workunit.client.0.smithi019.stdout:8/426: mkdir d5/dc/d8a/d8e 0 2024-09-12T22:11:27.725 INFO:tasks.workunit.client.0.smithi019.stdout:3/444: mkdir d18/d26/d30/d89 0 2024-09-12T22:11:27.725 INFO:tasks.workunit.client.0.smithi019.stdout:0/426: unlink d5/d7/d2c/d44/d6a/d76/c82 0 2024-09-12T22:11:27.726 INFO:tasks.workunit.client.0.smithi019.stdout:7/459: read da/d24/d28/d1c/d32/f5c [3050213,62026] 0 2024-09-12T22:11:27.726 INFO:tasks.workunit.client.0.smithi019.stdout:4/393: rename d9/d14/f34 to d9/d14/d57/d5e/f7f 0 2024-09-12T22:11:27.728 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:27.727+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:27.729 INFO:tasks.workunit.client.0.smithi019.stdout:7/460: chown da/d24/d28 18 1 2024-09-12T22:11:27.729 INFO:tasks.workunit.client.0.smithi019.stdout:8/427: write d5/dc/d26/d43/d49/d7a/f80 [258387,101841] 0 2024-09-12T22:11:27.729 INFO:tasks.workunit.client.0.smithi019.stdout:3/445: symlink d18/d1d/l8a 0 2024-09-12T22:11:27.729 INFO:tasks.workunit.client.0.smithi019.stdout:6/445: symlink d9/dc/d20/d4b/d64/d7e/l99 0 2024-09-12T22:11:27.730 INFO:tasks.workunit.client.0.smithi019.stdout:2/336: mknod d0/d3/d11/d2e/c6c 0 2024-09-12T22:11:27.731 INFO:tasks.workunit.client.0.smithi019.stdout:6/446: read - d9/d3d/f3c zero size 2024-09-12T22:11:27.732 INFO:tasks.workunit.client.0.smithi019.stdout:3/446: dread - d18/f56 zero size 2024-09-12T22:11:27.732 INFO:tasks.workunit.client.0.smithi019.stdout:6/447: stat d9 0 2024-09-12T22:11:27.734 INFO:tasks.workunit.client.0.smithi019.stdout:8/428: rmdir d5/d16/d19/d74 0 2024-09-12T22:11:27.734 INFO:tasks.workunit.client.0.smithi019.stdout:2/337: readlink d0/d31/d12/d3b/l4e 0 2024-09-12T22:11:27.734 INFO:tasks.workunit.client.0.smithi019.stdout:1/434: dread d1/d2/d18/d35/f3a [0,4194304] 0 2024-09-12T22:11:27.734 INFO:tasks.workunit.client.0.smithi019.stdout:3/447: mkdir d18/d1d/d8b 0 2024-09-12T22:11:27.735 INFO:tasks.workunit.client.0.smithi019.stdout:5/446: dread d0/f29 [0,4194304] 0 2024-09-12T22:11:27.735 INFO:tasks.workunit.client.0.smithi019.stdout:7/461: rename da/d30/d53/f59 to da/d24/d28/d1c/d32/d94/f9b 0 2024-09-12T22:11:27.735 INFO:tasks.workunit.client.0.smithi019.stdout:4/394: dread d9/d14/d31/d3f/f48 [0,4194304] 0 2024-09-12T22:11:27.736 INFO:tasks.workunit.client.0.smithi019.stdout:6/448: symlink d9/dc/l9a 0 2024-09-12T22:11:27.736 INFO:tasks.workunit.client.0.smithi019.stdout:8/429: chown d5/c1d 9811 1 2024-09-12T22:11:27.737 INFO:tasks.workunit.client.0.smithi019.stdout:6/449: stat d9/ce 0 2024-09-12T22:11:27.737 INFO:tasks.workunit.client.0.smithi019.stdout:7/462: chown da/l52 20 1 2024-09-12T22:11:27.737 INFO:tasks.workunit.client.0.smithi019.stdout:3/448: mknod d18/d26/d30/d71/d86/c8c 0 2024-09-12T22:11:27.738 INFO:tasks.workunit.client.0.smithi019.stdout:5/447: creat d0/d1d/d6d/f94 x:0 0 0 2024-09-12T22:11:27.738 INFO:tasks.workunit.client.0.smithi019.stdout:8/430: truncate d5/f23 1195890 0 2024-09-12T22:11:27.738 INFO:tasks.workunit.client.0.smithi019.stdout:4/395: fdatasync d9/db/d2b/f30 0 2024-09-12T22:11:27.738 INFO:tasks.workunit.client.0.smithi019.stdout:5/448: rmdir d0/d1d/d6d 39 2024-09-12T22:11:27.739 INFO:tasks.workunit.client.0.smithi019.stdout:6/450: fsync d9/f22 0 2024-09-12T22:11:27.739 INFO:tasks.workunit.client.0.smithi019.stdout:7/463: mkdir da/d30/d9c 0 2024-09-12T22:11:27.740 INFO:tasks.workunit.client.0.smithi019.stdout:4/396: rmdir d9/d14/d57/d69 39 2024-09-12T22:11:27.741 INFO:tasks.workunit.client.0.smithi019.stdout:5/449: creat d0/d1d/f95 x:0 0 0 2024-09-12T22:11:27.741 INFO:tasks.workunit.client.0.smithi019.stdout:8/431: readlink d5/d16/d19/l78 0 2024-09-12T22:11:27.741 INFO:tasks.workunit.client.0.smithi019.stdout:1/435: rename d1/d2/d18/d35/d84/dc/df/l21 to d1/d2/d18/d35/d84/dc/df/d53/d55/l9a 0 2024-09-12T22:11:27.742 INFO:tasks.workunit.client.0.smithi019.stdout:0/427: dwrite d5/d7/d10/d26/d2a/f65 [0,4194304] 0 2024-09-12T22:11:27.742 INFO:tasks.workunit.client.0.smithi019.stdout:6/451: fsync d9/dc/d20/f1a 0 2024-09-12T22:11:27.745 INFO:tasks.workunit.client.0.smithi019.stdout:8/432: readlink d5/dc/d17/l39 0 2024-09-12T22:11:27.746 INFO:tasks.workunit.client.0.smithi019.stdout:0/428: creat d5/d87/f8b x:0 0 0 2024-09-12T22:11:27.746 INFO:tasks.workunit.client.0.smithi019.stdout:3/449: getdents d18/d26/d30/d4e 0 2024-09-12T22:11:27.746 INFO:tasks.workunit.client.0.smithi019.stdout:6/452: mknod d9/dc/d20/d30/d5b/c9b 0 2024-09-12T22:11:27.749 INFO:tasks.workunit.client.0.smithi019.stdout:1/436: creat d1/d2/d18/d29/f9b x:0 0 0 2024-09-12T22:11:27.750 INFO:tasks.workunit.client.0.smithi019.stdout:3/450: write f16 [1237524,43355] 0 2024-09-12T22:11:27.750 INFO:tasks.workunit.client.0.smithi019.stdout:7/464: dwrite da/d24/d28/d1c/d32/f5c [4194304,4194304] 0 2024-09-12T22:11:27.751 INFO:tasks.workunit.client.0.smithi019.stdout:6/453: fsync d9/dc/d20/d4b/d7a/f80 0 2024-09-12T22:11:27.751 INFO:tasks.workunit.client.0.smithi019.stdout:4/397: dwrite d9/f54 [0,4194304] 0 2024-09-12T22:11:27.751 INFO:tasks.workunit.client.0.smithi019.stdout:8/433: symlink d5/d16/d19/d29/d7f/l8f 0 2024-09-12T22:11:27.751 INFO:tasks.workunit.client.0.smithi019.stdout:9/381: dread d12/d1b/d20/d29/d56/d60/f6b [0,4194304] 0 2024-09-12T22:11:27.753 INFO:tasks.workunit.client.0.smithi019.stdout:3/451: write d18/d58/f7b [1350897,124089] 0 2024-09-12T22:11:27.755 INFO:tasks.workunit.client.0.smithi019.stdout:5/450: dwrite d0/d26/d6f/f74 [0,4194304] 0 2024-09-12T22:11:27.755 INFO:tasks.workunit.client.0.smithi019.stdout:7/465: mkdir da/d24/d9d 0 2024-09-12T22:11:27.755 INFO:tasks.workunit.client.0.smithi019.stdout:0/429: dread d5/d7/de/f54 [0,4194304] 0 2024-09-12T22:11:27.758 INFO:tasks.workunit.client.0.smithi019.stdout:1/437: symlink d1/d2/d18/d35/d84/dc/df/d2c/l9c 0 2024-09-12T22:11:27.758 INFO:tasks.workunit.client.0.smithi019.stdout:5/451: chown d0/c7 61431 1 2024-09-12T22:11:27.760 INFO:tasks.workunit.client.0.smithi019.stdout:6/454: dwrite d9/d3d/d6f/f67 [0,4194304] 0 2024-09-12T22:11:27.760 INFO:tasks.workunit.client.0.smithi019.stdout:0/430: rename d5/d7/de/f39 to d5/d7/d10/d26/d8a/f8c 0 2024-09-12T22:11:27.761 INFO:tasks.workunit.client.0.smithi019.stdout:4/398: getdents d9/d14/d57/d69/d6f 0 2024-09-12T22:11:27.762 INFO:tasks.workunit.client.0.smithi019.stdout:5/452: write d0/f63 [3085603,13393] 0 2024-09-12T22:11:27.762 INFO:tasks.workunit.client.0.smithi019.stdout:6/455: fsync d9/d3d/d6f/f65 0 2024-09-12T22:11:27.765 INFO:tasks.workunit.client.0.smithi019.stdout:1/438: write d1/d2/d18/d35/d84/dc/df/d2c/f49 [1730489,21542] 0 2024-09-12T22:11:27.767 INFO:tasks.workunit.client.0.smithi019.stdout:5/453: mkdir d0/d1d/d4f/d96 0 2024-09-12T22:11:27.767 INFO:tasks.workunit.client.0.smithi019.stdout:3/452: dwrite d18/d26/f4b [0,4194304] 0 2024-09-12T22:11:27.767 INFO:tasks.workunit.client.0.smithi019.stdout:6/456: write d9/dc/d20/d30/f42 [1305403,27315] 0 2024-09-12T22:11:27.768 INFO:tasks.workunit.client.0.smithi019.stdout:9/382: dwrite d12/d1b/f7d [0,4194304] 0 2024-09-12T22:11:27.769 INFO:tasks.workunit.client.0.smithi019.stdout:4/399: read d9/d14/d31/f5c [3742117,90882] 0 2024-09-12T22:11:27.770 INFO:tasks.workunit.client.0.smithi019.stdout:7/466: dwrite da/d24/d28/d1c/d32/f8d [0,4194304] 0 2024-09-12T22:11:27.770 INFO:tasks.workunit.client.0.smithi019.stdout:1/439: symlink d1/d2/d18/d35/d84/d98/l9d 0 2024-09-12T22:11:27.770 INFO:tasks.workunit.client.0.smithi019.stdout:5/454: dread - d0/f9 zero size 2024-09-12T22:11:27.770 INFO:tasks.workunit.client.0.smithi019.stdout:7/467: chown da/d24 618 1 2024-09-12T22:11:27.772 INFO:tasks.workunit.client.0.smithi019.stdout:2/338: sync 2024-09-12T22:11:27.772 INFO:tasks.workunit.client.0.smithi019.stdout:6/457: symlink d9/d3d/d4f/d8d/l9c 0 2024-09-12T22:11:27.772 INFO:tasks.workunit.client.0.smithi019.stdout:9/383: truncate d12/d1b/d20/f2b 762380 0 2024-09-12T22:11:27.773 INFO:tasks.workunit.client.0.smithi019.stdout:5/455: write d0/f5 [4186903,66221] 0 2024-09-12T22:11:27.773 INFO:tasks.workunit.client.0.smithi019.stdout:4/400: truncate d9/d14/f1c 1083330 0 2024-09-12T22:11:27.773 INFO:tasks.workunit.client.0.smithi019.stdout:3/453: link d18/d26/d30/d4a/f62 d18/d1d/d35/f8d 0 2024-09-12T22:11:27.774 INFO:tasks.workunit.client.0.smithi019.stdout:7/468: rename da/f91 to da/d19/d25/f9e 0 2024-09-12T22:11:27.775 INFO:tasks.workunit.client.0.smithi019.stdout:4/401: mknod d9/d14/c80 0 2024-09-12T22:11:27.776 INFO:tasks.workunit.client.0.smithi019.stdout:2/339: creat d0/d3/d11/d2e/d64/f6d x:0 0 0 2024-09-12T22:11:27.776 INFO:tasks.workunit.client.0.smithi019.stdout:5/456: mkdir d0/d24/d97 0 2024-09-12T22:11:27.776 INFO:tasks.workunit.client.0.smithi019.stdout:1/440: rename d1/d2/d18/d35/d84/f31 to d1/d2/d18/d35/d84/dc/df/f9e 0 2024-09-12T22:11:27.776 INFO:tasks.workunit.client.0.smithi019.stdout:9/384: truncate d12/d1b/d20/d25/f7b 714549 0 2024-09-12T22:11:27.777 INFO:tasks.workunit.client.0.smithi019.stdout:5/457: chown d0/d1d/f22 172476 1 2024-09-12T22:11:27.777 INFO:tasks.workunit.client.0.smithi019.stdout:3/454: rename d18/d26/d30/d4e/f65 to d18/d58/f8e 0 2024-09-12T22:11:27.777 INFO:tasks.workunit.client.0.smithi019.stdout:4/402: dread d9/d14/d33/d4e/f53 [0,4194304] 0 2024-09-12T22:11:27.778 INFO:tasks.workunit.client.0.smithi019.stdout:9/385: chown d12/d1b/d20/d25/f3b 110 1 2024-09-12T22:11:27.778 INFO:tasks.workunit.client.0.smithi019.stdout:5/458: write d0/d4e/f5a [966774,95991] 0 2024-09-12T22:11:27.778 INFO:tasks.workunit.client.0.smithi019.stdout:2/340: read d0/d31/d4/d7/f45 [322852,96050] 0 2024-09-12T22:11:27.779 INFO:tasks.workunit.client.0.smithi019.stdout:3/455: symlink d18/d58/l8f 0 2024-09-12T22:11:27.779 INFO:tasks.workunit.client.0.smithi019.stdout:9/386: readlink d12/d1b/d20/l4f 0 2024-09-12T22:11:27.780 INFO:tasks.workunit.client.0.smithi019.stdout:5/459: write d0/f29 [5788507,104021] 0 2024-09-12T22:11:27.780 INFO:tasks.workunit.client.0.smithi019.stdout:4/403: creat d9/db/d2b/d6a/f81 x:0 0 0 2024-09-12T22:11:27.781 INFO:tasks.workunit.client.0.smithi019.stdout:0/431: dread d5/d7/de/f31 [0,4194304] 0 2024-09-12T22:11:27.781 INFO:tasks.workunit.client.0.smithi019.stdout:9/387: creat d12/d1b/d20/d29/d56/f81 x:0 0 0 2024-09-12T22:11:27.781 INFO:tasks.workunit.client.0.smithi019.stdout:4/404: rmdir d9/d14/d31/d3f 39 2024-09-12T22:11:27.781 INFO:tasks.workunit.client.0.smithi019.stdout:3/456: creat d18/d26/d30/d71/d86/f90 x:0 0 0 2024-09-12T22:11:27.782 INFO:tasks.workunit.client.0.smithi019.stdout:5/460: mkdir d0/d1d/d4f/d47/d57/d98 0 2024-09-12T22:11:27.783 INFO:tasks.workunit.client.0.smithi019.stdout:9/388: mknod d12/d1b/d20/d29/d56/c82 0 2024-09-12T22:11:27.783 INFO:tasks.workunit.client.0.smithi019.stdout:0/432: write d5/d7/d2c/d44/d6a/d52/f84 [693560,29206] 0 2024-09-12T22:11:27.784 INFO:tasks.workunit.client.0.smithi019.stdout:9/389: chown ff 13169 1 2024-09-12T22:11:27.784 INFO:tasks.workunit.client.0.smithi019.stdout:1/441: dread d1/d2/d18/d29/d27/f23 [0,4194304] 0 2024-09-12T22:11:27.784 INFO:tasks.workunit.client.0.smithi019.stdout:3/457: mkdir d18/d26/d30/d91 0 2024-09-12T22:11:27.785 INFO:tasks.workunit.client.0.smithi019.stdout:8/434: dread d5/dc/d17/f72 [0,4194304] 0 2024-09-12T22:11:27.785 INFO:tasks.workunit.client.0.smithi019.stdout:2/341: dwrite d0/d3/d11/fc [0,4194304] 0 2024-09-12T22:11:27.787 INFO:tasks.workunit.client.0.smithi019.stdout:9/390: mkdir d12/d1b/d20/d64/d83 0 2024-09-12T22:11:27.788 INFO:tasks.workunit.client.0.smithi019.stdout:8/435: chown d5/d16/d19/d29/c82 31293 1 2024-09-12T22:11:27.789 INFO:tasks.workunit.client.0.smithi019.stdout:1/442: dread - d1/d2/d18/d35/d84/dc/df/d53/d66/f8b zero size 2024-09-12T22:11:27.789 INFO:tasks.workunit.client.0.smithi019.stdout:0/433: truncate d5/d7/d2c/d44/f74 925129 0 2024-09-12T22:11:27.791 INFO:tasks.workunit.client.0.smithi019.stdout:7/469: mkdir da/d24/d28/d1c/d32/d99/d9f 0 2024-09-12T22:11:27.792 INFO:tasks.workunit.client.0.smithi019.stdout:5/461: dwrite d0/d4e/f78 [0,4194304] 0 2024-09-12T22:11:27.792 INFO:tasks.workunit.client.0.smithi019.stdout:6/458: dwrite d9/dc/d20/d30/d5b/f6d [0,4194304] 0 2024-09-12T22:11:27.794 INFO:tasks.workunit.client.0.smithi019.stdout:9/391: creat d12/d1b/d20/d29/d74/d77/f84 x:0 0 0 2024-09-12T22:11:27.795 INFO:tasks.workunit.client.0.smithi019.stdout:6/459: creat d9/f9d x:0 0 0 2024-09-12T22:11:27.795 INFO:tasks.workunit.client.0.smithi019.stdout:7/470: creat da/d19/d25/d39/fa0 x:0 0 0 2024-09-12T22:11:27.795 INFO:tasks.workunit.client.0.smithi019.stdout:5/462: truncate d0/f2 314753 0 2024-09-12T22:11:27.795 INFO:tasks.workunit.client.0.smithi019.stdout:6/460: unlink l0 0 2024-09-12T22:11:27.796 INFO:tasks.workunit.client.0.smithi019.stdout:9/392: mkdir d12/d1b/d40/d85 0 2024-09-12T22:11:27.797 INFO:tasks.workunit.client.0.smithi019.stdout:3/458: dwrite d18/d26/d30/d4e/f60 [4194304,4194304] 0 2024-09-12T22:11:27.797 INFO:tasks.workunit.client.0.smithi019.stdout:5/463: write d0/d1d/f22 [822946,126165] 0 2024-09-12T22:11:27.797 INFO:tasks.workunit.client.0.smithi019.stdout:9/393: readlink d12/d1b/d20/l4e 0 2024-09-12T22:11:27.798 INFO:tasks.workunit.client.0.smithi019.stdout:1/443: dwrite d1/d2/d18/d35/d84/dc/f69 [0,4194304] 0 2024-09-12T22:11:27.798 INFO:tasks.workunit.client.0.smithi019.stdout:9/394: stat d12/d1b/d20/l4e 0 2024-09-12T22:11:27.799 INFO:tasks.workunit.client.0.smithi019.stdout:6/461: fsync d9/dc/f74 0 2024-09-12T22:11:27.799 INFO:tasks.workunit.client.0.smithi019.stdout:5/464: unlink d0/d24/l54 0 2024-09-12T22:11:27.799 INFO:tasks.workunit.client.0.smithi019.stdout:3/459: creat d18/d26/d30/d4a/f92 x:0 0 0 2024-09-12T22:11:27.800 INFO:tasks.workunit.client.0.smithi019.stdout:1/444: write d1/d2/d18/d35/d84/dc/df/d53/d55/f6b [476072,129130] 0 2024-09-12T22:11:27.801 INFO:tasks.workunit.client.0.smithi019.stdout:9/395: chown d12/d1b/d20/f36 33643959 1 2024-09-12T22:11:27.803 INFO:tasks.workunit.client.0.smithi019.stdout:6/462: symlink d9/dc/d20/d30/l9e 0 2024-09-12T22:11:27.803 INFO:tasks.workunit.client.0.smithi019.stdout:9/396: rmdir d12 39 2024-09-12T22:11:27.803 INFO:tasks.workunit.client.0.smithi019.stdout:0/434: truncate d5/d7/f12 646285 0 2024-09-12T22:11:27.804 INFO:tasks.workunit.client.0.smithi019.stdout:1/445: creat d1/d2/d18/d59/f9f x:0 0 0 2024-09-12T22:11:27.805 INFO:tasks.workunit.client.0.smithi019.stdout:6/463: unlink d9/dc/f74 0 2024-09-12T22:11:27.805 INFO:tasks.workunit.client.0.smithi019.stdout:7/471: write da/d24/d28/f15 [7036230,41358] 0 2024-09-12T22:11:27.805 INFO:tasks.workunit.client.0.smithi019.stdout:3/460: dwrite d18/d26/d30/d4a/f68 [0,4194304] 0 2024-09-12T22:11:27.806 INFO:tasks.workunit.client.0.smithi019.stdout:1/446: mknod d1/d2/d18/d35/d84/d98/ca0 0 2024-09-12T22:11:27.806 INFO:tasks.workunit.client.0.smithi019.stdout:3/461: symlink d18/d26/d30/d4e/l93 0 2024-09-12T22:11:27.806 INFO:tasks.workunit.client.0.smithi019.stdout:7/472: creat da/d24/d28/d1c/d32/d99/fa1 x:0 0 0 2024-09-12T22:11:27.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/464: truncate d9/dc/d20/d4b/f28 973254 0 2024-09-12T22:11:27.807 INFO:tasks.workunit.client.0.smithi019.stdout:3/462: mknod d18/d1d/c94 0 2024-09-12T22:11:27.807 INFO:tasks.workunit.client.0.smithi019.stdout:1/447: write d1/d2/d18/d35/d84/dc/f19 [7722077,380] 0 2024-09-12T22:11:27.808 INFO:tasks.workunit.client.0.smithi019.stdout:3/463: symlink d18/d26/d30/d4a/l95 0 2024-09-12T22:11:27.808 INFO:tasks.workunit.client.0.smithi019.stdout:6/465: rename d9/dc/d20/d30/c5a to d9/dc/d20/d4b/d64/d78/c9f 0 2024-09-12T22:11:27.809 INFO:tasks.workunit.client.0.smithi019.stdout:1/448: dread - d1/d2/d18/d35/d84/dc/df/d2c/f42 zero size 2024-09-12T22:11:27.809 INFO:tasks.workunit.client.0.smithi019.stdout:5/465: write d0/d1d/d4f/f1a [2367155,127352] 0 2024-09-12T22:11:27.809 INFO:tasks.workunit.client.0.smithi019.stdout:3/464: symlink d18/d26/l96 0 2024-09-12T22:11:27.809 INFO:tasks.workunit.client.0.smithi019.stdout:6/466: read - d9/dc/d20/d4b/d64/d7e/f87 zero size 2024-09-12T22:11:27.810 INFO:tasks.workunit.client.0.smithi019.stdout:1/449: rmdir d1/d2/d18/d35/d84 39 2024-09-12T22:11:27.810 INFO:tasks.workunit.client.0.smithi019.stdout:3/465: chown d18/d1d/l22 5759073 1 2024-09-12T22:11:27.810 INFO:tasks.workunit.client.0.smithi019.stdout:6/467: write d9/dc/d20/d4b/d64/d7e/f87 [319683,9934] 0 2024-09-12T22:11:27.811 INFO:tasks.workunit.client.0.smithi019.stdout:6/468: chown d9/dc/f4d 12747073 1 2024-09-12T22:11:27.811 INFO:tasks.workunit.client.0.smithi019.stdout:1/450: chown d1/d2/d18/d35/d84/dc/df/d53/d55/f6b 2 1 2024-09-12T22:11:27.813 INFO:tasks.workunit.client.0.smithi019.stdout:0/435: write d5/d7/d2c/d81/f86 [3551537,33087] 0 2024-09-12T22:11:27.814 INFO:tasks.workunit.client.0.smithi019.stdout:0/436: chown d5/d7/d10/c78 402 1 2024-09-12T22:11:27.815 INFO:tasks.workunit.client.0.smithi019.stdout:1/451: write d1/d2/d18/d35/d84/dc/df/d2c/f49 [886075,29286] 0 2024-09-12T22:11:27.817 INFO:tasks.workunit.client.0.smithi019.stdout:0/437: mkdir d5/d7/de/d8d 0 2024-09-12T22:11:27.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/452: mkdir d1/da1 0 2024-09-12T22:11:27.818 INFO:tasks.workunit.client.0.smithi019.stdout:6/469: dwrite d9/f4e [0,4194304] 0 2024-09-12T22:11:27.819 INFO:tasks.workunit.client.0.smithi019.stdout:0/438: chown d5/d7/d2c/d44/d6a/d52/f7b 4 1 2024-09-12T22:11:27.819 INFO:tasks.workunit.client.0.smithi019.stdout:6/470: dread - d9/dc/d20/d4b/d6c/f70 zero size 2024-09-12T22:11:27.819 INFO:tasks.workunit.client.0.smithi019.stdout:3/466: dwrite f8 [0,4194304] 0 2024-09-12T22:11:27.820 INFO:tasks.workunit.client.0.smithi019.stdout:6/471: dread - d9/dc/d20/d4b/f75 zero size 2024-09-12T22:11:27.823 INFO:tasks.workunit.client.0.smithi019.stdout:0/439: truncate d5/f22 5142096 0 2024-09-12T22:11:27.823 INFO:tasks.workunit.client.0.smithi019.stdout:1/453: mkdir d1/d2/da2 0 2024-09-12T22:11:27.823 INFO:tasks.workunit.client.0.smithi019.stdout:3/467: creat d18/f97 x:0 0 0 2024-09-12T22:11:27.823 INFO:tasks.workunit.client.0.smithi019.stdout:0/440: readlink d5/d7/de/l3d 0 2024-09-12T22:11:27.824 INFO:tasks.workunit.client.0.smithi019.stdout:9/397: dread d12/f17 [0,4194304] 0 2024-09-12T22:11:27.824 INFO:tasks.workunit.client.0.smithi019.stdout:3/468: creat d18/d26/d30/d91/f98 x:0 0 0 2024-09-12T22:11:27.827 INFO:tasks.workunit.client.0.smithi019.stdout:3/469: chown d18/d26/d30/d71/d86/f90 239607913 1 2024-09-12T22:11:27.827 INFO:tasks.workunit.client.0.smithi019.stdout:9/398: dread d12/d1b/d20/f5c [0,4194304] 0 2024-09-12T22:11:27.827 INFO:tasks.workunit.client.0.smithi019.stdout:2/342: dread d0/d31/d4/f22 [0,4194304] 0 2024-09-12T22:11:27.828 INFO:tasks.workunit.client.0.smithi019.stdout:6/472: dwrite d9/d3d/f61 [0,4194304] 0 2024-09-12T22:11:27.829 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.828+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.830 INFO:tasks.workunit.client.0.smithi019.stdout:9/399: mkdir d12/d1b/d20/d29/d74/d77/d86 0 2024-09-12T22:11:27.830 INFO:tasks.workunit.client.0.smithi019.stdout:1/454: dwrite d1/d2/d18/d59/f9f [0,4194304] 0 2024-09-12T22:11:27.831 INFO:tasks.workunit.client.0.smithi019.stdout:9/400: write fe [6977738,115300] 0 2024-09-12T22:11:27.831 INFO:tasks.workunit.client.0.smithi019.stdout:0/441: dwrite d5/d7/d2c/d44/d6a/d76/f7e [0,4194304] 0 2024-09-12T22:11:27.831 INFO:tasks.workunit.client.0.smithi019.stdout:6/473: symlink d9/d3d/d6f/la0 0 2024-09-12T22:11:27.833 INFO:tasks.workunit.client.0.smithi019.stdout:6/474: fsync d9/d3d/d6f/f67 0 2024-09-12T22:11:27.834 INFO:tasks.workunit.client.0.smithi019.stdout:6/475: fdatasync d9/dc/d20/d4b/d6c/f70 0 2024-09-12T22:11:27.834 INFO:tasks.workunit.client.0.smithi019.stdout:3/470: rename d18/d26/d30/d4a/f6e to d18/d26/d30/d4e/f99 0 2024-09-12T22:11:27.834 INFO:tasks.workunit.client.0.smithi019.stdout:9/401: unlink d12/c2e 0 2024-09-12T22:11:27.835 INFO:tasks.workunit.client.0.smithi019.stdout:0/442: symlink d5/d7/d2c/l8e 0 2024-09-12T22:11:27.837 INFO:tasks.workunit.client.0.smithi019.stdout:1/455: symlink d1/d2/d18/d35/d84/la3 0 2024-09-12T22:11:27.837 INFO:tasks.workunit.client.0.smithi019.stdout:0/443: unlink d5/d7/de/c77 0 2024-09-12T22:11:27.837 INFO:tasks.workunit.client.0.smithi019.stdout:9/402: write d12/f15 [1204268,72185] 0 2024-09-12T22:11:27.838 INFO:tasks.workunit.client.0.smithi019.stdout:2/343: dwrite d0/d31/d4/d7/f45 [0,4194304] 0 2024-09-12T22:11:27.838 INFO:tasks.workunit.client.0.smithi019.stdout:0/444: fdatasync d5/f70 0 2024-09-12T22:11:27.839 INFO:tasks.workunit.client.0.smithi019.stdout:9/403: truncate d12/d1b/d40/f70 659376 0 2024-09-12T22:11:27.840 INFO:tasks.workunit.client.0.smithi019.stdout:0/445: fsync d5/d7/d2c/d44/f45 0 2024-09-12T22:11:27.841 INFO:tasks.workunit.client.0.smithi019.stdout:2/344: symlink d0/d31/d12/d3b/d5c/l6e 0 2024-09-12T22:11:27.841 INFO:tasks.workunit.client.0.smithi019.stdout:0/446: rmdir d5/d7/d10/d26 39 2024-09-12T22:11:27.842 INFO:tasks.workunit.client.0.smithi019.stdout:2/345: chown d0/d3/df/d18/d2c/d4c 197 1 2024-09-12T22:11:27.842 INFO:tasks.workunit.client.0.smithi019.stdout:6/476: dwrite d9/dc/ff [4194304,4194304] 0 2024-09-12T22:11:27.847 INFO:tasks.workunit.client.0.smithi019.stdout:4/405: sync 2024-09-12T22:11:27.847 INFO:tasks.workunit.client.0.smithi019.stdout:5/466: sync 2024-09-12T22:11:27.847 INFO:tasks.workunit.client.0.smithi019.stdout:2/346: link d0/d3/d11/d2e/d34/d51/c5f d0/d31/d4/c6f 0 2024-09-12T22:11:27.847 INFO:tasks.workunit.client.0.smithi019.stdout:9/404: dwrite d12/d1b/d20/d29/d56/d60/f7a [0,4194304] 0 2024-09-12T22:11:27.849 INFO:tasks.workunit.client.0.smithi019.stdout:5/467: fsync d0/d1d/d3d/f90 0 2024-09-12T22:11:27.849 INFO:tasks.workunit.client.0.smithi019.stdout:0/447: rename d5/d7/de/l3f to d5/d7/d10/d26/l8f 0 2024-09-12T22:11:27.849 INFO:tasks.workunit.client.0.smithi019.stdout:1/456: read d1/d2/d18/d35/d84/dc/df/d61/f52 [633368,81441] 0 2024-09-12T22:11:27.852 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:27.852 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:27.853 INFO:tasks.workunit.client.0.smithi019.stdout:7/473: dread da/d24/d28/f15 [4194304,4194304] 0 2024-09-12T22:11:27.853 INFO:tasks.workunit.client.0.smithi019.stdout:2/347: chown d0/d3/df/d18/d2c/d30/d32/f4a 3157495 1 2024-09-12T22:11:27.853 INFO:tasks.workunit.client.0.smithi019.stdout:9/405: getdents d12/d1b/d40/d52 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:1/457: fdatasync d1/d2/d18/d35/f3a 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:0/448: unlink d5/d7/de/f54 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:5/468: truncate d0/d4e/d50/f6c 117955 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:5/469: chown d0/d1d/d4f/f4d 30 1 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:2/348: mkdir d0/d3/d11/d2e/d70 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:9/406: symlink d12/d1b/d20/d64/d83/l87 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:7/474: getdents da/d19/d25/d39 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:4/406: read d9/db/fd [5309282,102659] 0 2024-09-12T22:11:27.854 INFO:tasks.workunit.client.0.smithi019.stdout:7/475: rename da/d19 to da/d19/d25/d39/d51/da2 22 2024-09-12T22:11:27.855 INFO:tasks.workunit.client.0.smithi019.stdout:9/407: mkdir d12/d1b/d20/d29/d88 0 2024-09-12T22:11:27.856 INFO:tasks.workunit.client.0.smithi019.stdout:6/477: truncate d9/dc/d20/d30/f38 2950683 0 2024-09-12T22:11:27.856 INFO:tasks.workunit.client.0.smithi019.stdout:2/349: getdents d0/d3/d21/d36 0 2024-09-12T22:11:27.857 INFO:tasks.workunit.client.0.smithi019.stdout:4/407: symlink d9/d14/d31/d3f/l82 0 2024-09-12T22:11:27.857 INFO:tasks.workunit.client.0.smithi019.stdout:1/458: dwrite d1/fe [0,4194304] 0 2024-09-12T22:11:27.857 INFO:tasks.workunit.client.0.smithi019.stdout:0/449: dwrite d5/d7/f4a [0,4194304] 0 2024-09-12T22:11:27.858 INFO:tasks.workunit.client.0.smithi019.stdout:7/476: write da/d24/d28/d1c/d32/f8d [2687193,89421] 0 2024-09-12T22:11:27.859 INFO:tasks.workunit.client.0.smithi019.stdout:1/459: readlink d1/d2/l16 0 2024-09-12T22:11:27.859 INFO:tasks.workunit.client.0.smithi019.stdout:2/350: write d0/d3/d11/fc [1493132,118948] 0 2024-09-12T22:11:27.859 INFO:tasks.workunit.client.0.smithi019.stdout:7/477: readlink da/d19/l1f 0 2024-09-12T22:11:27.861 INFO:tasks.workunit.client.0.smithi019.stdout:3/471: dread d18/d26/d30/d71/f74 [0,4194304] 0 2024-09-12T22:11:27.861 INFO:tasks.workunit.client.0.smithi019.stdout:4/408: symlink d9/d14/d57/d69/d6f/l83 0 2024-09-12T22:11:27.861 INFO:tasks.workunit.client.0.smithi019.stdout:4/409: creat d9/d17/f84 x:0 0 0 2024-09-12T22:11:27.863 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:27.864 INFO:tasks.workunit.client.0.smithi019.stdout:1/460: link d1/d2/d18/d35/d84/dc/df/l78 d1/d37/la4 0 2024-09-12T22:11:27.864 INFO:tasks.workunit.client.0.smithi019.stdout:4/410: creat d9/d14/d33/d4e/f85 x:0 0 0 2024-09-12T22:11:27.865 INFO:tasks.workunit.client.0.smithi019.stdout:9/408: truncate d12/f15 46879 0 2024-09-12T22:11:27.865 INFO:tasks.workunit.client.0.smithi019.stdout:7/478: dwrite da/d19/f88 [0,4194304] 0 2024-09-12T22:11:27.866 INFO:tasks.workunit.client.0.smithi019.stdout:9/409: chown f11 4073 1 2024-09-12T22:11:27.867 INFO:tasks.workunit.client.0.smithi019.stdout:5/470: dread d0/d1d/d4f/f4b [0,4194304] 0 2024-09-12T22:11:27.868 INFO:tasks.workunit.client.0.smithi019.stdout:7/479: fdatasync da/d19/d25/d39/d51/f75 0 2024-09-12T22:11:27.869 INFO:tasks.workunit.client.0.smithi019.stdout:1/461: dwrite d1/d37/f65 [0,4194304] 0 2024-09-12T22:11:27.869 INFO:tasks.workunit.client.0.smithi019.stdout:4/411: rename d9/db/l35 to d9/db/d2b/d6a/d7d/l86 0 2024-09-12T22:11:27.870 INFO:tasks.workunit.client.0.smithi019.stdout:5/471: write d0/f11 [3349043,126587] 0 2024-09-12T22:11:27.871 INFO:tasks.workunit.client.0.smithi019.stdout:1/462: write d1/d2/d18/d29/f9b [907052,75648] 0 2024-09-12T22:11:27.872 INFO:tasks.workunit.client.0.smithi019.stdout:0/450: write d5/d7/d10/d26/d2a/f5d [789480,36733] 0 2024-09-12T22:11:27.873 INFO:tasks.workunit.client.0.smithi019.stdout:1/463: write d1/d2/d18/d29/d27/f6a [972242,98278] 0 2024-09-12T22:11:27.873 INFO:tasks.workunit.client.0.smithi019.stdout:1/464: readlink d1/d2/d18/d59/l86 0 2024-09-12T22:11:27.874 INFO:tasks.workunit.client.0.smithi019.stdout:0/451: symlink d5/d87/l90 0 2024-09-12T22:11:27.874 INFO:tasks.workunit.client.0.smithi019.stdout:8/436: sync 2024-09-12T22:11:27.875 INFO:tasks.workunit.client.0.smithi019.stdout:1/465: stat d1/d2/d18/d35/d84/dc/df/d53/d55/d56/l57 0 2024-09-12T22:11:27.876 INFO:tasks.workunit.client.0.smithi019.stdout:4/412: dread d9/d17/f4f [0,4194304] 0 2024-09-12T22:11:27.877 INFO:tasks.workunit.client.0.smithi019.stdout:6/478: dread d9/dc/d20/d4b/d64/d7e/f87 [0,4194304] 0 2024-09-12T22:11:27.877 INFO:tasks.workunit.client.0.smithi019.stdout:9/410: read d12/d1b/d20/d29/f2d [1222205,129812] 0 2024-09-12T22:11:27.877 INFO:tasks.workunit.client.0.smithi019.stdout:1/466: link d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f79 d1/d2/da2/fa5 0 2024-09-12T22:11:27.878 INFO:tasks.workunit.client.0.smithi019.stdout:4/413: getdents d9/d58 0 2024-09-12T22:11:27.879 INFO:tasks.workunit.client.0.smithi019.stdout:9/411: rename f0 to d12/d1b/d20/d29/d88/f89 0 2024-09-12T22:11:27.879 INFO:tasks.workunit.client.0.smithi019.stdout:6/479: mkdir d9/dc/d20/d4b/d64/d78/da1 0 2024-09-12T22:11:27.880 INFO:tasks.workunit.client.0.smithi019.stdout:5/472: dread d0/d1d/d3d/f69 [0,4194304] 0 2024-09-12T22:11:27.880 INFO:tasks.workunit.client.0.smithi019.stdout:4/414: dread d9/d14/d31/d3f/f48 [0,4194304] 0 2024-09-12T22:11:27.881 INFO:tasks.workunit.client.0.smithi019.stdout:5/473: chown d0/d26/c79 2115 1 2024-09-12T22:11:27.881 INFO:tasks.workunit.client.0.smithi019.stdout:9/412: creat d12/d1b/f8a x:0 0 0 2024-09-12T22:11:27.881 INFO:tasks.workunit.client.0.smithi019.stdout:6/480: creat d9/dc/d20/d4b/d6c/fa2 x:0 0 0 2024-09-12T22:11:27.882 INFO:tasks.workunit.client.0.smithi019.stdout:6/481: mknod d9/d3d/d6f/ca3 0 2024-09-12T22:11:27.883 INFO:tasks.workunit.client.0.smithi019.stdout:5/474: creat d0/d1d/d4f/d47/f99 x:0 0 0 2024-09-12T22:11:27.883 INFO:tasks.workunit.client.0.smithi019.stdout:9/413: readlink d12/d1b/d20/d29/d56/l6e 0 2024-09-12T22:11:27.884 INFO:tasks.workunit.client.0.smithi019.stdout:4/415: getdents d9/d14/d57/d5e 0 2024-09-12T22:11:27.884 INFO:tasks.workunit.client.0.smithi019.stdout:1/467: dwrite d1/d37/f64 [0,4194304] 0 2024-09-12T22:11:27.885 INFO:tasks.workunit.client.0.smithi019.stdout:4/416: write d9/d17/f2c [412858,67721] 0 2024-09-12T22:11:27.886 INFO:tasks.workunit.client.0.smithi019.stdout:5/475: unlink d0/d24/d7a/f7e 0 2024-09-12T22:11:27.886 INFO:tasks.workunit.client.0.smithi019.stdout:9/414: unlink d12/d1b/d20/d25/f7b 0 2024-09-12T22:11:27.886 INFO:tasks.workunit.client.0.smithi019.stdout:1/468: rmdir d1/d2/d18/d35/d84/dc 39 2024-09-12T22:11:27.887 INFO:tasks.workunit.client.0.smithi019.stdout:4/417: mkdir d9/d87 0 2024-09-12T22:11:27.887 INFO:tasks.workunit.client.0.smithi019.stdout:9/415: symlink d12/d48/l8b 0 2024-09-12T22:11:27.887 INFO:tasks.workunit.client.0.smithi019.stdout:5/476: creat d0/d24/d7a/f9a x:0 0 0 2024-09-12T22:11:27.888 INFO:tasks.workunit.client.0.smithi019.stdout:3/472: dread d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:27.888 INFO:tasks.workunit.client.0.smithi019.stdout:4/418: creat d9/d4c/f88 x:0 0 0 2024-09-12T22:11:27.888 INFO:tasks.workunit.client.0.smithi019.stdout:6/482: dread d9/dc/ff [0,4194304] 0 2024-09-12T22:11:27.889 INFO:tasks.workunit.client.0.smithi019.stdout:1/469: readlink d1/d2/d18/d35/d84/dc/df/l10 0 2024-09-12T22:11:27.889 INFO:tasks.workunit.client.0.smithi019.stdout:5/477: symlink d0/d1d/l9b 0 2024-09-12T22:11:27.890 INFO:tasks.workunit.client.0.smithi019.stdout:6/483: symlink d9/dc/d20/d71/la4 0 2024-09-12T22:11:27.890 INFO:tasks.workunit.client.0.smithi019.stdout:9/416: rename d12/d1b/d20/d25/f3b to d12/d1b/d40/d52/d62/f8c 0 2024-09-12T22:11:27.890 INFO:tasks.workunit.client.0.smithi019.stdout:6/484: dread - d9/d6b/f82 zero size 2024-09-12T22:11:27.891 INFO:tasks.workunit.client.0.smithi019.stdout:5/478: creat d0/f9c x:0 0 0 2024-09-12T22:11:27.891 INFO:tasks.workunit.client.0.smithi019.stdout:4/419: rename d9/d14/d31/d3f/l5d to d9/d14/d57/d5e/l89 0 2024-09-12T22:11:27.892 INFO:tasks.workunit.client.0.smithi019.stdout:6/485: truncate d9/dc/ff 9071935 0 2024-09-12T22:11:27.892 INFO:tasks.workunit.client.0.smithi019.stdout:4/420: symlink d9/db/d2b/d6a/d7d/l8a 0 2024-09-12T22:11:27.892 INFO:tasks.workunit.client.0.smithi019.stdout:5/479: truncate d0/d1d/d6d/f94 171735 0 2024-09-12T22:11:27.893 INFO:tasks.workunit.client.0.smithi019.stdout:9/417: write d12/d48/f6d [313253,7914] 0 2024-09-12T22:11:27.894 INFO:tasks.workunit.client.0.smithi019.stdout:5/480: creat d0/d26/d6f/f9d x:0 0 0 2024-09-12T22:11:27.894 INFO:tasks.workunit.client.0.smithi019.stdout:4/421: creat d9/d14/d31/f8b x:0 0 0 2024-09-12T22:11:27.896 INFO:tasks.workunit.client.0.smithi019.stdout:4/422: mknod d9/d14/d33/c8c 0 2024-09-12T22:11:27.896 INFO:tasks.workunit.client.0.smithi019.stdout:5/481: creat d0/d26/d5f/f9e x:0 0 0 2024-09-12T22:11:27.896 INFO:tasks.workunit.client.0.smithi019.stdout:1/470: dread d1/d2/d18/d70/f7a [0,4194304] 0 2024-09-12T22:11:27.897 INFO:tasks.workunit.client.0.smithi019.stdout:4/423: dread - d9/d14/d33/f6b zero size 2024-09-12T22:11:27.898 INFO:tasks.workunit.client.0.smithi019.stdout:5/482: mknod d0/d1d/d4f/d47/d57/d98/c9f 0 2024-09-12T22:11:27.899 INFO:tasks.workunit.client.0.smithi019.stdout:4/424: symlink d9/d14/d31/l8d 0 2024-09-12T22:11:27.899 INFO:tasks.workunit.client.0.smithi019.stdout:1/471: creat d1/d2/d18/d35/d84/dc/fa6 x:0 0 0 2024-09-12T22:11:27.900 INFO:tasks.workunit.client.0.smithi019.stdout:6/486: dwrite d9/dc/d20/d4b/d64/d78/f8e [0,4194304] 0 2024-09-12T22:11:27.900 INFO:tasks.workunit.client.0.smithi019.stdout:5/483: fdatasync d0/d1d/d3d/f53 0 2024-09-12T22:11:27.900 INFO:tasks.workunit.client.0.smithi019.stdout:4/425: stat d9/db/d2b/f37 0 2024-09-12T22:11:27.900 INFO:tasks.workunit.client.0.smithi019.stdout:9/418: dwrite f11 [0,4194304] 0 2024-09-12T22:11:27.902 INFO:tasks.workunit.client.0.smithi019.stdout:9/419: write d12/d1b/d20/f36 [5521874,97882] 0 2024-09-12T22:11:27.903 INFO:tasks.workunit.client.0.smithi019.stdout:9/420: fsync f5 0 2024-09-12T22:11:27.903 INFO:tasks.workunit.client.0.smithi019.stdout:1/472: truncate d1/d2/d18/d35/d84/dc/df/d61/f44 5743825 0 2024-09-12T22:11:27.905 INFO:tasks.workunit.client.0.smithi019.stdout:5/484: getdents d0/d1d/d4f/d96 0 2024-09-12T22:11:27.905 INFO:tasks.workunit.client.0.smithi019.stdout:4/426: mknod d9/db/c8e 0 2024-09-12T22:11:27.905 INFO:tasks.workunit.client.0.smithi019.stdout:6/487: chown d9/dc/d20/d30/l41 21 1 2024-09-12T22:11:27.905 INFO:tasks.workunit.client.0.smithi019.stdout:9/421: dread - d12/d1b/f3a zero size 2024-09-12T22:11:27.905 INFO:tasks.workunit.client.0.smithi019.stdout:5/485: rmdir d0/d1d 39 2024-09-12T22:11:27.905 INFO:tasks.workunit.client.0.smithi019.stdout:4/427: write d9/f2f [3261790,91269] 0 2024-09-12T22:11:27.906 INFO:tasks.workunit.client.0.smithi019.stdout:4/428: write f4 [2732482,70924] 0 2024-09-12T22:11:27.907 INFO:tasks.workunit.client.0.smithi019.stdout:5/486: rename d0/d24/f36 to d0/d26/d3a/fa0 0 2024-09-12T22:11:27.907 INFO:tasks.workunit.client.0.smithi019.stdout:6/488: write d9/dc/d20/d4b/f75 [94259,55541] 0 2024-09-12T22:11:27.908 INFO:tasks.workunit.client.0.smithi019.stdout:4/429: mkdir d9/d73/d8f 0 2024-09-12T22:11:27.908 INFO:tasks.workunit.client.0.smithi019.stdout:1/473: rename d1/fe to d1/d2/d18/d35/d84/dc/df/d61/fa7 0 2024-09-12T22:11:27.909 INFO:tasks.workunit.client.0.smithi019.stdout:3/473: dread d18/f3e [0,4194304] 0 2024-09-12T22:11:27.909 INFO:tasks.workunit.client.0.smithi019.stdout:5/487: creat d0/d26/fa1 x:0 0 0 2024-09-12T22:11:27.909 INFO:tasks.workunit.client.0.smithi019.stdout:4/430: write d9/d14/f38 [8704483,17326] 0 2024-09-12T22:11:27.910 INFO:tasks.workunit.client.0.smithi019.stdout:9/422: dwrite d12/d1b/d20/f2b [0,4194304] 0 2024-09-12T22:11:27.911 INFO:tasks.workunit.client.0.smithi019.stdout:1/474: write d1/d2/d18/d29/d51/f5c [4205123,17247] 0 2024-09-12T22:11:27.911 INFO:tasks.workunit.client.0.smithi019.stdout:4/431: write d9/db/d2b/f30 [6475374,69491] 0 2024-09-12T22:11:27.911 INFO:tasks.workunit.client.0.smithi019.stdout:9/423: write d12/d1b/d40/f6f [735742,61452] 0 2024-09-12T22:11:27.912 INFO:tasks.workunit.client.0.smithi019.stdout:4/432: readlink d9/d14/d31/d3f/l70 0 2024-09-12T22:11:27.913 INFO:tasks.workunit.client.0.smithi019.stdout:5/488: fdatasync d0/d4e/d50/f7b 0 2024-09-12T22:11:27.913 INFO:tasks.workunit.client.0.smithi019.stdout:9/424: symlink d12/d1b/d40/d52/l8d 0 2024-09-12T22:11:27.913 INFO:tasks.workunit.client.0.smithi019.stdout:0/452: sync 2024-09-12T22:11:27.914 INFO:tasks.workunit.client.0.smithi019.stdout:8/437: sync 2024-09-12T22:11:27.914 INFO:tasks.workunit.client.0.smithi019.stdout:2/351: sync 2024-09-12T22:11:27.914 INFO:tasks.workunit.client.0.smithi019.stdout:7/480: sync 2024-09-12T22:11:27.915 INFO:tasks.workunit.client.0.smithi019.stdout:6/489: dwrite d9/dc/d20/d4b/f2d [0,4194304] 0 2024-09-12T22:11:27.915 INFO:tasks.workunit.client.0.smithi019.stdout:9/425: chown d12/f45 1009240 1 2024-09-12T22:11:27.915 INFO:tasks.workunit.client.0.smithi019.stdout:2/352: chown d0/d31/d4/f3f 44534 1 2024-09-12T22:11:27.916 INFO:tasks.workunit.client.0.smithi019.stdout:8/438: fdatasync d5/d16/d19/f3c 0 2024-09-12T22:11:27.916 INFO:tasks.workunit.client.0.smithi019.stdout:1/475: getdents d1/d2/d18/d35/d84/dc/df/d2c 0 2024-09-12T22:11:27.917 INFO:tasks.workunit.client.0.smithi019.stdout:5/489: creat d0/d1d/d4f/d96/fa2 x:0 0 0 2024-09-12T22:11:27.917 INFO:tasks.workunit.client.0.smithi019.stdout:7/481: creat da/d19/d25/d39/fa3 x:0 0 0 2024-09-12T22:11:27.918 INFO:tasks.workunit.client.0.smithi019.stdout:2/353: mkdir d0/d31/d12/d3b/d5c/d71 0 2024-09-12T22:11:27.918 INFO:tasks.workunit.client.0.smithi019.stdout:1/476: fsync d1/d2/d18/d35/d84/dc/df/d53/d55/f6b 0 2024-09-12T22:11:27.918 INFO:tasks.workunit.client.0.smithi019.stdout:0/453: creat d5/d7/f91 x:0 0 0 2024-09-12T22:11:27.920 INFO:tasks.workunit.client.0.smithi019.stdout:5/490: dread - d0/d26/d3a/f5c zero size 2024-09-12T22:11:27.920 INFO:tasks.workunit.client.0.smithi019.stdout:1/477: chown d1/d2/d18/d35/d84/dc/df/f74 46425 1 2024-09-12T22:11:27.920 INFO:tasks.workunit.client.0.smithi019.stdout:7/482: creat da/d19/fa4 x:0 0 0 2024-09-12T22:11:27.921 INFO:tasks.workunit.client.0.smithi019.stdout:9/426: write d12/d1b/d40/f5e [849823,95204] 0 2024-09-12T22:11:27.921 INFO:tasks.workunit.client.0.smithi019.stdout:4/433: write f5 [3109931,40654] 0 2024-09-12T22:11:27.921 INFO:tasks.workunit.client.0.smithi019.stdout:0/454: link d5/d7/d2c/d44/d6a/f4f d5/d7/d10/d26/d2a/f92 0 2024-09-12T22:11:27.921 INFO:tasks.workunit.client.0.smithi019.stdout:7/483: chown da/d19/l1f 4994 1 2024-09-12T22:11:27.921 INFO:tasks.workunit.client.0.smithi019.stdout:1/478: fdatasync d1/d2/d18/d29/d27/f6a 0 2024-09-12T22:11:27.922 INFO:tasks.workunit.client.0.smithi019.stdout:8/439: dread d5/d16/d19/f45 [0,4194304] 0 2024-09-12T22:11:27.924 INFO:tasks.workunit.client.0.smithi019.stdout:7/484: mkdir da/d30/da5 0 2024-09-12T22:11:27.924 INFO:tasks.workunit.client.0.smithi019.stdout:8/440: rmdir d5/dc/d17 39 2024-09-12T22:11:27.924 INFO:tasks.workunit.client.0.smithi019.stdout:0/455: truncate d5/d7/d2c/d44/d6a/f59 941881 0 2024-09-12T22:11:27.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/427: read d12/d1b/d20/f5c [26620,85525] 0 2024-09-12T22:11:27.927 INFO:tasks.workunit.client.0.smithi019.stdout:8/441: symlink d5/dc/d26/d5c/l90 0 2024-09-12T22:11:27.927 INFO:tasks.workunit.client.0.smithi019.stdout:7/485: symlink da/d19/d79/la6 0 2024-09-12T22:11:27.928 INFO:tasks.workunit.client.0.smithi019.stdout:0/456: write d5/d7/f91 [5877,61389] 0 2024-09-12T22:11:27.928 INFO:tasks.workunit.client.0.smithi019.stdout:9/428: symlink d12/d1b/d20/d29/d56/l8e 0 2024-09-12T22:11:27.929 INFO:tasks.workunit.client.0.smithi019.stdout:2/354: dwrite d0/d3/df/d18/d2c/d2d/f54 [0,4194304] 0 2024-09-12T22:11:27.929 INFO:tasks.workunit.client.0.smithi019.stdout:5/491: dwrite d0/d1d/d4f/d47/d57/f6e [0,4194304] 0 2024-09-12T22:11:27.932 INFO:tasks.workunit.client.0.smithi019.stdout:1/479: dwrite d1/d2/f24 [0,4194304] 0 2024-09-12T22:11:27.932 INFO:tasks.workunit.client.0.smithi019.stdout:7/486: chown da/d19/d25/d39/f6b 191259348 1 2024-09-12T22:11:27.934 INFO:tasks.workunit.client.0.smithi019.stdout:7/487: readlink da/d30/l65 0 2024-09-12T22:11:27.936 INFO:tasks.workunit.client.0.smithi019.stdout:2/355: dread d0/d31/d4/f22 [4194304,4194304] 0 2024-09-12T22:11:27.937 INFO:tasks.workunit.client.0.smithi019.stdout:3/474: dread d18/f1b [0,4194304] 0 2024-09-12T22:11:27.937 INFO:tasks.workunit.client.0.smithi019.stdout:9/429: unlink d12/d1b/d20/d29/d56/d60/f68 0 2024-09-12T22:11:27.939 INFO:tasks.workunit.client.0.smithi019.stdout:1/480: creat d1/fa8 x:0 0 0 2024-09-12T22:11:27.939 INFO:tasks.workunit.client.0.smithi019.stdout:7/488: symlink da/d8f/la7 0 2024-09-12T22:11:27.939 INFO:tasks.workunit.client.0.smithi019.stdout:9/430: write d12/d1b/f3a [429176,69845] 0 2024-09-12T22:11:27.940 INFO:tasks.workunit.client.0.smithi019.stdout:0/457: dwrite d5/d7/d10/d26/d2a/f37 [0,4194304] 0 2024-09-12T22:11:27.940 INFO:tasks.workunit.client.0.smithi019.stdout:7/489: symlink da/d30/d9c/la8 0 2024-09-12T22:11:27.941 INFO:tasks.workunit.client.0.smithi019.stdout:9/431: fdatasync d12/f55 0 2024-09-12T22:11:27.941 INFO:tasks.workunit.client.0.smithi019.stdout:6/490: sync 2024-09-12T22:11:27.941 INFO:tasks.workunit.client.0.smithi019.stdout:1/481: rename d1/d2/d18/d29/l5b to d1/d2/d18/d29/d51/la9 0 2024-09-12T22:11:27.945 INFO:tasks.workunit.client.0.smithi019.stdout:9/432: read d12/d1b/d20/d29/d56/d60/f67 [266930,36659] 0 2024-09-12T22:11:27.945 INFO:tasks.workunit.client.0.smithi019.stdout:6/491: write d9/dc/d20/d71/f88 [600952,128618] 0 2024-09-12T22:11:27.946 INFO:tasks.workunit.client.0.smithi019.stdout:2/356: dwrite d0/d3/df/d18/d2c/d30/d32/f4a [0,4194304] 0 2024-09-12T22:11:27.946 INFO:tasks.workunit.client.0.smithi019.stdout:1/482: chown d1/d2/d18/d35/d84/dc/df/l62 377 1 2024-09-12T22:11:27.946 INFO:tasks.workunit.client.0.smithi019.stdout:9/433: fsync d12/d1b/d20/f36 0 2024-09-12T22:11:27.948 INFO:tasks.workunit.client.0.smithi019.stdout:9/434: fdatasync d12/f1a 0 2024-09-12T22:11:27.949 INFO:tasks.workunit.client.0.smithi019.stdout:2/357: getdents d0/d3/df/d18/d2c/d30 0 2024-09-12T22:11:27.949 INFO:tasks.workunit.client.0.smithi019.stdout:0/458: dwrite d5/d7/d2c/d44/d6a/d46/f60 [0,4194304] 0 2024-09-12T22:11:27.949 INFO:tasks.workunit.client.0.smithi019.stdout:7/490: dwrite da/d24/d28/d1c/f23 [0,4194304] 0 2024-09-12T22:11:27.949 INFO:tasks.workunit.client.0.smithi019.stdout:2/358: readlink d0/l3d 0 2024-09-12T22:11:27.950 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:27.949+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:27.951 INFO:tasks.workunit.client.0.smithi019.stdout:2/359: chown d0/d3/df/d18/l3c 291 1 2024-09-12T22:11:27.951 INFO:tasks.workunit.client.0.smithi019.stdout:0/459: creat d5/d7/f93 x:0 0 0 2024-09-12T22:11:27.952 INFO:tasks.workunit.client.0.smithi019.stdout:2/360: chown d0/ce 6 1 2024-09-12T22:11:27.953 INFO:tasks.workunit.client.0.smithi019.stdout:0/460: chown d5/d7/d2c/d44/d6a/d46/c4e 463 1 2024-09-12T22:11:27.953 INFO:tasks.workunit.client.0.smithi019.stdout:2/361: truncate d0/f42 502590 0 2024-09-12T22:11:27.953 INFO:tasks.workunit.client.0.smithi019.stdout:0/461: fsync d5/d7/f4a 0 2024-09-12T22:11:27.954 INFO:tasks.workunit.client.0.smithi019.stdout:0/462: mkdir d5/d7/d10/d26/d2a/d94 0 2024-09-12T22:11:27.955 INFO:tasks.workunit.client.0.smithi019.stdout:2/362: truncate d0/d31/d4/f16 6199802 0 2024-09-12T22:11:27.956 INFO:tasks.workunit.client.0.smithi019.stdout:7/491: dwrite da/d8f/f9a [0,4194304] 0 2024-09-12T22:11:27.957 INFO:tasks.workunit.client.0.smithi019.stdout:7/492: read da/d24/f2c [2340607,62048] 0 2024-09-12T22:11:27.958 INFO:tasks.workunit.client.0.smithi019.stdout:7/493: mknod da/d30/ca9 0 2024-09-12T22:11:27.959 INFO:tasks.workunit.client.0.smithi019.stdout:7/494: write da/d19/d25/d39/f6b [108320,17200] 0 2024-09-12T22:11:27.960 INFO:tasks.workunit.client.0.smithi019.stdout:7/495: mknod da/d24/d9d/caa 0 2024-09-12T22:11:27.964 INFO:tasks.workunit.client.0.smithi019.stdout:3/475: dread d18/d26/d30/d4e/f59 [0,4194304] 0 2024-09-12T22:11:27.965 INFO:tasks.workunit.client.0.smithi019.stdout:7/496: dwrite da/d8f/f7f [0,4194304] 0 2024-09-12T22:11:27.968 INFO:tasks.workunit.client.0.smithi019.stdout:8/442: dread d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:27.969 INFO:tasks.workunit.client.0.smithi019.stdout:8/443: link d5/d16/d19/d29/f4d d5/dc/d26/d4b/f91 0 2024-09-12T22:11:27.971 INFO:tasks.workunit.client.0.smithi019.stdout:8/444: write d5/dc/d17/f2b [1997509,46023] 0 2024-09-12T22:11:27.971 INFO:tasks.workunit.client.0.smithi019.stdout:8/445: write d5/d16/d19/f31 [2753800,18557] 0 2024-09-12T22:11:27.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-09-12T22:11:27.973 INFO:tasks.workunit.client.0.smithi019.stdout:4/434: sync 2024-09-12T22:11:27.973 INFO:tasks.workunit.client.0.smithi019.stdout:6/492: sync 2024-09-12T22:11:27.974 INFO:tasks.workunit.client.0.smithi019.stdout:6/493: mknod d9/d3d/d6f/ca5 0 2024-09-12T22:11:27.976 INFO:tasks.workunit.client.0.smithi019.stdout:8/446: dwrite d5/dc/d17/f2b [0,4194304] 0 2024-09-12T22:11:27.976 INFO:tasks.workunit.client.0.smithi019.stdout:6/494: getdents d9/dc/d20/d4b 0 2024-09-12T22:11:27.977 INFO:tasks.workunit.client.0.smithi019.stdout:6/495: fsync d9/dc/d20/d71/f88 0 2024-09-12T22:11:27.981 INFO:tasks.workunit.client.0.smithi019.stdout:3/476: sync 2024-09-12T22:11:27.983 INFO:tasks.workunit.client.0.smithi019.stdout:3/477: rename d18/d26/d30/d89 to d18/d26/d30/d4e/d9a 0 2024-09-12T22:11:27.983 INFO:tasks.workunit.client.0.smithi019.stdout:3/478: stat d18/d26/d30/l66 0 2024-09-12T22:11:27.986 INFO:tasks.workunit.client.0.smithi019.stdout:8/447: dread d5/dc/f6d [0,4194304] 0 2024-09-12T22:11:27.988 INFO:tasks.workunit.client.0.smithi019.stdout:8/448: mkdir d5/dc/d26/d43/d49/d92 0 2024-09-12T22:11:27.988 INFO:tasks.workunit.client.0.smithi019.stdout:3/479: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:27.989 INFO:tasks.workunit.client.0.smithi019.stdout:4/435: dread d9/db/f24 [0,4194304] 0 2024-09-12T22:11:27.990 INFO:tasks.workunit.client.0.smithi019.stdout:4/436: write d9/db/d2b/f30 [794364,38134] 0 2024-09-12T22:11:27.991 INFO:tasks.workunit.client.0.smithi019.stdout:8/449: link d5/d53/f6e d5/dc/d26/d5c/f93 0 2024-09-12T22:11:27.992 INFO:tasks.workunit.client.0.smithi019.stdout:3/480: rename d18/d26/c31 to d18/c9b 0 2024-09-12T22:11:27.992 INFO:tasks.workunit.client.0.smithi019.stdout:8/450: chown d5/dc/d17/l85 1 1 2024-09-12T22:11:27.992 INFO:tasks.workunit.client.0.smithi019.stdout:4/437: link d9/d14/d33/d4e/f85 d9/db/d2b/d6a/f90 0 2024-09-12T22:11:27.992 INFO:tasks.workunit.client.0.smithi019.stdout:8/451: mknod d5/d16/d19/d32/c94 0 2024-09-12T22:11:27.993 INFO:tasks.workunit.client.0.smithi019.stdout:4/438: write d9/d14/d33/d4e/f85 [710005,82238] 0 2024-09-12T22:11:27.993 INFO:tasks.workunit.client.0.smithi019.stdout:8/452: sync 2024-09-12T22:11:27.996 INFO:tasks.workunit.client.0.smithi019.stdout:3/481: dwrite d18/d26/d30/d4e/f60 [4194304,4194304] 0 2024-09-12T22:11:27.996 INFO:tasks.workunit.client.0.smithi019.stdout:8/453: mknod d5/dc/d8a/d8e/c95 0 2024-09-12T22:11:27.997 INFO:tasks.workunit.client.0.smithi019.stdout:4/439: rename d9/d14/f1c to d9/d14/d31/d3f/f91 0 2024-09-12T22:11:27.997 INFO:tasks.workunit.client.0.smithi019.stdout:8/454: rmdir d5/dc/d26 39 2024-09-12T22:11:27.998 INFO:tasks.workunit.client.0.smithi019.stdout:8/455: truncate d5/d53/f89 471444 0 2024-09-12T22:11:28.001 INFO:tasks.workunit.client.0.smithi019.stdout:5/492: truncate d0/f4 3890325 0 2024-09-12T22:11:28.002 INFO:tasks.workunit.client.0.smithi019.stdout:1/483: fsync d1/fa8 0 2024-09-12T22:11:28.004 INFO:tasks.workunit.client.0.smithi019.stdout:5/493: write d0/f29 [6495282,121610] 0 2024-09-12T22:11:28.004 INFO:tasks.workunit.client.0.smithi019.stdout:6/496: dread d9/d6b/f95 [0,4194304] 0 2024-09-12T22:11:28.004 INFO:tasks.workunit.client.0.smithi019.stdout:1/484: creat d1/d2/d18/d35/d84/dc/df/d53/d55/faa x:0 0 0 2024-09-12T22:11:28.005 INFO:tasks.workunit.client.0.smithi019.stdout:6/497: write d9/dc/d20/f14 [1129946,48610] 0 2024-09-12T22:11:28.006 INFO:tasks.workunit.client.0.smithi019.stdout:5/494: dread d0/d1d/d4f/d47/f70 [0,4194304] 0 2024-09-12T22:11:28.006 INFO:tasks.workunit.client.0.smithi019.stdout:8/456: dwrite d5/dc/d26/f30 [0,4194304] 0 2024-09-12T22:11:28.007 INFO:tasks.workunit.client.0.smithi019.stdout:8/457: chown d5/dc/d26/f3a 248092973 1 2024-09-12T22:11:28.008 INFO:tasks.workunit.client.0.smithi019.stdout:6/498: creat d9/d3d/d4f/d8d/fa6 x:0 0 0 2024-09-12T22:11:28.010 INFO:tasks.workunit.client.0.smithi019.stdout:9/435: truncate d12/d1b/d20/d29/d88/f89 782946 0 2024-09-12T22:11:28.010 INFO:tasks.workunit.client.0.smithi019.stdout:6/499: mkdir d9/dc/d20/d4b/d64/d7d/da7 0 2024-09-12T22:11:28.011 INFO:tasks.workunit.client.0.smithi019.stdout:6/500: rmdir d9/dc/d20/d30 39 2024-09-12T22:11:28.011 INFO:tasks.workunit.client.0.smithi019.stdout:8/458: dwrite d5/dc/d17/f67 [0,4194304] 0 2024-09-12T22:11:28.012 INFO:tasks.workunit.client.0.smithi019.stdout:6/501: creat d9/dc/d20/d4b/d64/d7d/fa8 x:0 0 0 2024-09-12T22:11:28.015 INFO:tasks.workunit.client.0.smithi019.stdout:2/363: write d0/d31/d4/f3f [3407464,14550] 0 2024-09-12T22:11:28.015 INFO:tasks.workunit.client.0.smithi019.stdout:6/502: creat d9/dc/d20/d4b/d64/d7d/fa9 x:0 0 0 2024-09-12T22:11:28.015 INFO:tasks.workunit.client.0.smithi019.stdout:2/364: chown d0/d3/d11/d2e/l38 1 1 2024-09-12T22:11:28.015 INFO:tasks.workunit.client.0.smithi019.stdout:6/503: read - d9/dc/d20/d4b/d64/d7d/fa9 zero size 2024-09-12T22:11:28.015 INFO:tasks.workunit.client.0.smithi019.stdout:2/365: stat d0/d3/d11/f5b 0 2024-09-12T22:11:28.015 INFO:tasks.workunit.client.0.smithi019.stdout:6/504: readlink l7 0 2024-09-12T22:11:28.016 INFO:tasks.workunit.client.0.smithi019.stdout:6/505: mknod d9/d3d/d4f/d59/d79/caa 0 2024-09-12T22:11:28.016 INFO:tasks.workunit.client.0.smithi019.stdout:6/506: stat d9/dc/d20/c1c 0 2024-09-12T22:11:28.017 INFO:tasks.workunit.client.0.smithi019.stdout:6/507: chown d9/dc/c18 159389 1 2024-09-12T22:11:28.017 INFO:tasks.workunit.client.0.smithi019.stdout:0/463: dwrite d5/d7/d10/d26/d2a/f65 [0,4194304] 0 2024-09-12T22:11:28.018 INFO:tasks.workunit.client.0.smithi019.stdout:2/366: symlink d0/d3/df/d18/d2c/d2d/l72 0 2024-09-12T22:11:28.020 INFO:tasks.workunit.client.0.smithi019.stdout:2/367: creat d0/d31/d12/d3b/d5c/d71/f73 x:0 0 0 2024-09-12T22:11:28.022 INFO:tasks.workunit.client.0.smithi019.stdout:2/368: write d0/d31/d4/f3f [4769798,69932] 0 2024-09-12T22:11:28.023 INFO:tasks.workunit.client.0.smithi019.stdout:7/497: dwrite da/d24/d28/d1c/f20 [4194304,4194304] 0 2024-09-12T22:11:28.024 INFO:tasks.workunit.client.0.smithi019.stdout:6/508: dwrite d9/d3d/f6e [0,4194304] 0 2024-09-12T22:11:28.026 INFO:tasks.workunit.client.0.smithi019.stdout:6/509: unlink d9/d3d/d4f/f62 0 2024-09-12T22:11:28.026 INFO:tasks.workunit.client.0.smithi019.stdout:7/498: mknod da/d24/d28/d1c/d32/d99/cab 0 2024-09-12T22:11:28.026 INFO:tasks.workunit.client.0.smithi019.stdout:2/369: creat d0/d3/df/d18/d2c/d56/d60/f74 x:0 0 0 2024-09-12T22:11:28.027 INFO:tasks.workunit.client.0.smithi019.stdout:3/482: getdents d18 0 2024-09-12T22:11:28.028 INFO:tasks.workunit.client.0.smithi019.stdout:0/464: dread d5/f4c [0,4194304] 0 2024-09-12T22:11:28.028 INFO:tasks.workunit.client.0.smithi019.stdout:3/483: truncate d18/d26/d30/d4e/f73 697437 0 2024-09-12T22:11:28.029 INFO:tasks.workunit.client.0.smithi019.stdout:7/499: truncate da/d24/d28/d1c/d32/f87 1749579 0 2024-09-12T22:11:28.030 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:28.029+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:28.030 INFO:tasks.workunit.client.0.smithi019.stdout:3/484: rmdir d18/d26/d30/d71/d86 39 2024-09-12T22:11:28.031 INFO:tasks.workunit.client.0.smithi019.stdout:9/436: sync 2024-09-12T22:11:28.031 INFO:tasks.workunit.client.0.smithi019.stdout:3/485: readlink d18/d1d/l46 0 2024-09-12T22:11:28.031 INFO:tasks.workunit.client.0.smithi019.stdout:7/500: creat da/d30/da5/fac x:0 0 0 2024-09-12T22:11:28.031 INFO:tasks.workunit.client.0.smithi019.stdout:8/459: dread d5/d53/f6e [0,4194304] 0 2024-09-12T22:11:28.032 INFO:tasks.workunit.client.0.smithi019.stdout:9/437: write d12/f23 [482112,109553] 0 2024-09-12T22:11:28.032 INFO:tasks.workunit.client.0.smithi019.stdout:3/486: mkdir d18/d1d/d35/d9c 0 2024-09-12T22:11:28.033 INFO:tasks.workunit.client.0.smithi019.stdout:8/460: stat d5/dc/d8a/d8e/c95 0 2024-09-12T22:11:28.033 INFO:tasks.workunit.client.0.smithi019.stdout:7/501: chown da/d24/d28/d1c/c2d 130206 1 2024-09-12T22:11:28.033 INFO:tasks.workunit.client.0.smithi019.stdout:3/487: chown d18/d58 92 1 2024-09-12T22:11:28.033 INFO:tasks.workunit.client.0.smithi019.stdout:0/465: dwrite d5/d7/d10/f42 [0,4194304] 0 2024-09-12T22:11:28.034 INFO:tasks.workunit.client.0.smithi019.stdout:7/502: chown da/f76 75447 1 2024-09-12T22:11:28.035 INFO:tasks.workunit.client.0.smithi019.stdout:3/488: mknod d18/d1d/c9d 0 2024-09-12T22:11:28.036 INFO:tasks.workunit.client.0.smithi019.stdout:4/440: truncate d9/d14/d33/f46 1121226 0 2024-09-12T22:11:28.037 INFO:tasks.workunit.client.0.smithi019.stdout:9/438: getdents d12/d1b/d20/d29/d74 0 2024-09-12T22:11:28.038 INFO:tasks.workunit.client.0.smithi019.stdout:3/489: fsync d18/d26/d30/d71/f74 0 2024-09-12T22:11:28.040 INFO:tasks.workunit.client.0.smithi019.stdout:7/503: link da/d24/c35 da/cad 0 2024-09-12T22:11:28.040 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:28.040 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:28.041 INFO:tasks.workunit.client.0.smithi019.stdout:9/439: mkdir d12/d1b/d40/d8f 0 2024-09-12T22:11:28.041 INFO:tasks.workunit.client.0.smithi019.stdout:6/510: truncate d9/d3d/d4f/f5e 3882398 0 2024-09-12T22:11:28.042 INFO:tasks.workunit.client.0.smithi019.stdout:0/466: dwrite d5/d7/d10/d26/d2a/f5d [0,4194304] 0 2024-09-12T22:11:28.042 INFO:tasks.workunit.client.0.smithi019.stdout:9/440: write fa [3940908,81312] 0 2024-09-12T22:11:28.043 INFO:tasks.workunit.client.0.smithi019.stdout:1/485: dwrite d1/d2/d18/d70/f7a [0,4194304] 0 2024-09-12T22:11:28.043 INFO:tasks.workunit.client.0.smithi019.stdout:4/441: getdents d9/d14/d33/d4e/d66 0 2024-09-12T22:11:28.043 INFO:tasks.workunit.client.0.smithi019.stdout:7/504: symlink da/d24/d28/lae 0 2024-09-12T22:11:28.044 INFO:tasks.workunit.client.0.smithi019.stdout:3/490: creat d18/d26/d30/d71/d86/f9e x:0 0 0 2024-09-12T22:11:28.045 INFO:tasks.workunit.client.0.smithi019.stdout:0/467: truncate d5/d7/d2c/d44/f74 1141926 0 2024-09-12T22:11:28.046 INFO:tasks.workunit.client.0.smithi019.stdout:6/511: mknod d9/dc/cab 0 2024-09-12T22:11:28.046 INFO:tasks.workunit.client.0.smithi019.stdout:4/442: unlink d9/db/d2b/d6a/d7d/l8a 0 2024-09-12T22:11:28.047 INFO:tasks.workunit.client.0.smithi019.stdout:7/505: mkdir da/d24/d28/d1c/d32/daf 0 2024-09-12T22:11:28.047 INFO:tasks.workunit.client.0.smithi019.stdout:3/491: chown d18/d26/d30/d71/f74 105666070 1 2024-09-12T22:11:28.050 INFO:tasks.workunit.client.0.smithi019.stdout:0/468: mknod d5/d7/de/c95 0 2024-09-12T22:11:28.050 INFO:tasks.workunit.client.0.smithi019.stdout:3/492: write d18/f28 [1761716,39679] 0 2024-09-12T22:11:28.050 INFO:tasks.workunit.client.0.smithi019.stdout:6/512: symlink d9/dc/d20/d71/lac 0 2024-09-12T22:11:28.050 INFO:tasks.workunit.client.0.smithi019.stdout:1/486: write d1/d2/d18/d35/d84/dc/df/d2c/d5d/f8e [433341,68527] 0 2024-09-12T22:11:28.051 INFO:tasks.workunit.client.0.smithi019.stdout:4/443: rename d9/db/d2b/l63 to d9/d17/l92 0 2024-09-12T22:11:28.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:28.052 INFO:tasks.workunit.client.0.smithi019.stdout:0/469: symlink d5/d7/l96 0 2024-09-12T22:11:28.053 INFO:tasks.workunit.client.0.smithi019.stdout:0/470: chown d5/d7/d10/c40 1757 1 2024-09-12T22:11:28.057 INFO:tasks.workunit.client.0.smithi019.stdout:0/471: write d5/d7/d2c/d44/f74 [416857,108364] 0 2024-09-12T22:11:28.057 INFO:tasks.workunit.client.0.smithi019.stdout:7/506: dwrite da/d8f/f7f [0,4194304] 0 2024-09-12T22:11:28.058 INFO:tasks.workunit.client.0.smithi019.stdout:2/370: write d0/d3/d11/f10 [4968489,121139] 0 2024-09-12T22:11:28.059 INFO:tasks.workunit.client.0.smithi019.stdout:4/444: readlink d9/d17/l92 0 2024-09-12T22:11:28.060 INFO:tasks.workunit.client.0.smithi019.stdout:6/513: dwrite d9/d3d/f61 [0,4194304] 0 2024-09-12T22:11:28.062 INFO:tasks.workunit.client.0.smithi019.stdout:4/445: dread d9/d17/f4f [0,4194304] 0 2024-09-12T22:11:28.062 INFO:tasks.workunit.client.0.smithi019.stdout:3/493: dwrite d18/d1d/f3f [0,4194304] 0 2024-09-12T22:11:28.063 INFO:tasks.workunit.client.0.smithi019.stdout:0/472: rename d5/d7/d2c/d81/f86 to d5/d7/d2c/d44/f97 0 2024-09-12T22:11:28.063 INFO:tasks.workunit.client.0.smithi019.stdout:5/495: dread d0/f5 [0,4194304] 0 2024-09-12T22:11:28.064 INFO:tasks.workunit.client.0.smithi019.stdout:1/487: rename d1/d2/d18/d35/d84/dc/df/l78 to d1/d2/d18/d35/d84/dc/df/lab 0 2024-09-12T22:11:28.064 INFO:tasks.workunit.client.0.smithi019.stdout:4/446: chown d9/db/d2b/d6a/f81 21 1 2024-09-12T22:11:28.065 INFO:tasks.workunit.client.0.smithi019.stdout:0/473: chown d5/d7/d2c/d44/d6a/d46/c4e 3 1 2024-09-12T22:11:28.065 INFO:tasks.workunit.client.0.smithi019.stdout:2/371: link d0/d31/d12/d3b/c59 d0/d3/df/d18/d2c/d30/d32/c75 0 2024-09-12T22:11:28.067 INFO:tasks.workunit.client.0.smithi019.stdout:7/507: rename da/d19/f46 to da/d19/d25/d39/fb0 0 2024-09-12T22:11:28.067 INFO:tasks.workunit.client.0.smithi019.stdout:1/488: rmdir d1/d2/d18/d35/d84 39 2024-09-12T22:11:28.068 INFO:tasks.workunit.client.0.smithi019.stdout:2/372: creat d0/d31/d12/d3b/f76 x:0 0 0 2024-09-12T22:11:28.069 INFO:tasks.workunit.client.0.smithi019.stdout:9/441: dread d12/d1b/d20/d25/f49 [0,4194304] 0 2024-09-12T22:11:28.069 INFO:tasks.workunit.client.0.smithi019.stdout:5/496: getdents d0/d1d 0 2024-09-12T22:11:28.070 INFO:tasks.workunit.client.0.smithi019.stdout:6/514: dwrite d9/f4e [0,4194304] 0 2024-09-12T22:11:28.072 INFO:tasks.workunit.client.0.smithi019.stdout:7/508: mkdir da/d30/d53/db1 0 2024-09-12T22:11:28.074 INFO:tasks.workunit.client.0.smithi019.stdout:5/497: creat d0/d1d/d3d/fa3 x:0 0 0 2024-09-12T22:11:28.074 INFO:tasks.workunit.client.0.smithi019.stdout:6/515: creat d9/d3d/d4f/fad x:0 0 0 2024-09-12T22:11:28.074 INFO:tasks.workunit.client.0.smithi019.stdout:1/489: dread d1/d2/d18/d59/f9f [0,4194304] 0 2024-09-12T22:11:28.075 INFO:tasks.workunit.client.0.smithi019.stdout:0/474: read d5/d7/d2c/d44/d6a/d52/f84 [433177,95378] 0 2024-09-12T22:11:28.076 INFO:tasks.workunit.client.0.smithi019.stdout:6/516: chown d9/d3d/d4f/d59/c93 41745482 1 2024-09-12T22:11:28.078 INFO:tasks.workunit.client.0.smithi019.stdout:5/498: rename d0/d1d/d4f/f2b to d0/d26/d3a/fa4 0 2024-09-12T22:11:28.079 INFO:tasks.workunit.client.0.smithi019.stdout:2/373: dwrite d0/d3/d11/d2e/d64/f65 [0,4194304] 0 2024-09-12T22:11:28.079 INFO:tasks.workunit.client.0.smithi019.stdout:9/442: dwrite fa [0,4194304] 0 2024-09-12T22:11:28.079 INFO:tasks.workunit.client.0.smithi019.stdout:1/490: write d1/d2/d18/d29/d27/f23 [322033,103957] 0 2024-09-12T22:11:28.080 INFO:tasks.workunit.client.0.smithi019.stdout:5/499: rmdir d0/d4e 39 2024-09-12T22:11:28.082 INFO:tasks.workunit.client.0.smithi019.stdout:6/517: truncate d9/dc/d20/f50 325597 0 2024-09-12T22:11:28.082 INFO:tasks.workunit.client.0.smithi019.stdout:5/500: read d0/d1d/d3d/f69 [218415,94227] 0 2024-09-12T22:11:28.082 INFO:tasks.workunit.client.0.smithi019.stdout:0/475: creat d5/d7/d2c/d44/d6a/f98 x:0 0 0 2024-09-12T22:11:28.082 INFO:tasks.workunit.client.0.smithi019.stdout:9/443: chown d12/d1b/d20/l3c 5 1 2024-09-12T22:11:28.083 INFO:tasks.workunit.client.0.smithi019.stdout:2/374: mkdir d0/d3/d11/d77 0 2024-09-12T22:11:28.083 INFO:tasks.workunit.client.0.smithi019.stdout:8/461: dread d5/dc/d26/d43/f4c [0,4194304] 0 2024-09-12T22:11:28.084 INFO:tasks.workunit.client.0.smithi019.stdout:5/501: write d0/d1d/f45 [863700,34688] 0 2024-09-12T22:11:28.084 INFO:tasks.workunit.client.0.smithi019.stdout:7/509: dwrite da/d24/f2c [0,4194304] 0 2024-09-12T22:11:28.084 INFO:tasks.workunit.client.0.smithi019.stdout:1/491: write d1/d2/d18/f1c [1286595,69878] 0 2024-09-12T22:11:28.085 INFO:tasks.workunit.client.0.smithi019.stdout:0/476: truncate d5/d7/de/f31 953997 0 2024-09-12T22:11:28.085 INFO:tasks.workunit.client.0.smithi019.stdout:7/510: write da/d19/f88 [2815452,17804] 0 2024-09-12T22:11:28.085 INFO:tasks.workunit.client.0.smithi019.stdout:9/444: creat d12/d1b/d20/d29/d74/d77/f90 x:0 0 0 2024-09-12T22:11:28.086 INFO:tasks.workunit.client.0.smithi019.stdout:8/462: mkdir d5/dc/d8d/d96 0 2024-09-12T22:11:28.086 INFO:tasks.workunit.client.0.smithi019.stdout:5/502: mknod d0/d26/d5f/ca5 0 2024-09-12T22:11:28.086 INFO:tasks.workunit.client.0.smithi019.stdout:2/375: rename d0/d3/df/d18 to d0/d3/d11/d77/d78 0 2024-09-12T22:11:28.087 INFO:tasks.workunit.client.0.smithi019.stdout:3/494: dread f13 [0,4194304] 0 2024-09-12T22:11:28.087 INFO:tasks.workunit.client.0.smithi019.stdout:9/445: readlink d12/d1b/d20/d37/l5a 0 2024-09-12T22:11:28.087 INFO:tasks.workunit.client.0.smithi019.stdout:7/511: dread - da/d19/d25/d39/fa3 zero size 2024-09-12T22:11:28.087 INFO:tasks.workunit.client.0.smithi019.stdout:1/492: dread - d1/d2/d18/d35/d84/dc/df/f74 zero size 2024-09-12T22:11:28.088 INFO:tasks.workunit.client.0.smithi019.stdout:3/495: readlink d18/d26/d30/d4a/l7c 0 2024-09-12T22:11:28.088 INFO:tasks.workunit.client.0.smithi019.stdout:1/493: readlink d1/d2/d18/d59/l87 0 2024-09-12T22:11:28.088 INFO:tasks.workunit.client.0.smithi019.stdout:8/463: symlink d5/dc/d26/d5c/l97 0 2024-09-12T22:11:28.089 INFO:tasks.workunit.client.0.smithi019.stdout:9/446: symlink d12/d1b/d20/d29/d74/d77/l91 0 2024-09-12T22:11:28.089 INFO:tasks.workunit.client.0.smithi019.stdout:3/496: write f9 [2538781,43104] 0 2024-09-12T22:11:28.089 INFO:tasks.workunit.client.0.smithi019.stdout:9/447: fdatasync d12/d48/f61 0 2024-09-12T22:11:28.090 INFO:tasks.workunit.client.0.smithi019.stdout:2/376: getdents d0/d3/d11/d77/d78 0 2024-09-12T22:11:28.091 INFO:tasks.workunit.client.0.smithi019.stdout:9/448: unlink d12/d1b/l22 0 2024-09-12T22:11:28.092 INFO:tasks.workunit.client.0.smithi019.stdout:8/464: truncate d5/d16/d19/f3c 1385557 0 2024-09-12T22:11:28.092 INFO:tasks.workunit.client.0.smithi019.stdout:3/497: rename d18/d1d/d35/l5c to d18/d1d/l9f 0 2024-09-12T22:11:28.094 INFO:tasks.workunit.client.0.smithi019.stdout:2/377: write d0/d31/d12/d3b/d5c/f62 [4089974,33797] 0 2024-09-12T22:11:28.094 INFO:tasks.workunit.client.0.smithi019.stdout:9/449: rmdir d12/d1b/d40/d8f 0 2024-09-12T22:11:28.095 INFO:tasks.workunit.client.0.smithi019.stdout:5/503: dwrite d0/f18 [0,4194304] 0 2024-09-12T22:11:28.095 INFO:tasks.workunit.client.0.smithi019.stdout:3/498: truncate d18/d58/f8e 880023 0 2024-09-12T22:11:28.096 INFO:tasks.workunit.client.0.smithi019.stdout:7/512: dwrite da/d19/f88 [0,4194304] 0 2024-09-12T22:11:28.098 INFO:tasks.workunit.client.0.smithi019.stdout:2/378: truncate d0/d3/d11/d77/d78/d2c/d2d/f57 395596 0 2024-09-12T22:11:28.100 INFO:tasks.workunit.client.0.smithi019.stdout:8/465: read d5/d16/f63 [427405,44730] 0 2024-09-12T22:11:28.100 INFO:tasks.workunit.client.0.smithi019.stdout:9/450: mkdir d12/d1b/d20/d29/d92 0 2024-09-12T22:11:28.101 INFO:tasks.workunit.client.0.smithi019.stdout:2/379: creat d0/d3/d11/d2e/d64/f79 x:0 0 0 2024-09-12T22:11:28.101 INFO:tasks.workunit.client.0.smithi019.stdout:9/451: creat d12/d48/f93 x:0 0 0 2024-09-12T22:11:28.102 INFO:tasks.workunit.client.0.smithi019.stdout:5/504: truncate d0/f19 4557558 0 2024-09-12T22:11:28.102 INFO:tasks.workunit.client.0.smithi019.stdout:8/466: write d5/d53/f89 [70025,43702] 0 2024-09-12T22:11:28.102 INFO:tasks.workunit.client.0.smithi019.stdout:7/513: rename da/f83 to da/d30/d9c/fb2 0 2024-09-12T22:11:28.102 INFO:tasks.workunit.client.0.smithi019.stdout:6/518: dread d9/dc/f36 [0,4194304] 0 2024-09-12T22:11:28.103 INFO:tasks.workunit.client.0.smithi019.stdout:2/380: write d0/d31/d12/f17 [2399285,2389] 0 2024-09-12T22:11:28.104 INFO:tasks.workunit.client.0.smithi019.stdout:8/467: mkdir d5/dc/d8a/d98 0 2024-09-12T22:11:28.104 INFO:tasks.workunit.client.0.smithi019.stdout:9/452: fdatasync d12/d1b/d20/d29/d56/f79 0 2024-09-12T22:11:28.104 INFO:tasks.workunit.client.0.smithi019.stdout:7/514: unlink da/d30/ca9 0 2024-09-12T22:11:28.104 INFO:tasks.workunit.client.0.smithi019.stdout:6/519: truncate d9/d6b/f82 982639 0 2024-09-12T22:11:28.104 INFO:tasks.workunit.client.0.smithi019.stdout:5/505: truncate d0/d24/d7a/f8f 906769 0 2024-09-12T22:11:28.105 INFO:tasks.workunit.client.0.smithi019.stdout:1/494: dread d1/d2/d18/d35/d84/dc/df/d61/f34 [0,4194304] 0 2024-09-12T22:11:28.105 INFO:tasks.workunit.client.0.smithi019.stdout:7/515: stat da/d24/d9d/caa 0 2024-09-12T22:11:28.105 INFO:tasks.workunit.client.0.smithi019.stdout:2/381: truncate d0/d31/d12/d3b/f76 242412 0 2024-09-12T22:11:28.109 INFO:tasks.workunit.client.0.smithi019.stdout:9/453: dread d12/d1b/f1c [0,4194304] 0 2024-09-12T22:11:28.109 INFO:tasks.workunit.client.0.smithi019.stdout:3/499: dwrite d18/d26/d30/d64/f88 [0,4194304] 0 2024-09-12T22:11:28.109 INFO:tasks.workunit.client.0.smithi019.stdout:5/506: creat d0/fa6 x:0 0 0 2024-09-12T22:11:28.109 INFO:tasks.workunit.client.0.smithi019.stdout:6/520: mknod d9/dc/d20/d4b/d7a/cae 0 2024-09-12T22:11:28.109 INFO:tasks.workunit.client.0.smithi019.stdout:1/495: symlink d1/d83/lac 0 2024-09-12T22:11:28.109 INFO:tasks.workunit.client.0.smithi019.stdout:4/447: dread d9/d4c/f78 [0,4194304] 0 2024-09-12T22:11:28.110 INFO:tasks.workunit.client.0.smithi019.stdout:5/507: creat d0/d26/d5f/fa7 x:0 0 0 2024-09-12T22:11:28.111 INFO:tasks.workunit.client.0.smithi019.stdout:9/454: creat d12/d1b/d20/d29/d56/d60/f94 x:0 0 0 2024-09-12T22:11:28.111 INFO:tasks.workunit.client.0.smithi019.stdout:2/382: rename d0/d31/d12/l20 to d0/d3/d11/d77/d78/d2c/d56/l7a 0 2024-09-12T22:11:28.111 INFO:tasks.workunit.client.0.smithi019.stdout:4/448: mkdir d9/d73/d8f/d93 0 2024-09-12T22:11:28.111 INFO:tasks.workunit.client.0.smithi019.stdout:3/500: creat d18/d1d/d8b/fa0 x:0 0 0 2024-09-12T22:11:28.112 INFO:tasks.workunit.client.0.smithi019.stdout:5/508: write d0/d26/d42/f7f [990940,101777] 0 2024-09-12T22:11:28.112 INFO:tasks.workunit.client.0.smithi019.stdout:1/496: mkdir d1/d2/d18/d35/dad 0 2024-09-12T22:11:28.112 INFO:tasks.workunit.client.0.smithi019.stdout:9/455: read - d12/d1b/d20/d29/d56/f80 zero size 2024-09-12T22:11:28.112 INFO:tasks.workunit.client.0.smithi019.stdout:2/383: readlink d0/d31/d4/d7/l47 0 2024-09-12T22:11:28.113 INFO:tasks.workunit.client.0.smithi019.stdout:5/509: fsync d0/d24/d58/f87 0 2024-09-12T22:11:28.113 INFO:tasks.workunit.client.0.smithi019.stdout:7/516: truncate da/d8f/f9a 1951201 0 2024-09-12T22:11:28.114 INFO:tasks.workunit.client.0.smithi019.stdout:0/477: sync 2024-09-12T22:11:28.114 INFO:tasks.workunit.client.0.smithi019.stdout:6/521: truncate d9/d3d/d4f/f53 3321509 0 2024-09-12T22:11:28.114 INFO:tasks.workunit.client.0.smithi019.stdout:4/449: truncate d9/d14/d33/f4b 5135438 0 2024-09-12T22:11:28.114 INFO:tasks.workunit.client.0.smithi019.stdout:1/497: creat d1/d2/d18/d70/fae x:0 0 0 2024-09-12T22:11:28.114 INFO:tasks.workunit.client.0.smithi019.stdout:2/384: fdatasync d0/d3/d11/d77/d78/d2c/d56/d60/f74 0 2024-09-12T22:11:28.115 INFO:tasks.workunit.client.0.smithi019.stdout:5/510: chown d0/d1d/d6d/f94 199945511 1 2024-09-12T22:11:28.115 INFO:tasks.workunit.client.0.smithi019.stdout:0/478: chown d5/d7/d10 90016 1 2024-09-12T22:11:28.115 INFO:tasks.workunit.client.0.smithi019.stdout:9/456: truncate f9 776561 0 2024-09-12T22:11:28.116 INFO:tasks.workunit.client.0.smithi019.stdout:3/501: link d18/d26/d30/d4e/f6c d18/d26/d30/d71/d86/fa1 0 2024-09-12T22:11:28.117 INFO:tasks.workunit.client.0.smithi019.stdout:1/498: write d1/d2/d18/d29/d51/f85 [630516,118902] 0 2024-09-12T22:11:28.117 INFO:tasks.workunit.client.0.smithi019.stdout:5/511: write d0/d24/d7a/f9a [416441,20456] 0 2024-09-12T22:11:28.117 INFO:tasks.workunit.client.0.smithi019.stdout:0/479: mknod d5/d7/d10/c99 0 2024-09-12T22:11:28.117 INFO:tasks.workunit.client.0.smithi019.stdout:2/385: write d0/d31/d12/d15/f23 [3385048,2860] 0 2024-09-12T22:11:28.119 INFO:tasks.workunit.client.0.smithi019.stdout:3/502: stat d18/d26/d30/d4a/c84 0 2024-09-12T22:11:28.119 INFO:tasks.workunit.client.0.smithi019.stdout:9/457: mknod d12/d1b/d40/d85/c95 0 2024-09-12T22:11:28.119 INFO:tasks.workunit.client.0.smithi019.stdout:5/512: readlink d0/d26/d5f/l6b 0 2024-09-12T22:11:28.121 INFO:tasks.workunit.client.0.smithi019.stdout:2/386: fdatasync d0/d31/d12/d15/f33 0 2024-09-12T22:11:28.121 INFO:tasks.workunit.client.0.smithi019.stdout:9/458: creat d12/d1b/d20/d29/d56/d60/f96 x:0 0 0 2024-09-12T22:11:28.121 INFO:tasks.workunit.client.0.smithi019.stdout:8/468: dread d5/d16/d19/d29/f38 [0,4194304] 0 2024-09-12T22:11:28.122 INFO:tasks.workunit.client.0.smithi019.stdout:7/517: dwrite da/d19/d25/d39/f49 [0,4194304] 0 2024-09-12T22:11:28.122 INFO:tasks.workunit.client.0.smithi019.stdout:1/499: fdatasync d1/d2/d18/d35/d84/dc/df/d61/f34 0 2024-09-12T22:11:28.122 INFO:tasks.workunit.client.0.smithi019.stdout:4/450: dwrite d9/f54 [0,4194304] 0 2024-09-12T22:11:28.124 INFO:tasks.workunit.client.0.smithi019.stdout:1/500: dread - d1/d2/d18/d35/d84/dc/fa6 zero size 2024-09-12T22:11:28.124 INFO:tasks.workunit.client.0.smithi019.stdout:2/387: write d0/d3/d11/d2e/d64/f79 [519490,54315] 0 2024-09-12T22:11:28.125 INFO:tasks.workunit.client.0.smithi019.stdout:9/459: mknod d12/d1b/d20/d29/d74/c97 0 2024-09-12T22:11:28.125 INFO:tasks.workunit.client.0.smithi019.stdout:7/518: creat da/d19/d79/fb3 x:0 0 0 2024-09-12T22:11:28.125 INFO:tasks.workunit.client.0.smithi019.stdout:0/480: read d5/d7/d2c/d44/d6a/d46/f5c [3235300,44073] 0 2024-09-12T22:11:28.127 INFO:tasks.workunit.client.0.smithi019.stdout:3/503: dwrite d18/f97 [0,4194304] 0 2024-09-12T22:11:28.128 INFO:tasks.workunit.client.0.smithi019.stdout:4/451: getdents d9/db/d2b/d6a/d7d 0 2024-09-12T22:11:28.128 INFO:tasks.workunit.client.0.smithi019.stdout:2/388: rename d0/d3/d21/d36 to d0/d3/df/d7b 0 2024-09-12T22:11:28.129 INFO:tasks.workunit.client.0.smithi019.stdout:4/452: chown d9/d14/d31/d3f/c43 34774 1 2024-09-12T22:11:28.130 INFO:tasks.workunit.client.0.smithi019.stdout:9/460: rename d12/d1b/d20/d37 to d12/d1b/d40/d85/d98 0 2024-09-12T22:11:28.130 INFO:tasks.workunit.client.0.smithi019.stdout:0/481: mkdir d5/d7/de/d9a 0 2024-09-12T22:11:28.130 INFO:tasks.workunit.client.0.smithi019.stdout:3/504: symlink d18/d26/d30/d4e/d80/la2 0 2024-09-12T22:11:28.130 INFO:tasks.workunit.client.0.smithi019.stdout:4/453: fdatasync d9/d4c/f78 0 2024-09-12T22:11:28.131 INFO:tasks.workunit.client.0.smithi019.stdout:3/505: dread - d18/d26/d30/d4e/f99 zero size 2024-09-12T22:11:28.132 INFO:tasks.workunit.client.0.smithi019.stdout:4/454: mkdir d9/d14/d31/d3f/d94 0 2024-09-12T22:11:28.132 INFO:tasks.workunit.client.0.smithi019.stdout:2/389: rename d0/d3/d11/d77/d78/d2c/d2d/f54 to d0/d3/d11/d77/d78/f7c 0 2024-09-12T22:11:28.132 INFO:tasks.workunit.client.0.smithi019.stdout:6/522: dwrite d9/d3d/d4f/f53 [0,4194304] 0 2024-09-12T22:11:28.133 INFO:tasks.workunit.client.0.smithi019.stdout:4/455: dread - d9/d14/d31/f8b zero size 2024-09-12T22:11:28.133 INFO:tasks.workunit.client.0.smithi019.stdout:6/523: stat d9/dc/d20/l16 0 2024-09-12T22:11:28.134 INFO:tasks.workunit.client.0.smithi019.stdout:2/390: mknod d0/d3/d11/d77/d78/c7d 0 2024-09-12T22:11:28.134 INFO:tasks.workunit.client.0.smithi019.stdout:6/524: readlink d9/d3d/d4f/l94 0 2024-09-12T22:11:28.134 INFO:tasks.workunit.client.0.smithi019.stdout:3/506: creat d18/d1d/d8b/fa3 x:0 0 0 2024-09-12T22:11:28.135 INFO:tasks.workunit.client.0.smithi019.stdout:3/507: stat d18/d58 0 2024-09-12T22:11:28.136 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:28.135+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:28.136 INFO:tasks.workunit.client.0.smithi019.stdout:6/525: dread - d9/dc/d20/d4b/d6c/f70 zero size 2024-09-12T22:11:28.137 INFO:tasks.workunit.client.0.smithi019.stdout:4/456: getdents d9/d14/d33 0 2024-09-12T22:11:28.138 INFO:tasks.workunit.client.0.smithi019.stdout:9/461: dwrite d12/f1f [0,4194304] 0 2024-09-12T22:11:28.138 INFO:tasks.workunit.client.0.smithi019.stdout:3/508: getdents d18/d26/d30/d4e/d9a 0 2024-09-12T22:11:28.138 INFO:tasks.workunit.client.0.smithi019.stdout:2/391: rename d0/d3/d11/d2e/d34/c46 to d0/d31/d4/c7e 0 2024-09-12T22:11:28.138 INFO:tasks.workunit.client.0.smithi019.stdout:9/462: write d12/d1b/f32 [994308,64691] 0 2024-09-12T22:11:28.139 INFO:tasks.workunit.client.0.smithi019.stdout:6/526: symlink d9/dc/d20/d4b/d64/d78/da1/laf 0 2024-09-12T22:11:28.139 INFO:tasks.workunit.client.0.smithi019.stdout:4/457: write d9/d14/d31/f8b [310973,51368] 0 2024-09-12T22:11:28.140 INFO:tasks.workunit.client.0.smithi019.stdout:6/527: chown d9 172779 1 2024-09-12T22:11:28.140 INFO:tasks.workunit.client.0.smithi019.stdout:3/509: truncate d18/f7e 4656985 0 2024-09-12T22:11:28.140 INFO:tasks.workunit.client.0.smithi019.stdout:2/392: mknod d0/d31/d12/c7f 0 2024-09-12T22:11:28.141 INFO:tasks.workunit.client.0.smithi019.stdout:8/469: dread d5/d53/d66/f6f [0,4194304] 0 2024-09-12T22:11:28.141 INFO:tasks.workunit.client.0.smithi019.stdout:9/463: fsync d12/d1b/d20/d29/d74/d77/f90 0 2024-09-12T22:11:28.141 INFO:tasks.workunit.client.0.smithi019.stdout:2/393: chown d0/d3/d21/c29 3776 1 2024-09-12T22:11:28.141 INFO:tasks.workunit.client.0.smithi019.stdout:3/510: chown d18/d26/c3a 2239241 1 2024-09-12T22:11:28.141 INFO:tasks.workunit.client.0.smithi019.stdout:4/458: readlink d9/d17/l92 0 2024-09-12T22:11:28.142 INFO:tasks.workunit.client.0.smithi019.stdout:6/528: truncate d9/d3d/f2f 717788 0 2024-09-12T22:11:28.142 INFO:tasks.workunit.client.0.smithi019.stdout:9/464: mknod d12/d1b/d20/d59/c99 0 2024-09-12T22:11:28.142 INFO:tasks.workunit.client.0.smithi019.stdout:3/511: stat d18/c40 0 2024-09-12T22:11:28.143 INFO:tasks.workunit.client.0.smithi019.stdout:2/394: write d0/d3/d11/d77/d78/f7c [1657268,2219] 0 2024-09-12T22:11:28.143 INFO:tasks.workunit.client.0.smithi019.stdout:0/482: dread d5/d7/d2c/d44/d6a/f59 [0,4194304] 0 2024-09-12T22:11:28.143 INFO:tasks.workunit.client.0.smithi019.stdout:6/529: readlink d9/dc/d20/l1d 0 2024-09-12T22:11:28.145 INFO:tasks.workunit.client.0.smithi019.stdout:2/395: mkdir d0/d3/df/d7b/d80 0 2024-09-12T22:11:28.146 INFO:tasks.workunit.client.0.smithi019.stdout:2/396: fsync d0/f42 0 2024-09-12T22:11:28.149 INFO:tasks.workunit.client.0.smithi019.stdout:3/512: dwrite f15 [0,4194304] 0 2024-09-12T22:11:28.149 INFO:tasks.workunit.client.0.smithi019.stdout:6/530: dread d9/dc/d20/d71/f88 [0,4194304] 0 2024-09-12T22:11:28.150 INFO:tasks.workunit.client.0.smithi019.stdout:4/459: dwrite d9/d14/d33/d4e/f85 [0,4194304] 0 2024-09-12T22:11:28.150 INFO:tasks.workunit.client.0.smithi019.stdout:2/397: fsync d0/d3/d11/d77/d78/d2c/f5a 0 2024-09-12T22:11:28.150 INFO:tasks.workunit.client.0.smithi019.stdout:9/465: dread d12/f55 [0,4194304] 0 2024-09-12T22:11:28.151 INFO:tasks.workunit.client.0.smithi019.stdout:0/483: dwrite d5/d7/f30 [0,4194304] 0 2024-09-12T22:11:28.151 INFO:tasks.workunit.client.0.smithi019.stdout:1/501: dread d1/d37/f65 [0,4194304] 0 2024-09-12T22:11:28.152 INFO:tasks.workunit.client.0.smithi019.stdout:9/466: rmdir d12/d1b/d20 39 2024-09-12T22:11:28.153 INFO:tasks.workunit.client.0.smithi019.stdout:9/467: fdatasync f5 0 2024-09-12T22:11:28.154 INFO:tasks.workunit.client.0.smithi019.stdout:0/484: write d5/d7/d10/f4d [1186654,113759] 0 2024-09-12T22:11:28.154 INFO:tasks.workunit.client.0.smithi019.stdout:7/519: dread da/d24/d28/d1c/d32/d94/f9b [0,4194304] 0 2024-09-12T22:11:28.154 INFO:tasks.workunit.client.0.smithi019.stdout:3/513: rename d18/d26/d30/d71/f74 to d18/d26/d30/d4e/d80/fa4 0 2024-09-12T22:11:28.154 INFO:tasks.workunit.client.0.smithi019.stdout:1/502: chown d1/d2/d18/d35/d84/d6e/c89 2290327 1 2024-09-12T22:11:28.154 INFO:tasks.workunit.client.0.smithi019.stdout:2/398: creat d0/d3/d11/d77/d78/d2c/d30/d32/f81 x:0 0 0 2024-09-12T22:11:28.155 INFO:tasks.workunit.client.0.smithi019.stdout:0/485: fsync d5/d7/d10/f42 0 2024-09-12T22:11:28.155 INFO:tasks.workunit.client.0.smithi019.stdout:6/531: creat d9/dc/d20/d4b/d64/d7d/da7/fb0 x:0 0 0 2024-09-12T22:11:28.155 INFO:tasks.workunit.client.0.smithi019.stdout:3/514: read d18/d1d/f2a [147878,108790] 0 2024-09-12T22:11:28.155 INFO:tasks.workunit.client.0.smithi019.stdout:7/520: chown da/d24/d28/d1c/d32/c7e 72388293 1 2024-09-12T22:11:28.155 INFO:tasks.workunit.client.0.smithi019.stdout:5/513: sync 2024-09-12T22:11:28.155 INFO:tasks.workunit.client.0.smithi019.stdout:8/470: sync 2024-09-12T22:11:28.156 INFO:tasks.workunit.client.0.smithi019.stdout:2/399: mkdir d0/d3/d11/d77/d82 0 2024-09-12T22:11:28.156 INFO:tasks.workunit.client.0.smithi019.stdout:9/468: mkdir d12/d1b/d20/d59/d5b/d9a 0 2024-09-12T22:11:28.158 INFO:tasks.workunit.client.0.smithi019.stdout:7/521: dread - da/d19/d79/fb3 zero size 2024-09-12T22:11:28.158 INFO:tasks.workunit.client.0.smithi019.stdout:8/471: fsync d5/d16/d19/f50 0 2024-09-12T22:11:28.158 INFO:tasks.workunit.client.0.smithi019.stdout:0/486: truncate d5/d7/d10/f68 896769 0 2024-09-12T22:11:28.158 INFO:tasks.workunit.client.0.smithi019.stdout:3/515: write d18/f56 [971293,58619] 0 2024-09-12T22:11:28.159 INFO:tasks.workunit.client.0.smithi019.stdout:2/400: write d0/d3/d11/d77/d78/d2c/d2d/f57 [497393,73564] 0 2024-09-12T22:11:28.159 INFO:tasks.workunit.client.0.smithi019.stdout:7/522: fsync da/f11 0 2024-09-12T22:11:28.160 INFO:tasks.workunit.client.0.smithi019.stdout:8/472: unlink d5/d16/c33 0 2024-09-12T22:11:28.160 INFO:tasks.workunit.client.0.smithi019.stdout:1/503: rename d1/d2/d18/d29/c95 to d1/d2/d18/d35/caf 0 2024-09-12T22:11:28.161 INFO:tasks.workunit.client.0.smithi019.stdout:7/523: creat da/d8f/fb4 x:0 0 0 2024-09-12T22:11:28.161 INFO:tasks.workunit.client.0.smithi019.stdout:6/532: rename d9/d3d/l8b to d9/dc/d20/d4b/d64/d78/da1/lb1 0 2024-09-12T22:11:28.162 INFO:tasks.workunit.client.0.smithi019.stdout:2/401: getdents d0/d3/df/d52 0 2024-09-12T22:11:28.163 INFO:tasks.workunit.client.0.smithi019.stdout:6/533: fdatasync d9/d3d/f61 0 2024-09-12T22:11:28.163 INFO:tasks.workunit.client.0.smithi019.stdout:4/460: dwrite d9/d14/d33/f4b [0,4194304] 0 2024-09-12T22:11:28.164 INFO:tasks.workunit.client.0.smithi019.stdout:5/514: dwrite d0/d26/d5f/f8e [0,4194304] 0 2024-09-12T22:11:28.165 INFO:tasks.workunit.client.0.smithi019.stdout:0/487: sync 2024-09-12T22:11:28.165 INFO:tasks.workunit.client.0.smithi019.stdout:5/515: stat d0/d26/d6f/c81 0 2024-09-12T22:11:28.165 INFO:tasks.workunit.client.0.smithi019.stdout:1/504: sync 2024-09-12T22:11:28.165 INFO:tasks.workunit.client.0.smithi019.stdout:4/461: sync 2024-09-12T22:11:28.165 INFO:tasks.workunit.client.0.smithi019.stdout:8/473: dread d5/dc/d26/d5c/f93 [0,4194304] 0 2024-09-12T22:11:28.166 INFO:tasks.workunit.client.0.smithi019.stdout:1/505: stat d1/c68 0 2024-09-12T22:11:28.167 INFO:tasks.workunit.client.0.smithi019.stdout:2/402: creat d0/d31/d12/f83 x:0 0 0 2024-09-12T22:11:28.167 INFO:tasks.workunit.client.0.smithi019.stdout:5/516: symlink d0/d1d/d6d/la8 0 2024-09-12T22:11:28.167 INFO:tasks.workunit.client.0.smithi019.stdout:9/469: dread d12/d1b/d20/d29/d88/f89 [0,4194304] 0 2024-09-12T22:11:28.167 INFO:tasks.workunit.client.0.smithi019.stdout:7/524: mkdir da/d30/d53/db1/db5 0 2024-09-12T22:11:28.169 INFO:tasks.workunit.client.0.smithi019.stdout:8/474: creat d5/d53/d66/f99 x:0 0 0 2024-09-12T22:11:28.169 INFO:tasks.workunit.client.0.smithi019.stdout:5/517: creat d0/d1d/d4f/d96/fa9 x:0 0 0 2024-09-12T22:11:28.170 INFO:tasks.workunit.client.0.smithi019.stdout:4/462: rename d9/d14/d31/d3f/d94 to d9/d14/d57/d95 0 2024-09-12T22:11:28.171 INFO:tasks.workunit.client.0.smithi019.stdout:9/470: symlink d12/d1b/d20/d29/d74/d77/l9b 0 2024-09-12T22:11:28.171 INFO:tasks.workunit.client.0.smithi019.stdout:2/403: chown d0/d3/d11/d77/d78/c6a 233245596 1 2024-09-12T22:11:28.171 INFO:tasks.workunit.client.0.smithi019.stdout:7/525: unlink da/d24/d28/d1c/d32/d99/cab 0 2024-09-12T22:11:28.174 INFO:tasks.workunit.client.0.smithi019.stdout:4/463: mkdir d9/d14/d57/d95/d96 0 2024-09-12T22:11:28.176 INFO:tasks.workunit.client.0.smithi019.stdout:1/506: dwrite d1/d37/f4c [0,4194304] 0 2024-09-12T22:11:28.176 INFO:tasks.workunit.client.0.smithi019.stdout:2/404: write d0/d3/d11/d77/d78/d2c/d2d/f57 [1519018,104696] 0 2024-09-12T22:11:28.177 INFO:tasks.workunit.client.0.smithi019.stdout:6/534: dwrite d9/dc/d20/d4b/d64/d7e/f87 [0,4194304] 0 2024-09-12T22:11:28.177 INFO:tasks.workunit.client.0.smithi019.stdout:7/526: unlink da/d24/c6f 0 2024-09-12T22:11:28.177 INFO:tasks.workunit.client.0.smithi019.stdout:7/527: sync 2024-09-12T22:11:28.178 INFO:tasks.workunit.client.0.smithi019.stdout:0/488: dwrite d5/d7/d2c/d44/d6a/d76/f80 [0,4194304] 0 2024-09-12T22:11:28.178 INFO:tasks.workunit.client.0.smithi019.stdout:3/516: dread d18/f28 [0,4194304] 0 2024-09-12T22:11:28.179 INFO:tasks.workunit.client.0.smithi019.stdout:9/471: rename d12/d1b/d20/d64/d83/l87 to d12/d1b/d20/d64/l9c 0 2024-09-12T22:11:28.180 INFO:tasks.workunit.client.0.smithi019.stdout:8/475: dread d5/dc/d17/f67 [0,4194304] 0 2024-09-12T22:11:28.180 INFO:tasks.workunit.client.0.smithi019.stdout:6/535: write d9/d3d/d4f/f53 [4984220,125318] 0 2024-09-12T22:11:28.181 INFO:tasks.workunit.client.0.smithi019.stdout:2/405: getdents d0/d3/d11/d77/d82 0 2024-09-12T22:11:28.181 INFO:tasks.workunit.client.0.smithi019.stdout:4/464: write d9/db/f24 [3592350,117869] 0 2024-09-12T22:11:28.181 INFO:tasks.workunit.client.0.smithi019.stdout:1/507: chown d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f99 2 1 2024-09-12T22:11:28.182 INFO:tasks.workunit.client.0.smithi019.stdout:7/528: mkdir da/d30/d53/db1/db5/db6 0 2024-09-12T22:11:28.182 INFO:tasks.workunit.client.0.smithi019.stdout:0/489: chown d5/d7/d2c/d44/d6a/l27 0 1 2024-09-12T22:11:28.182 INFO:tasks.workunit.client.0.smithi019.stdout:6/536: fdatasync d9/dc/f52 0 2024-09-12T22:11:28.182 INFO:tasks.workunit.client.0.smithi019.stdout:6/537: sync 2024-09-12T22:11:28.182 INFO:tasks.workunit.client.0.smithi019.stdout:0/490: fsync d5/d7/d10/d26/d2a/f37 0 2024-09-12T22:11:28.184 INFO:tasks.workunit.client.0.smithi019.stdout:6/538: readlink d9/l1f 0 2024-09-12T22:11:28.184 INFO:tasks.workunit.client.0.smithi019.stdout:7/529: fsync da/d24/d28/d1c/f23 0 2024-09-12T22:11:28.185 INFO:tasks.workunit.client.0.smithi019.stdout:2/406: write d0/d3/d11/d77/d78/d2c/d2d/f57 [1295023,30995] 0 2024-09-12T22:11:28.186 INFO:tasks.workunit.client.0.smithi019.stdout:8/476: link d5/dc/d17/l39 d5/dc/d26/d5c/l9a 0 2024-09-12T22:11:28.186 INFO:tasks.workunit.client.0.smithi019.stdout:6/539: unlink d9/ce 0 2024-09-12T22:11:28.187 INFO:tasks.workunit.client.0.smithi019.stdout:5/518: dread d0/d1d/d4f/f16 [0,4194304] 0 2024-09-12T22:11:28.187 INFO:tasks.workunit.client.0.smithi019.stdout:4/465: truncate d9/d14/d33/f6e 30936 0 2024-09-12T22:11:28.187 INFO:tasks.workunit.client.0.smithi019.stdout:3/517: dwrite d18/f1b [4194304,4194304] 0 2024-09-12T22:11:28.188 INFO:tasks.workunit.client.0.smithi019.stdout:0/491: unlink d5/d7/d2c/d44/d6a/l27 0 2024-09-12T22:11:28.189 INFO:tasks.workunit.client.0.smithi019.stdout:8/477: fdatasync d5/d16/d19/d29/f4d 0 2024-09-12T22:11:28.189 INFO:tasks.workunit.client.0.smithi019.stdout:7/530: creat da/d24/fb7 x:0 0 0 2024-09-12T22:11:28.189 INFO:tasks.workunit.client.0.smithi019.stdout:6/540: write d9/dc/d20/d4b/f28 [1800453,55923] 0 2024-09-12T22:11:28.190 INFO:tasks.workunit.client.0.smithi019.stdout:4/466: chown d9/ff 6 1 2024-09-12T22:11:28.190 INFO:tasks.workunit.client.0.smithi019.stdout:9/472: dwrite d12/f17 [0,4194304] 0 2024-09-12T22:11:28.192 INFO:tasks.workunit.client.0.smithi019.stdout:0/492: rmdir d5/d7/d2c/d44/d6a 39 2024-09-12T22:11:28.192 INFO:tasks.workunit.client.0.smithi019.stdout:5/519: write d0/d1d/d4f/d47/f4a [664331,26300] 0 2024-09-12T22:11:28.193 INFO:tasks.workunit.client.0.smithi019.stdout:1/508: dwrite d1/d2/d18/d35/d84/dc/df/d61/f34 [0,4194304] 0 2024-09-12T22:11:28.193 INFO:tasks.workunit.client.0.smithi019.stdout:4/467: chown d9/d14/d31/d3f/c43 270219 1 2024-09-12T22:11:28.193 INFO:tasks.workunit.client.0.smithi019.stdout:2/407: getdents d0/d3 0 2024-09-12T22:11:28.193 INFO:tasks.workunit.client.0.smithi019.stdout:9/473: write d12/d1b/d40/f57 [458648,9125] 0 2024-09-12T22:11:28.193 INFO:tasks.workunit.client.0.smithi019.stdout:8/478: fdatasync d5/d53/d66/f6f 0 2024-09-12T22:11:28.193 INFO:tasks.workunit.client.0.smithi019.stdout:5/520: dread - d0/fa6 zero size 2024-09-12T22:11:28.194 INFO:tasks.workunit.client.0.smithi019.stdout:3/518: write d18/d26/d30/d4e/d80/fa4 [776637,130372] 0 2024-09-12T22:11:28.195 INFO:tasks.workunit.client.0.smithi019.stdout:1/509: stat d1/d2/d18/d35/l41 0 2024-09-12T22:11:28.195 INFO:tasks.workunit.client.0.smithi019.stdout:0/493: creat d5/d7/de/d9a/f9b x:0 0 0 2024-09-12T22:11:28.195 INFO:tasks.workunit.client.0.smithi019.stdout:8/479: fdatasync d5/d53/f6e 0 2024-09-12T22:11:28.195 INFO:tasks.workunit.client.0.smithi019.stdout:2/408: truncate d0/d3/d11/f5b 206449 0 2024-09-12T22:11:28.196 INFO:tasks.workunit.client.0.smithi019.stdout:3/519: mkdir d18/d26/da5 0 2024-09-12T22:11:28.196 INFO:tasks.workunit.client.0.smithi019.stdout:0/494: stat d5/d7/f4a 0 2024-09-12T22:11:28.196 INFO:tasks.workunit.client.0.smithi019.stdout:5/521: symlink d0/d24/d7a/laa 0 2024-09-12T22:11:28.197 INFO:tasks.workunit.client.0.smithi019.stdout:1/510: fdatasync d1/d2/d18/d59/f9f 0 2024-09-12T22:11:28.197 INFO:tasks.workunit.client.0.smithi019.stdout:8/480: stat d5/d16/d19/d32 0 2024-09-12T22:11:28.197 INFO:tasks.workunit.client.0.smithi019.stdout:5/522: creat d0/d4e/fab x:0 0 0 2024-09-12T22:11:28.197 INFO:tasks.workunit.client.0.smithi019.stdout:9/474: truncate d12/d1b/d40/d52/f65 741762 0 2024-09-12T22:11:28.198 INFO:tasks.workunit.client.0.smithi019.stdout:0/495: write d5/d7/d2c/d44/f97 [2808993,29403] 0 2024-09-12T22:11:28.198 INFO:tasks.workunit.client.0.smithi019.stdout:8/481: write d5/dc/d26/f30 [1036691,20219] 0 2024-09-12T22:11:28.199 INFO:tasks.workunit.client.0.smithi019.stdout:1/511: creat d1/d2/d18/d29/d51/fb0 x:0 0 0 2024-09-12T22:11:28.199 INFO:tasks.workunit.client.0.smithi019.stdout:9/475: mkdir d12/d1b/d20/d29/d92/d9d 0 2024-09-12T22:11:28.200 INFO:tasks.workunit.client.0.smithi019.stdout:1/512: rmdir d1/d2/d18/d35/d84/dc/df/d53/d55 39 2024-09-12T22:11:28.203 INFO:tasks.workunit.client.0.smithi019.stdout:4/468: dread d9/d14/d33/f46 [0,4194304] 0 2024-09-12T22:11:28.203 INFO:tasks.workunit.client.0.smithi019.stdout:1/513: fdatasync d1/d2/d18/d35/f3a 0 2024-09-12T22:11:28.203 INFO:tasks.workunit.client.0.smithi019.stdout:5/523: truncate d0/d4e/f78 2660902 0 2024-09-12T22:11:28.204 INFO:tasks.workunit.client.0.smithi019.stdout:9/476: rename d12/d1b/d40/d85/d98 to d12/d1b/d20/d59/d5b/d9e 0 2024-09-12T22:11:28.206 INFO:tasks.workunit.client.0.smithi019.stdout:2/409: dwrite d0/d3/df/f2a [0,4194304] 0 2024-09-12T22:11:28.207 INFO:tasks.workunit.client.0.smithi019.stdout:4/469: readlink d9/d14/d57/d5e/l89 0 2024-09-12T22:11:28.207 INFO:tasks.workunit.client.0.smithi019.stdout:9/477: unlink d12/f23 0 2024-09-12T22:11:28.208 INFO:tasks.workunit.client.0.smithi019.stdout:1/514: fsync d1/d2/d18/d35/d84/dc/df/f74 0 2024-09-12T22:11:28.208 INFO:tasks.workunit.client.0.smithi019.stdout:8/482: dwrite d5/d16/d19/f50 [0,4194304] 0 2024-09-12T22:11:28.208 INFO:tasks.workunit.client.0.smithi019.stdout:5/524: write d0/d1d/f95 [170594,8007] 0 2024-09-12T22:11:28.208 INFO:tasks.workunit.client.0.smithi019.stdout:2/410: stat d0/d3/d11/d77/d78/c6a 0 2024-09-12T22:11:28.210 INFO:tasks.workunit.client.0.smithi019.stdout:9/478: chown d12/d1b/d40/f70 2681 1 2024-09-12T22:11:28.210 INFO:tasks.workunit.client.0.smithi019.stdout:0/496: dwrite d5/d7/d10/d26/f71 [0,4194304] 0 2024-09-12T22:11:28.210 INFO:tasks.workunit.client.0.smithi019.stdout:4/470: fsync d9/db/d2b/d6a/f90 0 2024-09-12T22:11:28.211 INFO:tasks.workunit.client.0.smithi019.stdout:1/515: write d1/d2/d18/d35/f3a [1374650,78328] 0 2024-09-12T22:11:28.211 INFO:tasks.workunit.client.0.smithi019.stdout:5/525: dread d0/d1d/d4f/f16 [0,4194304] 0 2024-09-12T22:11:28.212 INFO:tasks.workunit.client.0.smithi019.stdout:9/479: mknod d12/d1b/c9f 0 2024-09-12T22:11:28.212 INFO:tasks.workunit.client.0.smithi019.stdout:0/497: creat d5/d7/d2c/d81/f9c x:0 0 0 2024-09-12T22:11:28.213 INFO:tasks.workunit.client.0.smithi019.stdout:2/411: write d0/d3/d11/d77/d78/d2c/f5a [4853463,40253] 0 2024-09-12T22:11:28.213 INFO:tasks.workunit.client.0.smithi019.stdout:8/483: rename d5/l77 to d5/dc/l9b 0 2024-09-12T22:11:28.213 INFO:tasks.workunit.client.0.smithi019.stdout:5/526: rename d0/d4e to d0/d4e/d50/dac 22 2024-09-12T22:11:28.214 INFO:tasks.workunit.client.0.smithi019.stdout:5/527: symlink d0/d1d/d6d/lad 0 2024-09-12T22:11:28.214 INFO:tasks.workunit.client.0.smithi019.stdout:9/480: fdatasync d12/d1b/d20/d29/d88/f89 0 2024-09-12T22:11:28.215 INFO:tasks.workunit.client.0.smithi019.stdout:9/481: fsync d12/d1b/f32 0 2024-09-12T22:11:28.216 INFO:tasks.workunit.client.0.smithi019.stdout:8/484: link d5/dc/d26/d43/d49/l8b d5/dc/d8a/l9c 0 2024-09-12T22:11:28.216 INFO:tasks.workunit.client.0.smithi019.stdout:1/516: rename d1/d2/d18/d29/f3e to d1/fb1 0 2024-09-12T22:11:28.217 INFO:tasks.workunit.client.0.smithi019.stdout:5/528: write d0/d1d/d3d/f69 [1007936,93165] 0 2024-09-12T22:11:28.219 INFO:tasks.workunit.client.0.smithi019.stdout:5/529: creat d0/d1d/d4f/d96/fae x:0 0 0 2024-09-12T22:11:28.220 INFO:tasks.workunit.client.0.smithi019.stdout:0/498: dwrite d5/d7/f4a [0,4194304] 0 2024-09-12T22:11:28.220 INFO:tasks.workunit.client.0.smithi019.stdout:9/482: write d12/d1b/d40/f57 [1087588,46579] 0 2024-09-12T22:11:28.221 INFO:tasks.workunit.client.0.smithi019.stdout:8/485: write d5/dc/d26/f36 [3125006,49589] 0 2024-09-12T22:11:28.221 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:28.221 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:28.222 INFO:tasks.workunit.client.0.smithi019.stdout:5/530: creat d0/d26/d42/faf x:0 0 0 2024-09-12T22:11:28.223 INFO:tasks.workunit.client.0.smithi019.stdout:2/412: dwrite d0/d3/df/d7b/f39 [0,4194304] 0 2024-09-12T22:11:28.224 INFO:tasks.workunit.client.0.smithi019.stdout:6/541: dread d9/d3d/d4f/f5e [0,4194304] 0 2024-09-12T22:11:28.226 INFO:tasks.workunit.client.0.smithi019.stdout:1/517: dwrite d1/d2/d18/d29/d27/f6a [0,4194304] 0 2024-09-12T22:11:28.226 INFO:tasks.workunit.client.0.smithi019.stdout:6/542: read - d9/dc/d20/d4b/d64/d7d/fa8 zero size 2024-09-12T22:11:28.227 INFO:tasks.workunit.client.0.smithi019.stdout:1/518: mknod d1/d2/d18/d29/d27/cb2 0 2024-09-12T22:11:28.229 INFO:tasks.workunit.client.0.smithi019.stdout:1/519: fdatasync d1/d2/d18/d29/d51/f5c 0 2024-09-12T22:11:28.229 INFO:tasks.workunit.client.0.smithi019.stdout:2/413: symlink d0/d3/d11/d2e/l84 0 2024-09-12T22:11:28.230 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:28.229+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:28.232 INFO:tasks.workunit.client.0.smithi019.stdout:3/520: dread d18/d26/d30/d4e/f6c [0,4194304] 0 2024-09-12T22:11:28.232 INFO:tasks.workunit.client.0.smithi019.stdout:9/483: dread d12/d1b/d40/f70 [0,4194304] 0 2024-09-12T22:11:28.234 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:28.234 INFO:tasks.workunit.client.0.smithi019.stdout:9/484: stat d12/c31 0 2024-09-12T22:11:28.236 INFO:tasks.workunit.client.0.smithi019.stdout:7/531: dread da/d24/f2c [4194304,4194304] 0 2024-09-12T22:11:28.236 INFO:tasks.workunit.client.0.smithi019.stdout:1/520: creat d1/d2/d18/d35/d84/fb3 x:0 0 0 2024-09-12T22:11:28.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/414: fdatasync d0/d3/d11/d77/d78/d2c/d30/d32/f81 0 2024-09-12T22:11:28.237 INFO:tasks.workunit.client.0.smithi019.stdout:6/543: dwrite d9/d3d/f3c [0,4194304] 0 2024-09-12T22:11:28.239 INFO:tasks.workunit.client.0.smithi019.stdout:5/531: dwrite d0/d1d/d4f/f64 [0,4194304] 0 2024-09-12T22:11:28.240 INFO:tasks.workunit.client.0.smithi019.stdout:8/486: dwrite d5/d16/f28 [0,4194304] 0 2024-09-12T22:11:28.240 INFO:tasks.workunit.client.0.smithi019.stdout:2/415: readlink d0/d3/d11/d77/d78/l3c 0 2024-09-12T22:11:28.240 INFO:tasks.workunit.client.0.smithi019.stdout:3/521: rename d18/d26/d30/d91/f98 to d18/d26/fa6 0 2024-09-12T22:11:28.240 INFO:tasks.workunit.client.0.smithi019.stdout:9/485: mkdir d12/d1b/d20/da0 0 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:4/471: dread d9/db/f24 [0,4194304] 0 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:6/544: mknod d9/dc/d20/d71/cb2 0 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:8/487: symlink d5/d53/d66/l9d 0 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:5/532: rmdir d0 39 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:2/416: readlink d0/d3/d11/d77/d78/d2c/d56/d60/l69 0 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:7/532: getdents da/d30 0 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:3/522: link f16 d18/d1d/d35/d9c/fa7 0 2024-09-12T22:11:28.243 INFO:tasks.workunit.client.0.smithi019.stdout:9/486: mknod d12/d1b/d20/ca1 0 2024-09-12T22:11:28.244 INFO:tasks.workunit.client.0.smithi019.stdout:8/488: dread - d5/dc/d26/d43/f6a zero size 2024-09-12T22:11:28.244 INFO:tasks.workunit.client.0.smithi019.stdout:2/417: write d0/d3/d11/d77/d78/d2c/f5a [2667764,83442] 0 2024-09-12T22:11:28.244 INFO:tasks.workunit.client.0.smithi019.stdout:2/418: fdatasync d0/d31/d12/f83 0 2024-09-12T22:11:28.245 INFO:tasks.workunit.client.0.smithi019.stdout:4/472: mknod d9/d17/c97 0 2024-09-12T22:11:28.246 INFO:tasks.workunit.client.0.smithi019.stdout:6/545: unlink d9/dc/d20/d4b/d7a/cae 0 2024-09-12T22:11:28.246 INFO:tasks.workunit.client.0.smithi019.stdout:3/523: creat d18/d58/fa8 x:0 0 0 2024-09-12T22:11:28.246 INFO:tasks.workunit.client.0.smithi019.stdout:7/533: mkdir da/d30/d53/db1/db5/db6/db8 0 2024-09-12T22:11:28.246 INFO:tasks.workunit.client.0.smithi019.stdout:4/473: write d9/f54 [4036331,127030] 0 2024-09-12T22:11:28.247 INFO:tasks.workunit.client.0.smithi019.stdout:6/546: chown d9/d3d/d4f/d8d/l9c 26148 1 2024-09-12T22:11:28.247 INFO:tasks.workunit.client.0.smithi019.stdout:8/489: rename d5/d53/f6e to d5/dc/d8a/d8e/f9e 0 2024-09-12T22:11:28.248 INFO:tasks.workunit.client.0.smithi019.stdout:7/534: mkdir da/d24/d28/d1c/db9 0 2024-09-12T22:11:28.248 INFO:tasks.workunit.client.0.smithi019.stdout:6/547: write d9/d3d/d6f/f5c [71253,56418] 0 2024-09-12T22:11:28.249 INFO:tasks.workunit.client.0.smithi019.stdout:7/535: sync 2024-09-12T22:11:28.250 INFO:tasks.workunit.client.0.smithi019.stdout:6/548: unlink l3 0 2024-09-12T22:11:28.252 INFO:tasks.workunit.client.0.smithi019.stdout:9/487: dwrite d12/d1b/d20/d25/f49 [0,4194304] 0 2024-09-12T22:11:28.252 INFO:tasks.workunit.client.0.smithi019.stdout:2/419: truncate d0/d31/d4/d7/f45 2167258 0 2024-09-12T22:11:28.252 INFO:tasks.workunit.client.0.smithi019.stdout:3/524: write d18/d1d/f2a [129006,115150] 0 2024-09-12T22:11:28.252 INFO:tasks.workunit.client.0.smithi019.stdout:1/521: dread d1/d2/d18/d35/d84/dc/df/d2c/d5d/f8e [0,4194304] 0 2024-09-12T22:11:28.253 INFO:tasks.workunit.client.0.smithi019.stdout:6/549: creat d9/dc/d20/d4b/fb3 x:0 0 0 2024-09-12T22:11:28.257 INFO:tasks.workunit.client.0.smithi019.stdout:4/474: dwrite d9/d14/d57/f7c [0,4194304] 0 2024-09-12T22:11:28.257 INFO:tasks.workunit.client.0.smithi019.stdout:0/499: dread d5/f41 [0,4194304] 0 2024-09-12T22:11:28.257 INFO:tasks.workunit.client.0.smithi019.stdout:9/488: symlink d12/d1b/d20/d64/d83/la2 0 2024-09-12T22:11:28.257 INFO:tasks.workunit.client.0.smithi019.stdout:6/550: chown d9/dc/d20/d71/lac 28567 1 2024-09-12T22:11:28.257 INFO:tasks.workunit.client.0.smithi019.stdout:9/489: readlink d12/l18 0 2024-09-12T22:11:28.257 INFO:tasks.workunit.client.0.smithi019.stdout:9/490: sync 2024-09-12T22:11:28.257 INFO:tasks.workunit.client.0.smithi019.stdout:4/475: creat d9/d87/f98 x:0 0 0 2024-09-12T22:11:28.258 INFO:tasks.workunit.client.0.smithi019.stdout:3/525: rename d18/d26/d30/d64/l70 to d18/d26/d30/d4e/d80/la9 0 2024-09-12T22:11:28.258 INFO:tasks.workunit.client.0.smithi019.stdout:0/500: symlink d5/d88/l9d 0 2024-09-12T22:11:28.259 INFO:tasks.workunit.client.0.smithi019.stdout:3/526: fdatasync d18/d58/f7b 0 2024-09-12T22:11:28.259 INFO:tasks.workunit.client.0.smithi019.stdout:2/420: rename d0/d3/df/c1d to d0/d3/d11/d2e/d34/c85 0 2024-09-12T22:11:28.260 INFO:tasks.workunit.client.0.smithi019.stdout:7/536: dwrite da/d24/d28/d1c/d32/f89 [0,4194304] 0 2024-09-12T22:11:28.260 INFO:tasks.workunit.client.0.smithi019.stdout:0/501: creat d5/d7/d10/d26/f9e x:0 0 0 2024-09-12T22:11:28.261 INFO:tasks.workunit.client.0.smithi019.stdout:9/491: dread d12/d1b/d20/f5c [0,4194304] 0 2024-09-12T22:11:28.261 INFO:tasks.workunit.client.0.smithi019.stdout:2/421: write d0/d3/df/f2a [1580656,88434] 0 2024-09-12T22:11:28.262 INFO:tasks.workunit.client.0.smithi019.stdout:7/537: mknod da/d24/d28/d1c/cba 0 2024-09-12T22:11:28.262 INFO:tasks.workunit.client.0.smithi019.stdout:3/527: rename d18/d26/d30/d4e/l6b to d18/d26/da5/laa 0 2024-09-12T22:11:28.263 INFO:tasks.workunit.client.0.smithi019.stdout:8/490: dread d5/d53/f89 [0,4194304] 0 2024-09-12T22:11:28.264 INFO:tasks.workunit.client.0.smithi019.stdout:0/502: chown d5/d7/d2c/d44/d6a/d76/c7a 565332 1 2024-09-12T22:11:28.264 INFO:tasks.workunit.client.0.smithi019.stdout:9/492: mknod d12/d1b/d20/d25/ca3 0 2024-09-12T22:11:28.264 INFO:tasks.workunit.client.0.smithi019.stdout:2/422: creat d0/d3/df/d6b/f86 x:0 0 0 2024-09-12T22:11:28.265 INFO:tasks.workunit.client.0.smithi019.stdout:3/528: unlink d18/d1d/d35/c75 0 2024-09-12T22:11:28.266 INFO:tasks.workunit.client.0.smithi019.stdout:4/476: dwrite d9/d14/d31/f5c [0,4194304] 0 2024-09-12T22:11:28.266 INFO:tasks.workunit.client.0.smithi019.stdout:1/522: dwrite d1/d2/da2/fa5 [0,4194304] 0 2024-09-12T22:11:28.266 INFO:tasks.workunit.client.0.smithi019.stdout:8/491: write d5/dc/d26/f36 [5236601,70771] 0 2024-09-12T22:11:28.267 INFO:tasks.workunit.client.0.smithi019.stdout:2/423: stat d0/d31/d12/f17 0 2024-09-12T22:11:28.267 INFO:tasks.workunit.client.0.smithi019.stdout:4/477: fsync f5 0 2024-09-12T22:11:28.268 INFO:tasks.workunit.client.0.smithi019.stdout:0/503: truncate d5/d87/f8b 407743 0 2024-09-12T22:11:28.268 INFO:tasks.workunit.client.0.smithi019.stdout:9/493: write d12/d1b/d20/d29/f50 [368798,90139] 0 2024-09-12T22:11:28.271 INFO:tasks.workunit.client.0.smithi019.stdout:2/424: creat d0/d3/d11/d77/d78/d2c/d30/f87 x:0 0 0 2024-09-12T22:11:28.271 INFO:tasks.workunit.client.0.smithi019.stdout:4/478: chown d9/db/d2b/d6a/d7d/l86 110645 1 2024-09-12T22:11:28.271 INFO:tasks.workunit.client.0.smithi019.stdout:1/523: write d1/d2/d18/d35/d84/dc/f69 [3341694,65478] 0 2024-09-12T22:11:28.271 INFO:tasks.workunit.client.0.smithi019.stdout:7/538: dwrite da/d24/fb7 [0,4194304] 0 2024-09-12T22:11:28.273 INFO:tasks.workunit.client.0.smithi019.stdout:2/425: write d0/d3/d11/f10 [2564574,130710] 0 2024-09-12T22:11:28.273 INFO:tasks.workunit.client.0.smithi019.stdout:0/504: rename d5/d7/de/c64 to d5/d7/d10/d26/c9f 0 2024-09-12T22:11:28.275 INFO:tasks.workunit.client.0.smithi019.stdout:1/524: write d1/d2/d18/d35/d84/f5a [1322370,105261] 0 2024-09-12T22:11:28.275 INFO:tasks.workunit.client.0.smithi019.stdout:3/529: dwrite d18/f34 [4194304,4194304] 0 2024-09-12T22:11:28.277 INFO:tasks.workunit.client.0.smithi019.stdout:0/505: stat d5/d7/d2c/d44/d6a/d46/l89 0 2024-09-12T22:11:28.278 INFO:tasks.workunit.client.0.smithi019.stdout:4/479: creat d9/db/f99 x:0 0 0 2024-09-12T22:11:28.278 INFO:tasks.workunit.client.0.smithi019.stdout:7/539: fdatasync da/d19/d25/d39/fb0 0 2024-09-12T22:11:28.278 INFO:tasks.workunit.client.0.smithi019.stdout:8/492: dwrite d5/f15 [8388608,4194304] 0 2024-09-12T22:11:28.278 INFO:tasks.workunit.client.0.smithi019.stdout:9/494: write d12/d1b/d40/f5e [1651397,50114] 0 2024-09-12T22:11:28.278 INFO:tasks.workunit.client.0.smithi019.stdout:2/426: rmdir d0/d3/d11/d77/d78/d2c/d56 39 2024-09-12T22:11:28.279 INFO:tasks.workunit.client.0.smithi019.stdout:1/525: creat d1/d37/fb4 x:0 0 0 2024-09-12T22:11:28.279 INFO:tasks.workunit.client.0.smithi019.stdout:4/480: write f5 [723513,116375] 0 2024-09-12T22:11:28.280 INFO:tasks.workunit.client.0.smithi019.stdout:0/506: rename d5/d7/l49 to d5/d7/de/la0 0 2024-09-12T22:11:28.281 INFO:tasks.workunit.client.0.smithi019.stdout:8/493: unlink d5/dc/f7c 0 2024-09-12T22:11:28.281 INFO:tasks.workunit.client.0.smithi019.stdout:4/481: write d9/f3b [3121773,97113] 0 2024-09-12T22:11:28.281 INFO:tasks.workunit.client.0.smithi019.stdout:0/507: write d5/d7/f91 [633067,24869] 0 2024-09-12T22:11:28.281 INFO:tasks.workunit.client.0.smithi019.stdout:1/526: write d1/d2/d18/d35/f3a [6205348,105596] 0 2024-09-12T22:11:28.282 INFO:tasks.workunit.client.0.smithi019.stdout:9/495: symlink d12/d1b/d20/da0/la4 0 2024-09-12T22:11:28.282 INFO:tasks.workunit.client.0.smithi019.stdout:4/482: creat d9/d14/d57/d69/d6f/f9a x:0 0 0 2024-09-12T22:11:28.283 INFO:tasks.workunit.client.0.smithi019.stdout:4/483: readlink d9/d14/d31/d3f/l4a 0 2024-09-12T22:11:28.283 INFO:tasks.workunit.client.0.smithi019.stdout:7/540: rename da/d24/d28/d1c/d32/f8d to da/d24/fbb 0 2024-09-12T22:11:28.284 INFO:tasks.workunit.client.0.smithi019.stdout:5/533: dread d0/d1d/d3d/f48 [0,4194304] 0 2024-09-12T22:11:28.284 INFO:tasks.workunit.client.0.smithi019.stdout:7/541: stat da/d8f/la7 0 2024-09-12T22:11:28.284 INFO:tasks.workunit.client.0.smithi019.stdout:0/508: creat d5/d7/d2c/d44/d6a/d76/fa1 x:0 0 0 2024-09-12T22:11:28.285 INFO:tasks.workunit.client.0.smithi019.stdout:9/496: mkdir d12/d1b/d20/d29/d92/d9d/da5 0 2024-09-12T22:11:28.285 INFO:tasks.workunit.client.0.smithi019.stdout:4/484: write d9/d58/f68 [1253674,95831] 0 2024-09-12T22:11:28.285 INFO:tasks.workunit.client.0.smithi019.stdout:5/534: write d0/d1d/d4f/d96/fa9 [171868,30330] 0 2024-09-12T22:11:28.286 INFO:tasks.workunit.client.0.smithi019.stdout:8/494: rename d5/dc/l9b to d5/dc/d26/d5c/l9f 0 2024-09-12T22:11:28.286 INFO:tasks.workunit.client.0.smithi019.stdout:0/509: creat d5/d7/d2c/d81/fa2 x:0 0 0 2024-09-12T22:11:28.287 INFO:tasks.workunit.client.0.smithi019.stdout:9/497: write d12/d1b/d20/d29/d56/f81 [113605,73621] 0 2024-09-12T22:11:28.287 INFO:tasks.workunit.client.0.smithi019.stdout:0/510: read - d5/d7/d2c/d81/f9c zero size 2024-09-12T22:11:28.288 INFO:tasks.workunit.client.0.smithi019.stdout:5/535: truncate d0/d26/d5f/f9e 789782 0 2024-09-12T22:11:28.289 INFO:tasks.workunit.client.0.smithi019.stdout:3/530: dread d18/f56 [0,4194304] 0 2024-09-12T22:11:28.289 INFO:tasks.workunit.client.0.smithi019.stdout:5/536: symlink d0/d26/d6f/lb0 0 2024-09-12T22:11:28.290 INFO:tasks.workunit.client.0.smithi019.stdout:0/511: write d5/d7/d2c/d44/d6a/d76/f80 [2728122,1359] 0 2024-09-12T22:11:28.290 INFO:tasks.workunit.client.0.smithi019.stdout:9/498: getdents d12/d1b/d40/d52 0 2024-09-12T22:11:28.291 INFO:tasks.workunit.client.0.smithi019.stdout:4/485: dread d9/d14/d31/f5c [0,4194304] 0 2024-09-12T22:11:28.293 INFO:tasks.workunit.client.0.smithi019.stdout:1/527: truncate d1/d2/da2/fa5 1775080 0 2024-09-12T22:11:28.293 INFO:tasks.workunit.client.0.smithi019.stdout:5/537: rename d0/d26/d42/f89 to d0/d24/fb1 0 2024-09-12T22:11:28.293 INFO:tasks.workunit.client.0.smithi019.stdout:4/486: chown d9/d73 12458 1 2024-09-12T22:11:28.293 INFO:tasks.workunit.client.0.smithi019.stdout:7/542: truncate da/d8f/f7f 1236350 0 2024-09-12T22:11:28.293 INFO:tasks.workunit.client.0.smithi019.stdout:0/512: write d5/d7/d2c/d44/d6a/d46/f60 [3269433,52298] 0 2024-09-12T22:11:28.293 INFO:tasks.workunit.client.0.smithi019.stdout:3/531: write d18/d26/d30/d4e/f59 [1986412,10822] 0 2024-09-12T22:11:28.294 INFO:tasks.workunit.client.0.smithi019.stdout:5/538: stat d0/f4 0 2024-09-12T22:11:28.294 INFO:tasks.workunit.client.0.smithi019.stdout:3/532: chown d18/d58 5845 1 2024-09-12T22:11:28.295 INFO:tasks.workunit.client.0.smithi019.stdout:8/495: dwrite d5/dc/d26/d43/f4c [0,4194304] 0 2024-09-12T22:11:28.296 INFO:tasks.workunit.client.0.smithi019.stdout:6/551: dread d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:28.297 INFO:tasks.workunit.client.0.smithi019.stdout:7/543: unlink da/d24/d28/d1c/c3e 0 2024-09-12T22:11:28.297 INFO:tasks.workunit.client.0.smithi019.stdout:0/513: mkdir d5/d7/de/da3 0 2024-09-12T22:11:28.298 INFO:tasks.workunit.client.0.smithi019.stdout:1/528: rename d1/d2/d18/d70/f7a to d1/d2/fb5 0 2024-09-12T22:11:28.299 INFO:tasks.workunit.client.0.smithi019.stdout:6/552: chown d9/dc/d20/d4b/d6c/f70 130347958 1 2024-09-12T22:11:28.300 INFO:tasks.workunit.client.0.smithi019.stdout:7/544: truncate da/d19/d79/f90 84569 0 2024-09-12T22:11:28.300 INFO:tasks.workunit.client.0.smithi019.stdout:1/529: chown d1/c68 414521994 1 2024-09-12T22:11:28.300 INFO:tasks.workunit.client.0.smithi019.stdout:9/499: dwrite f9 [0,4194304] 0 2024-09-12T22:11:28.300 INFO:tasks.workunit.client.0.smithi019.stdout:1/530: sync 2024-09-12T22:11:28.300 INFO:tasks.workunit.client.0.smithi019.stdout:5/539: getdents d0/d26/d5f 0 2024-09-12T22:11:28.301 INFO:tasks.workunit.client.0.smithi019.stdout:6/553: dread - d9/d3d/d4f/d8d/fa6 zero size 2024-09-12T22:11:28.302 INFO:tasks.workunit.client.0.smithi019.stdout:1/531: unlink d1/d2/d18/d59/l7f 0 2024-09-12T22:11:28.302 INFO:tasks.workunit.client.0.smithi019.stdout:9/500: mknod d12/d1b/d20/d29/d56/d60/ca6 0 2024-09-12T22:11:28.303 INFO:tasks.workunit.client.0.smithi019.stdout:7/545: mknod da/d24/cbc 0 2024-09-12T22:11:28.303 INFO:tasks.workunit.client.0.smithi019.stdout:0/514: rename d5/d87/l90 to d5/d7/la4 0 2024-09-12T22:11:28.304 INFO:tasks.workunit.client.0.smithi019.stdout:6/554: readlink d9/dc/d20/d30/l33 0 2024-09-12T22:11:28.304 INFO:tasks.workunit.client.0.smithi019.stdout:3/533: dwrite d18/f34 [0,4194304] 0 2024-09-12T22:11:28.304 INFO:tasks.workunit.client.0.smithi019.stdout:5/540: truncate d0/f1b 8470175 0 2024-09-12T22:11:28.304 INFO:tasks.workunit.client.0.smithi019.stdout:9/501: rmdir d12/d1b/d20/da0 39 2024-09-12T22:11:28.305 INFO:tasks.workunit.client.0.smithi019.stdout:7/546: symlink da/d30/lbd 0 2024-09-12T22:11:28.306 INFO:tasks.workunit.client.0.smithi019.stdout:9/502: chown d12/d1b/d20/d29/d56/d60 8872 1 2024-09-12T22:11:28.306 INFO:tasks.workunit.client.0.smithi019.stdout:0/515: fsync d5/d7/d2c/d44/d6a/d52/f84 0 2024-09-12T22:11:28.307 INFO:tasks.workunit.client.0.smithi019.stdout:4/487: dread d9/d14/d31/f8b [0,4194304] 0 2024-09-12T22:11:28.308 INFO:tasks.workunit.client.0.smithi019.stdout:5/541: rename d0/d4e/d50/f60 to d0/d26/d42/fb2 0 2024-09-12T22:11:28.309 INFO:tasks.workunit.client.0.smithi019.stdout:3/534: creat d18/d1d/d35/d9c/fab x:0 0 0 2024-09-12T22:11:28.309 INFO:tasks.workunit.client.0.smithi019.stdout:2/427: dread d0/d31/d12/d15/f23 [4194304,4194304] 0 2024-09-12T22:11:28.311 INFO:tasks.workunit.client.0.smithi019.stdout:4/488: readlink d9/l2a 0 2024-09-12T22:11:28.311 INFO:tasks.workunit.client.0.smithi019.stdout:5/542: write d0/d1d/f31 [524405,50955] 0 2024-09-12T22:11:28.311 INFO:tasks.workunit.client.0.smithi019.stdout:8/496: dwrite d5/dc/d8a/d8e/f9e [0,4194304] 0 2024-09-12T22:11:28.311 INFO:tasks.workunit.client.0.smithi019.stdout:0/516: truncate d5/d7/de/f7f 498580 0 2024-09-12T22:11:28.314 INFO:tasks.workunit.client.0.smithi019.stdout:7/547: dwrite da/d30/f6a [0,4194304] 0 2024-09-12T22:11:28.314 INFO:tasks.workunit.client.0.smithi019.stdout:6/555: dread d9/fa [0,4194304] 0 2024-09-12T22:11:28.314 INFO:tasks.workunit.client.0.smithi019.stdout:6/556: sync 2024-09-12T22:11:28.315 INFO:tasks.workunit.client.0.smithi019.stdout:8/497: unlink d5/dc/d26/f41 0 2024-09-12T22:11:28.315 INFO:tasks.workunit.client.0.smithi019.stdout:0/517: truncate d5/d7/f93 259475 0 2024-09-12T22:11:28.315 INFO:tasks.workunit.client.0.smithi019.stdout:4/489: mkdir d9/d14/d57/d9b 0 2024-09-12T22:11:28.317 INFO:tasks.workunit.client.0.smithi019.stdout:9/503: dwrite d12/d1b/d20/d59/d5b/d9e/f7f [0,4194304] 0 2024-09-12T22:11:28.317 INFO:tasks.workunit.client.0.smithi019.stdout:4/490: mkdir d9/d4c/d9c 0 2024-09-12T22:11:28.317 INFO:tasks.workunit.client.0.smithi019.stdout:8/498: mknod d5/dc/d26/d43/d49/d92/ca0 0 2024-09-12T22:11:28.317 INFO:tasks.workunit.client.0.smithi019.stdout:4/491: readlink d9/d14/d57/l62 0 2024-09-12T22:11:28.319 INFO:tasks.workunit.client.0.smithi019.stdout:0/518: link d5/d7/d2c/d81/f9c d5/d7/de/d9a/fa5 0 2024-09-12T22:11:28.319 INFO:tasks.workunit.client.0.smithi019.stdout:8/499: fsync d5/dc/d26/d4b/f91 0 2024-09-12T22:11:28.319 INFO:tasks.workunit.client.0.smithi019.stdout:7/548: rename da/d24/d28/d1c/c70 to da/d24/d28/d1c/d32/daf/cbe 0 2024-09-12T22:11:28.319 INFO:tasks.workunit.client.0.smithi019.stdout:0/519: fsync d5/d7/d10/d26/f9e 0 2024-09-12T22:11:28.320 INFO:tasks.workunit.client.0.smithi019.stdout:5/543: read d0/d1d/d4f/d47/f70 [124019,37483] 0 2024-09-12T22:11:28.320 INFO:tasks.workunit.client.0.smithi019.stdout:0/520: chown d5/f16 166 1 2024-09-12T22:11:28.320 INFO:tasks.workunit.client.0.smithi019.stdout:9/504: creat d12/d1b/d20/d59/d5b/d9a/fa7 x:0 0 0 2024-09-12T22:11:28.321 INFO:tasks.workunit.client.0.smithi019.stdout:4/492: creat d9/d73/d8f/d93/f9d x:0 0 0 2024-09-12T22:11:28.322 INFO:tasks.workunit.client.0.smithi019.stdout:3/535: truncate d18/d26/d30/d4a/f68 1236071 0 2024-09-12T22:11:28.322 INFO:tasks.workunit.client.0.smithi019.stdout:0/521: fsync d5/d7/d10/f55 0 2024-09-12T22:11:28.322 INFO:tasks.workunit.client.0.smithi019.stdout:5/544: mknod d0/d4e/d50/cb3 0 2024-09-12T22:11:28.324 INFO:tasks.workunit.client.0.smithi019.stdout:4/493: stat d9/d14/l32 0 2024-09-12T22:11:28.324 INFO:tasks.workunit.client.0.smithi019.stdout:2/428: read d0/d31/d4/d7/f45 [1404003,114161] 0 2024-09-12T22:11:28.325 INFO:tasks.workunit.client.0.smithi019.stdout:5/545: read d0/d1d/d4f/f64 [1372798,1482] 0 2024-09-12T22:11:28.325 INFO:tasks.workunit.client.0.smithi019.stdout:4/494: stat d9/d14/d33/d4e/c52 0 2024-09-12T22:11:28.325 INFO:tasks.workunit.client.0.smithi019.stdout:9/505: creat d12/d1b/d20/d29/d74/d77/fa8 x:0 0 0 2024-09-12T22:11:28.326 INFO:tasks.workunit.client.0.smithi019.stdout:2/429: chown d0/d3/d11/d2e/d70 24938 1 2024-09-12T22:11:28.328 INFO:tasks.workunit.client.0.smithi019.stdout:5/546: creat d0/d1d/d4f/d47/fb4 x:0 0 0 2024-09-12T22:11:28.328 INFO:tasks.workunit.client.0.smithi019.stdout:1/532: dread d1/d2/f24 [0,4194304] 0 2024-09-12T22:11:28.328 INFO:tasks.workunit.client.0.smithi019.stdout:5/547: sync 2024-09-12T22:11:28.328 INFO:tasks.workunit.client.0.smithi019.stdout:9/506: symlink d12/d1b/d40/d85/la9 0 2024-09-12T22:11:28.328 INFO:tasks.workunit.client.0.smithi019.stdout:6/557: dwrite d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:28.329 INFO:tasks.workunit.client.0.smithi019.stdout:0/522: symlink d5/d7/d10/d26/d2a/d94/la6 0 2024-09-12T22:11:28.329 INFO:tasks.workunit.client.0.smithi019.stdout:8/500: dwrite d5/f15 [0,4194304] 0 2024-09-12T22:11:28.330 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:28.329+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:28.333 INFO:tasks.workunit.client.0.smithi019.stdout:8/501: fdatasync d5/d53/d66/f6f 0 2024-09-12T22:11:28.333 INFO:tasks.workunit.client.0.smithi019.stdout:1/533: write d1/d2/d18/d35/d84/dc/fa6 [305777,39252] 0 2024-09-12T22:11:28.334 INFO:tasks.workunit.client.0.smithi019.stdout:4/495: truncate f7 3982705 0 2024-09-12T22:11:28.335 INFO:tasks.workunit.client.0.smithi019.stdout:8/502: chown d5/dc/d17/f72 841951 1 2024-09-12T22:11:28.335 INFO:tasks.workunit.client.0.smithi019.stdout:6/558: symlink d9/dc/d20/d4b/d64/d78/da1/lb4 0 2024-09-12T22:11:28.335 INFO:tasks.workunit.client.0.smithi019.stdout:5/548: rename d0/d1d/d4f/d47/d57/f6e to d0/d26/d3a/fb5 0 2024-09-12T22:11:28.336 INFO:tasks.workunit.client.0.smithi019.stdout:3/536: dwrite d18/d26/d30/d4e/f99 [0,4194304] 0 2024-09-12T22:11:28.336 INFO:tasks.workunit.client.0.smithi019.stdout:9/507: symlink d12/d1b/d20/da0/laa 0 2024-09-12T22:11:28.337 INFO:tasks.workunit.client.0.smithi019.stdout:2/430: dwrite d0/d31/d4/f3f [4194304,4194304] 0 2024-09-12T22:11:28.337 INFO:tasks.workunit.client.0.smithi019.stdout:6/559: readlink d9/d3d/d4f/d8d/l9c 0 2024-09-12T22:11:28.338 INFO:tasks.workunit.client.0.smithi019.stdout:6/560: write d9/dc/d20/f1a [3060199,83367] 0 2024-09-12T22:11:28.339 INFO:tasks.workunit.client.0.smithi019.stdout:6/561: stat d9/f4e 0 2024-09-12T22:11:28.339 INFO:tasks.workunit.client.0.smithi019.stdout:4/496: creat d9/d4c/d9c/f9e x:0 0 0 2024-09-12T22:11:28.339 INFO:tasks.workunit.client.0.smithi019.stdout:1/534: creat d1/d2/d18/d70/fb6 x:0 0 0 2024-09-12T22:11:28.339 INFO:tasks.workunit.client.0.smithi019.stdout:8/503: mknod d5/dc/d17/ca1 0 2024-09-12T22:11:28.339 INFO:tasks.workunit.client.0.smithi019.stdout:5/549: mkdir d0/d26/d3a/db6 0 2024-09-12T22:11:28.340 INFO:tasks.workunit.client.0.smithi019.stdout:6/562: read d9/dc/d20/f2e [2553952,64427] 0 2024-09-12T22:11:28.340 INFO:tasks.workunit.client.0.smithi019.stdout:2/431: mknod d0/d3/d11/d77/d78/d2c/d56/c88 0 2024-09-12T22:11:28.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/508: dread f9 [0,4194304] 0 2024-09-12T22:11:28.341 INFO:tasks.workunit.client.0.smithi019.stdout:1/535: dread - d1/d2/d18/d35/d84/dc/df/d53/d55/faa zero size 2024-09-12T22:11:28.341 INFO:tasks.workunit.client.0.smithi019.stdout:5/550: readlink d0/d24/d7a/laa 0 2024-09-12T22:11:28.342 INFO:tasks.workunit.client.0.smithi019.stdout:8/504: mknod d5/dc/d26/d43/d7d/ca2 0 2024-09-12T22:11:28.342 INFO:tasks.workunit.client.0.smithi019.stdout:2/432: stat d0/d3/d11/d2e/d34/d51/c5f 0 2024-09-12T22:11:28.343 INFO:tasks.workunit.client.0.smithi019.stdout:6/563: mknod d9/dc/d20/d4b/d6c/cb5 0 2024-09-12T22:11:28.343 INFO:tasks.workunit.client.0.smithi019.stdout:8/505: readlink d5/d16/d19/l78 0 2024-09-12T22:11:28.343 INFO:tasks.workunit.client.0.smithi019.stdout:5/551: symlink d0/d4e/lb7 0 2024-09-12T22:11:28.343 INFO:tasks.workunit.client.0.smithi019.stdout:1/536: fdatasync d1/d37/f4c 0 2024-09-12T22:11:28.344 INFO:tasks.workunit.client.0.smithi019.stdout:1/537: chown d1/d2/d18 263394864 1 2024-09-12T22:11:28.345 INFO:tasks.workunit.client.0.smithi019.stdout:2/433: stat d0/d31/d12/d3b/d5c/d71/f73 0 2024-09-12T22:11:28.345 INFO:tasks.workunit.client.0.smithi019.stdout:5/552: fdatasync d0/d1d/d4f/f4d 0 2024-09-12T22:11:28.346 INFO:tasks.workunit.client.0.smithi019.stdout:4/497: dwrite d9/d4c/f88 [0,4194304] 0 2024-09-12T22:11:28.347 INFO:tasks.workunit.client.0.smithi019.stdout:3/537: truncate d18/d26/d30/d4e/f73 468509 0 2024-09-12T22:11:28.348 INFO:tasks.workunit.client.0.smithi019.stdout:1/538: dread - d1/d2/d18/d29/d51/fb0 zero size 2024-09-12T22:11:28.351 INFO:tasks.workunit.client.0.smithi019.stdout:6/564: rename d9/dc/d20/d4b/c48 to d9/dc/cb6 0 2024-09-12T22:11:28.351 INFO:tasks.workunit.client.0.smithi019.stdout:2/434: creat d0/d3/d11/d2e/d34/d51/f89 x:0 0 0 2024-09-12T22:11:28.351 INFO:tasks.workunit.client.0.smithi019.stdout:4/498: symlink d9/db/d2b/d6a/l9f 0 2024-09-12T22:11:28.351 INFO:tasks.workunit.client.0.smithi019.stdout:8/506: dwrite d5/d16/d19/f40 [0,4194304] 0 2024-09-12T22:11:28.352 INFO:tasks.workunit.client.0.smithi019.stdout:0/523: dread d5/d7/d10/d26/d8a/f8c [0,4194304] 0 2024-09-12T22:11:28.352 INFO:tasks.workunit.client.0.smithi019.stdout:2/435: stat d0/d3/d11/d77/d78/d2c/c68 0 2024-09-12T22:11:28.353 INFO:tasks.workunit.client.0.smithi019.stdout:2/436: chown d0/d31 16 1 2024-09-12T22:11:28.353 INFO:tasks.workunit.client.0.smithi019.stdout:4/499: read d9/d14/d31/f8b [333275,49692] 0 2024-09-12T22:11:28.353 INFO:tasks.workunit.client.0.smithi019.stdout:8/507: creat d5/dc/d26/d5c/fa3 x:0 0 0 2024-09-12T22:11:28.353 INFO:tasks.workunit.client.0.smithi019.stdout:8/508: sync 2024-09-12T22:11:28.354 INFO:tasks.workunit.client.0.smithi019.stdout:4/500: symlink d9/d73/la0 0 2024-09-12T22:11:28.355 INFO:tasks.workunit.client.0.smithi019.stdout:1/539: write d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f79 [1195528,30701] 0 2024-09-12T22:11:28.355 INFO:tasks.workunit.client.0.smithi019.stdout:4/501: stat d9/d14/d57/d5e/c64 0 2024-09-12T22:11:28.356 INFO:tasks.workunit.client.0.smithi019.stdout:4/502: write d9/d14/d57/f7c [149703,72661] 0 2024-09-12T22:11:28.356 INFO:tasks.workunit.client.0.smithi019.stdout:1/540: dread - d1/d2/d18/d35/d84/dc/df/d53/d66/f8b zero size 2024-09-12T22:11:28.357 INFO:tasks.workunit.client.0.smithi019.stdout:6/565: rename d9/dc/d20/d4b/d6c/d8c/d8f to d9/dc/d20/d30/db7 0 2024-09-12T22:11:28.357 INFO:tasks.workunit.client.0.smithi019.stdout:4/503: mkdir d9/d17/da1 0 2024-09-12T22:11:28.358 INFO:tasks.workunit.client.0.smithi019.stdout:8/509: write d5/dc/d17/f67 [4594600,2208] 0 2024-09-12T22:11:28.358 INFO:tasks.workunit.client.0.smithi019.stdout:0/524: rename d5/d7/d10/d26/d8a/f8c to d5/d7/de/fa7 0 2024-09-12T22:11:28.358 INFO:tasks.workunit.client.0.smithi019.stdout:6/566: chown d9/dc/d20/d4b/d6c 3 1 2024-09-12T22:11:28.359 INFO:tasks.workunit.client.0.smithi019.stdout:4/504: write d9/d58/f68 [2879015,66652] 0 2024-09-12T22:11:28.360 INFO:tasks.workunit.client.0.smithi019.stdout:1/541: creat d1/d2/d18/d35/d84/dc/df/fb7 x:0 0 0 2024-09-12T22:11:28.360 INFO:tasks.workunit.client.0.smithi019.stdout:6/567: mkdir d9/d3d/db8 0 2024-09-12T22:11:28.360 INFO:tasks.workunit.client.0.smithi019.stdout:0/525: mknod d5/d7/d2c/d44/d6a/d46/ca8 0 2024-09-12T22:11:28.360 INFO:tasks.workunit.client.0.smithi019.stdout:4/505: fsync d9/d14/d57/f7c 0 2024-09-12T22:11:28.361 INFO:tasks.workunit.client.0.smithi019.stdout:2/437: truncate d0/d31/d12/f1b 1654481 0 2024-09-12T22:11:28.362 INFO:tasks.workunit.client.0.smithi019.stdout:7/549: dread da/d19/d25/f2e [0,4194304] 0 2024-09-12T22:11:28.363 INFO:tasks.workunit.client.0.smithi019.stdout:4/506: chown d9/d14/d31/f5c 259 1 2024-09-12T22:11:28.363 INFO:tasks.workunit.client.0.smithi019.stdout:6/568: creat d9/dc/d20/d30/d5b/fb9 x:0 0 0 2024-09-12T22:11:28.363 INFO:tasks.workunit.client.0.smithi019.stdout:0/526: chown d5/d7/d10/d26/d2a/f92 522788 1 2024-09-12T22:11:28.363 INFO:tasks.workunit.client.0.smithi019.stdout:1/542: mkdir d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8 0 2024-09-12T22:11:28.364 INFO:tasks.workunit.client.0.smithi019.stdout:9/509: dread d12/d1b/d20/d59/d5b/d9e/f39 [0,4194304] 0 2024-09-12T22:11:28.364 INFO:tasks.workunit.client.0.smithi019.stdout:2/438: write d0/d3/d11/d2e/d64/f65 [1566683,108824] 0 2024-09-12T22:11:28.364 INFO:tasks.workunit.client.0.smithi019.stdout:7/550: write da/d19/d79/f90 [204375,25470] 0 2024-09-12T22:11:28.366 INFO:tasks.workunit.client.0.smithi019.stdout:6/569: rmdir d9/dc/d20/d4b/d7a 39 2024-09-12T22:11:28.368 INFO:tasks.workunit.client.0.smithi019.stdout:0/527: link d5/d7/de/fa7 d5/d7/d2c/fa9 0 2024-09-12T22:11:28.368 INFO:tasks.workunit.client.0.smithi019.stdout:8/510: dwrite d5/d53/f89 [0,4194304] 0 2024-09-12T22:11:28.370 INFO:tasks.workunit.client.0.smithi019.stdout:6/570: write d9/dc/d20/d4b/d64/d7e/f87 [1916418,51407] 0 2024-09-12T22:11:28.371 INFO:tasks.workunit.client.0.smithi019.stdout:2/439: rename d0/d3/d11/d77/d78/d2c/d2d/f57 to d0/d3/d11/f8a 0 2024-09-12T22:11:28.371 INFO:tasks.workunit.client.0.smithi019.stdout:8/511: write d5/f15 [663561,64334] 0 2024-09-12T22:11:28.371 INFO:tasks.workunit.client.0.smithi019.stdout:6/571: chown l7 2352 1 2024-09-12T22:11:28.372 INFO:tasks.workunit.client.0.smithi019.stdout:5/553: dread d0/d24/f5b [0,4194304] 0 2024-09-12T22:11:28.372 INFO:tasks.workunit.client.0.smithi019.stdout:5/554: sync 2024-09-12T22:11:28.373 INFO:tasks.workunit.client.0.smithi019.stdout:9/510: write d12/d1b/d20/d59/d5b/d9e/f7f [4428607,125839] 0 2024-09-12T22:11:28.373 INFO:tasks.workunit.client.0.smithi019.stdout:8/512: mknod d5/d16/d19/d29/ca4 0 2024-09-12T22:11:28.373 INFO:tasks.workunit.client.0.smithi019.stdout:0/528: rename d5/d7/d10/f67 to d5/d7/d10/d26/d2a/faa 0 2024-09-12T22:11:28.373 INFO:tasks.workunit.client.0.smithi019.stdout:6/572: unlink d9/d3d/f61 0 2024-09-12T22:11:28.373 INFO:tasks.workunit.client.0.smithi019.stdout:1/543: dwrite d1/d37/f4c [0,4194304] 0 2024-09-12T22:11:28.373 INFO:tasks.workunit.client.0.smithi019.stdout:5/555: chown d0/d26/d42/f7f 306 1 2024-09-12T22:11:28.374 INFO:tasks.workunit.client.0.smithi019.stdout:9/511: truncate d12/f17 8488565 0 2024-09-12T22:11:28.374 INFO:tasks.workunit.client.0.smithi019.stdout:2/440: rename d0/d3/d11/d77/d78/d2c/d56 to d0/d3/d11/d77/d78/d2c/d56/d60/d8b 22 2024-09-12T22:11:28.374 INFO:tasks.workunit.client.0.smithi019.stdout:8/513: write d5/d16/f28 [3307659,98159] 0 2024-09-12T22:11:28.375 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:28.375 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:28.375 INFO:tasks.workunit.client.0.smithi019.stdout:3/538: dread d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:28.376 INFO:tasks.workunit.client.0.smithi019.stdout:0/529: creat d5/d7/d10/d26/d2a/d94/fab x:0 0 0 2024-09-12T22:11:28.376 INFO:tasks.workunit.client.0.smithi019.stdout:1/544: dread - d1/d2/d18/d35/d84/dc/df/d53/d66/f8b zero size 2024-09-12T22:11:28.377 INFO:tasks.workunit.client.0.smithi019.stdout:8/514: mkdir d5/d16/d19/d29/da5 0 2024-09-12T22:11:28.377 INFO:tasks.workunit.client.0.smithi019.stdout:9/512: mknod d12/d1b/d20/d29/d74/d77/cab 0 2024-09-12T22:11:28.378 INFO:tasks.workunit.client.0.smithi019.stdout:6/573: creat d9/dc/d20/fba x:0 0 0 2024-09-12T22:11:28.378 INFO:tasks.workunit.client.0.smithi019.stdout:0/530: chown d5/d7/de/l13 10879 1 2024-09-12T22:11:28.379 INFO:tasks.workunit.client.0.smithi019.stdout:9/513: mkdir d12/d1b/d20/d29/d92/dac 0 2024-09-12T22:11:28.380 INFO:tasks.workunit.client.0.smithi019.stdout:6/574: fdatasync d9/dc/f4d 0 2024-09-12T22:11:28.381 INFO:tasks.workunit.client.0.smithi019.stdout:1/545: chown d1/d2/d18/d35/d84/d6e/l71 6412646 1 2024-09-12T22:11:28.381 INFO:tasks.workunit.client.0.smithi019.stdout:0/531: readlink d5/d7/d10/l56 0 2024-09-12T22:11:28.382 INFO:tasks.workunit.client.0.smithi019.stdout:2/441: dwrite d0/f42 [0,4194304] 0 2024-09-12T22:11:28.384 INFO:tasks.workunit.client.0.smithi019.stdout:8/515: dread d5/f42 [0,4194304] 0 2024-09-12T22:11:28.384 INFO:tasks.workunit.client.0.smithi019.stdout:6/575: write d9/dc/d20/d4b/f2c [591477,17920] 0 2024-09-12T22:11:28.385 INFO:tasks.workunit.client.0.smithi019.stdout:9/514: creat d12/d1b/d20/d25/fad x:0 0 0 2024-09-12T22:11:28.385 INFO:tasks.workunit.client.0.smithi019.stdout:2/442: symlink d0/d3/d11/l8c 0 2024-09-12T22:11:28.385 INFO:tasks.workunit.client.0.smithi019.stdout:5/556: dwrite d0/d1d/d4f/f16 [0,4194304] 0 2024-09-12T22:11:28.386 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:28.387 INFO:tasks.workunit.client.0.smithi019.stdout:8/516: chown d5/c3d 10826 1 2024-09-12T22:11:28.387 INFO:tasks.workunit.client.0.smithi019.stdout:6/576: stat d9/dc/d20/d4b/d6c/cb5 0 2024-09-12T22:11:28.387 INFO:tasks.workunit.client.0.smithi019.stdout:3/539: dwrite d18/d1d/f3b [0,4194304] 0 2024-09-12T22:11:28.387 INFO:tasks.workunit.client.0.smithi019.stdout:1/546: mknod d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/cb9 0 2024-09-12T22:11:28.389 INFO:tasks.workunit.client.0.smithi019.stdout:9/515: mknod d12/d1b/d20/d29/cae 0 2024-09-12T22:11:28.389 INFO:tasks.workunit.client.0.smithi019.stdout:8/517: rmdir d5/dc/d26/d5c 39 2024-09-12T22:11:28.390 INFO:tasks.workunit.client.0.smithi019.stdout:5/557: symlink d0/d1d/d4f/d47/lb8 0 2024-09-12T22:11:28.390 INFO:tasks.workunit.client.0.smithi019.stdout:7/551: dread da/d30/d53/f64 [0,4194304] 0 2024-09-12T22:11:28.391 INFO:tasks.workunit.client.0.smithi019.stdout:2/443: mknod d0/d3/d11/d77/d78/d2c/d30/c8d 0 2024-09-12T22:11:28.391 INFO:tasks.workunit.client.0.smithi019.stdout:4/507: dread d9/d14/f38 [0,4194304] 0 2024-09-12T22:11:28.391 INFO:tasks.workunit.client.0.smithi019.stdout:1/547: mkdir d1/d2/d18/d35/d84/dc/df/d53/d66/dba 0 2024-09-12T22:11:28.392 INFO:tasks.workunit.client.0.smithi019.stdout:0/532: dwrite d5/d7/d10/f42 [0,4194304] 0 2024-09-12T22:11:28.392 INFO:tasks.workunit.client.0.smithi019.stdout:2/444: dread - d0/d3/d11/d2e/f49 zero size 2024-09-12T22:11:28.392 INFO:tasks.workunit.client.0.smithi019.stdout:9/516: chown d12/d1b/d20/d29/d74/d77/f90 5 1 2024-09-12T22:11:28.393 INFO:tasks.workunit.client.0.smithi019.stdout:4/508: chown d9/d73/la0 1173 1 2024-09-12T22:11:28.394 INFO:tasks.workunit.client.0.smithi019.stdout:7/552: creat da/d19/d25/d39/d51/fbf x:0 0 0 2024-09-12T22:11:28.394 INFO:tasks.workunit.client.0.smithi019.stdout:4/509: chown d9/d14/d57/d9b 37635321 1 2024-09-12T22:11:28.396 INFO:tasks.workunit.client.0.smithi019.stdout:5/558: getdents d0/d1d/d4f/d96 0 2024-09-12T22:11:28.396 INFO:tasks.workunit.client.0.smithi019.stdout:0/533: write d5/d7/de/d9a/f9b [399408,25314] 0 2024-09-12T22:11:28.399 INFO:tasks.workunit.client.0.smithi019.stdout:6/577: dwrite d9/d3d/d6f/f86 [0,4194304] 0 2024-09-12T22:11:28.399 INFO:tasks.workunit.client.0.smithi019.stdout:4/510: write d9/d14/d57/d5e/f7f [1627410,127906] 0 2024-09-12T22:11:28.399 INFO:tasks.workunit.client.0.smithi019.stdout:1/548: rename d1/d83/c92 to d1/d2/d18/d35/d84/dc/df/d53/cbb 0 2024-09-12T22:11:28.400 INFO:tasks.workunit.client.0.smithi019.stdout:0/534: write d5/d7/d10/d26/d2a/faa [871293,116074] 0 2024-09-12T22:11:28.401 INFO:tasks.workunit.client.0.smithi019.stdout:8/518: truncate d5/d16/d19/d29/f38 1237034 0 2024-09-12T22:11:28.401 INFO:tasks.workunit.client.0.smithi019.stdout:2/445: read d0/d31/d12/d3b/f76 [140404,109432] 0 2024-09-12T22:11:28.402 INFO:tasks.workunit.client.0.smithi019.stdout:4/511: truncate d9/d87/f98 436355 0 2024-09-12T22:11:28.402 INFO:tasks.workunit.client.0.smithi019.stdout:5/559: rename d0/d26/d6f/f8a to d0/d1d/d4f/d47/d57/d98/fb9 0 2024-09-12T22:11:28.402 INFO:tasks.workunit.client.0.smithi019.stdout:6/578: mknod d9/d6b/cbb 0 2024-09-12T22:11:28.403 INFO:tasks.workunit.client.0.smithi019.stdout:7/553: link da/d24/d28/d1c/f20 da/d24/d28/d1c/d32/d99/fc0 0 2024-09-12T22:11:28.403 INFO:tasks.workunit.client.0.smithi019.stdout:9/517: dwrite fe [4194304,4194304] 0 2024-09-12T22:11:28.404 INFO:tasks.workunit.client.0.smithi019.stdout:0/535: mkdir d5/d7/dac 0 2024-09-12T22:11:28.404 INFO:tasks.workunit.client.0.smithi019.stdout:4/512: unlink d9/d14/d33/d4e/c5a 0 2024-09-12T22:11:28.405 INFO:tasks.workunit.client.0.smithi019.stdout:7/554: write da/d24/fb7 [2510636,16107] 0 2024-09-12T22:11:28.405 INFO:tasks.workunit.client.0.smithi019.stdout:2/446: write d0/d3/d11/d2e/d34/d51/f89 [911754,24880] 0 2024-09-12T22:11:28.405 INFO:tasks.workunit.client.0.smithi019.stdout:6/579: truncate d9/dc/d20/d30/d5b/fb9 696170 0 2024-09-12T22:11:28.406 INFO:tasks.workunit.client.0.smithi019.stdout:0/536: mknod d5/d7/de/d8d/cad 0 2024-09-12T22:11:28.407 INFO:tasks.workunit.client.0.smithi019.stdout:2/447: stat d0/d3/d11/f5b 0 2024-09-12T22:11:28.408 INFO:tasks.workunit.client.0.smithi019.stdout:1/549: truncate d1/d2/d18/d35/d84/dc/df/d61/fa7 407373 0 2024-09-12T22:11:28.409 INFO:tasks.workunit.client.0.smithi019.stdout:6/580: chown d9/dc/d20/d4b/d64/d7e/c7f 56 1 2024-09-12T22:11:28.410 INFO:tasks.workunit.client.0.smithi019.stdout:2/448: fdatasync d0/d3/d11/d2e/f49 0 2024-09-12T22:11:28.410 INFO:tasks.workunit.client.0.smithi019.stdout:3/540: dread d18/f3e [0,4194304] 0 2024-09-12T22:11:28.410 INFO:tasks.workunit.client.0.smithi019.stdout:7/555: truncate da/d8f/f9a 2670386 0 2024-09-12T22:11:28.412 INFO:tasks.workunit.client.0.smithi019.stdout:5/560: dwrite d0/d1d/d4f/d96/fa2 [0,4194304] 0 2024-09-12T22:11:28.413 INFO:tasks.workunit.client.0.smithi019.stdout:4/513: dwrite d9/d58/f68 [4194304,4194304] 0 2024-09-12T22:11:28.413 INFO:tasks.workunit.client.0.smithi019.stdout:3/541: write d18/d1d/d8b/fa3 [452657,9897] 0 2024-09-12T22:11:28.414 INFO:tasks.workunit.client.0.smithi019.stdout:8/519: dread d5/d16/d19/f45 [0,4194304] 0 2024-09-12T22:11:28.417 INFO:tasks.workunit.client.0.smithi019.stdout:5/561: mkdir d0/d1d/d4f/d47/d57/dba 0 2024-09-12T22:11:28.418 INFO:tasks.workunit.client.0.smithi019.stdout:8/520: rmdir d5/dc/d26/d43/d49 39 2024-09-12T22:11:28.419 INFO:tasks.workunit.client.0.smithi019.stdout:3/542: write d18/d26/d30/d71/d86/fa1 [1281475,771] 0 2024-09-12T22:11:28.420 INFO:tasks.workunit.client.0.smithi019.stdout:0/537: dwrite d5/d7/d2c/d81/f9c [0,4194304] 0 2024-09-12T22:11:28.421 INFO:tasks.workunit.client.0.smithi019.stdout:5/562: creat d0/d26/d3a/db6/fbb x:0 0 0 2024-09-12T22:11:28.421 INFO:tasks.workunit.client.0.smithi019.stdout:2/449: dwrite d0/d3/d11/d2e/d64/f79 [0,4194304] 0 2024-09-12T22:11:28.422 INFO:tasks.workunit.client.0.smithi019.stdout:2/450: sync 2024-09-12T22:11:28.422 INFO:tasks.workunit.client.0.smithi019.stdout:8/521: creat d5/dc/d26/d43/d49/d92/fa6 x:0 0 0 2024-09-12T22:11:28.422 INFO:tasks.workunit.client.0.smithi019.stdout:7/556: dread da/d24/d28/d1c/d32/f89 [0,4194304] 0 2024-09-12T22:11:28.423 INFO:tasks.workunit.client.0.smithi019.stdout:6/581: dread d9/dc/d20/f50 [0,4194304] 0 2024-09-12T22:11:28.423 INFO:tasks.workunit.client.0.smithi019.stdout:5/563: write d0/d4e/d50/f85 [411940,10788] 0 2024-09-12T22:11:28.424 INFO:tasks.workunit.client.0.smithi019.stdout:7/557: write da/d24/fb7 [1615195,80937] 0 2024-09-12T22:11:28.424 INFO:tasks.workunit.client.0.smithi019.stdout:9/518: dread d12/d1b/d20/d25/f78 [0,4194304] 0 2024-09-12T22:11:28.424 INFO:tasks.workunit.client.0.smithi019.stdout:0/538: creat d5/fae x:0 0 0 2024-09-12T22:11:28.425 INFO:tasks.workunit.client.0.smithi019.stdout:5/564: rename d0/d24/f5b to d0/d4e/fbc 0 2024-09-12T22:11:28.425 INFO:tasks.workunit.client.0.smithi019.stdout:0/539: mkdir d5/d7/d10/d26/d8a/daf 0 2024-09-12T22:11:28.426 INFO:tasks.workunit.client.0.smithi019.stdout:2/451: link d0/d31/d12/d3b/d5c/l6e d0/d3/df/d6b/l8e 0 2024-09-12T22:11:28.427 INFO:tasks.workunit.client.0.smithi019.stdout:0/540: write d5/d7/d2c/d44/f7d [4844024,59317] 0 2024-09-12T22:11:28.428 INFO:tasks.workunit.client.0.smithi019.stdout:1/550: truncate d1/d2/d18/d35/d84/dc/df/d61/f34 1209118 0 2024-09-12T22:11:28.430 INFO:tasks.workunit.client.0.smithi019.stdout:7/558: getdents da/d24/d28/d1c/d32/d99 0 2024-09-12T22:11:28.430 INFO:tasks.workunit.client.0.smithi019.stdout:0/541: unlink d5/d7/l96 0 2024-09-12T22:11:28.430 INFO:tasks.workunit.client.0.smithi019.stdout:8/522: truncate d5/dc/f6d 799859 0 2024-09-12T22:11:28.430 INFO:tasks.workunit.client.0.smithi019.stdout:2/452: dread d0/d31/d12/d3b/f76 [0,4194304] 0 2024-09-12T22:11:28.430 INFO:tasks.workunit.client.0.smithi019.stdout:6/582: dwrite d9/dc/d20/d30/d5b/fb9 [0,4194304] 0 2024-09-12T22:11:28.430 INFO:tasks.workunit.client.0.smithi019.stdout:6/583: write d9/d3d/f3c [4501326,23316] 0 2024-09-12T22:11:28.431 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:28.430+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:28.432 INFO:tasks.workunit.client.0.smithi019.stdout:7/559: creat da/d8f/fc1 x:0 0 0 2024-09-12T22:11:28.433 INFO:tasks.workunit.client.0.smithi019.stdout:8/523: mkdir d5/dc/d8d/d96/da7 0 2024-09-12T22:11:28.433 INFO:tasks.workunit.client.0.smithi019.stdout:6/584: creat d9/dc/d20/d71/fbc x:0 0 0 2024-09-12T22:11:28.433 INFO:tasks.workunit.client.0.smithi019.stdout:2/453: symlink d0/d3/df/d7b/l8f 0 2024-09-12T22:11:28.433 INFO:tasks.workunit.client.0.smithi019.stdout:0/542: rename d5/d7/de/f31 to d5/d7/d2c/d44/d6a/d46/fb0 0 2024-09-12T22:11:28.434 INFO:tasks.workunit.client.0.smithi019.stdout:7/560: chown da/d19/d25/d39/c69 47500356 1 2024-09-12T22:11:28.435 INFO:tasks.workunit.client.0.smithi019.stdout:2/454: creat d0/d31/d12/d3b/d5c/f90 x:0 0 0 2024-09-12T22:11:28.436 INFO:tasks.workunit.client.0.smithi019.stdout:0/543: mknod d5/d7/de/da3/cb1 0 2024-09-12T22:11:28.436 INFO:tasks.workunit.client.0.smithi019.stdout:1/551: dwrite d1/d2/f7 [0,4194304] 0 2024-09-12T22:11:28.436 INFO:tasks.workunit.client.0.smithi019.stdout:7/561: mkdir da/d24/d28/d1c/d32/dc2 0 2024-09-12T22:11:28.437 INFO:tasks.workunit.client.0.smithi019.stdout:9/519: dread d12/d1b/d20/d29/d88/f89 [0,4194304] 0 2024-09-12T22:11:28.439 INFO:tasks.workunit.client.0.smithi019.stdout:2/455: mkdir d0/d3/d11/d77/d78/d91 0 2024-09-12T22:11:28.439 INFO:tasks.workunit.client.0.smithi019.stdout:7/562: mkdir da/d24/d28/d1c/d32/d5e/dc3 0 2024-09-12T22:11:28.440 INFO:tasks.workunit.client.0.smithi019.stdout:8/524: truncate d5/f42 28875 0 2024-09-12T22:11:28.441 INFO:tasks.workunit.client.0.smithi019.stdout:9/520: unlink d12/d1b/d20/d29/d56/d60/f6b 0 2024-09-12T22:11:28.442 INFO:tasks.workunit.client.0.smithi019.stdout:6/585: dwrite f4 [0,4194304] 0 2024-09-12T22:11:28.443 INFO:tasks.workunit.client.0.smithi019.stdout:4/514: dread d9/d4c/f78 [0,4194304] 0 2024-09-12T22:11:28.443 INFO:tasks.workunit.client.0.smithi019.stdout:3/543: dread d18/d26/d30/d4e/f59 [0,4194304] 0 2024-09-12T22:11:28.445 INFO:tasks.workunit.client.0.smithi019.stdout:9/521: creat d12/d1b/d20/d64/d83/faf x:0 0 0 2024-09-12T22:11:28.445 INFO:tasks.workunit.client.0.smithi019.stdout:6/586: creat d9/d3d/d6f/fbd x:0 0 0 2024-09-12T22:11:28.445 INFO:tasks.workunit.client.0.smithi019.stdout:8/525: getdents d5/d16/d19/d29/da5 0 2024-09-12T22:11:28.446 INFO:tasks.workunit.client.0.smithi019.stdout:1/552: dwrite d1/d37/f4c [0,4194304] 0 2024-09-12T22:11:28.446 INFO:tasks.workunit.client.0.smithi019.stdout:4/515: creat d9/d14/fa2 x:0 0 0 2024-09-12T22:11:28.447 INFO:tasks.workunit.client.0.smithi019.stdout:6/587: write d9/dc/d20/d4b/d6c/f70 [730395,50343] 0 2024-09-12T22:11:28.448 INFO:tasks.workunit.client.0.smithi019.stdout:4/516: dread - d9/d14/d57/d69/d6f/f9a zero size 2024-09-12T22:11:28.450 INFO:tasks.workunit.client.0.smithi019.stdout:7/563: dread da/d30/d53/f66 [0,4194304] 0 2024-09-12T22:11:28.451 INFO:tasks.workunit.client.0.smithi019.stdout:8/526: symlink d5/la8 0 2024-09-12T22:11:28.451 INFO:tasks.workunit.client.0.smithi019.stdout:6/588: creat d9/d3d/d6f/fbe x:0 0 0 2024-09-12T22:11:28.451 INFO:tasks.workunit.client.0.smithi019.stdout:1/553: getdents d1/d2/d18/d35/d84/dc/df/d53/d66/dba 0 2024-09-12T22:11:28.451 INFO:tasks.workunit.client.0.smithi019.stdout:5/565: dread d0/d26/d3a/fb5 [0,4194304] 0 2024-09-12T22:11:28.452 INFO:tasks.workunit.client.0.smithi019.stdout:7/564: symlink da/d19/d25/lc4 0 2024-09-12T22:11:28.453 INFO:tasks.workunit.client.0.smithi019.stdout:9/522: dwrite d12/d48/f7c [8388608,4194304] 0 2024-09-12T22:11:28.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/527: mknod d5/dc/d8a/d98/ca9 0 2024-09-12T22:11:28.454 INFO:tasks.workunit.client.0.smithi019.stdout:5/566: mknod d0/d4e/d50/cbd 0 2024-09-12T22:11:28.454 INFO:tasks.workunit.client.0.smithi019.stdout:6/589: rmdir d9/dc/d20/d4b/d7a 39 2024-09-12T22:11:28.456 INFO:tasks.workunit.client.0.smithi019.stdout:9/523: mkdir d12/d1b/d20/db0 0 2024-09-12T22:11:28.456 INFO:tasks.workunit.client.0.smithi019.stdout:7/565: write da/d24/fbb [121642,94814] 0 2024-09-12T22:11:28.456 INFO:tasks.workunit.client.0.smithi019.stdout:2/456: dwrite d0/d31/d12/f1b [0,4194304] 0 2024-09-12T22:11:28.457 INFO:tasks.workunit.client.0.smithi019.stdout:1/554: truncate d1/d2/d18/d35/d84/dc/df/f74 735445 0 2024-09-12T22:11:28.457 INFO:tasks.workunit.client.0.smithi019.stdout:5/567: write d0/d24/d7a/f9a [1341818,31474] 0 2024-09-12T22:11:28.458 INFO:tasks.workunit.client.0.smithi019.stdout:8/528: rename d5/dc/c75 to d5/d16/d19/d29/d7f/caa 0 2024-09-12T22:11:28.458 INFO:tasks.workunit.client.0.smithi019.stdout:2/457: mkdir d0/d31/d12/d92 0 2024-09-12T22:11:28.459 INFO:tasks.workunit.client.0.smithi019.stdout:5/568: readlink d0/d4e/lb7 0 2024-09-12T22:11:28.459 INFO:tasks.workunit.client.0.smithi019.stdout:7/566: chown da/d24/d28/c16 4802541 1 2024-09-12T22:11:28.459 INFO:tasks.workunit.client.0.smithi019.stdout:1/555: chown d1/d2/f7 7 1 2024-09-12T22:11:28.460 INFO:tasks.workunit.client.0.smithi019.stdout:8/529: write d5/d53/d66/f6f [225340,92162] 0 2024-09-12T22:11:28.460 INFO:tasks.workunit.client.0.smithi019.stdout:7/567: rmdir da/d8f 39 2024-09-12T22:11:28.460 INFO:tasks.workunit.client.0.smithi019.stdout:5/569: mknod d0/d26/cbe 0 2024-09-12T22:11:28.460 INFO:tasks.workunit.client.0.smithi019.stdout:9/524: link d12/d1b/c2c d12/d1b/d20/d29/d74/d77/d86/cb1 0 2024-09-12T22:11:28.464 INFO:tasks.workunit.client.0.smithi019.stdout:2/458: creat d0/d3/df/d7b/d44/f93 x:0 0 0 2024-09-12T22:11:28.464 INFO:tasks.workunit.client.0.smithi019.stdout:1/556: mkdir d1/d2/d18/d35/d84/d98/dbc 0 2024-09-12T22:11:28.464 INFO:tasks.workunit.client.0.smithi019.stdout:7/568: mkdir da/d30/dc5 0 2024-09-12T22:11:28.465 INFO:tasks.workunit.client.0.smithi019.stdout:1/557: creat d1/d83/fbd x:0 0 0 2024-09-12T22:11:28.465 INFO:tasks.workunit.client.0.smithi019.stdout:2/459: mkdir d0/d3/d11/d77/d82/d94 0 2024-09-12T22:11:28.465 INFO:tasks.workunit.client.0.smithi019.stdout:7/569: write da/d19/d79/f90 [928205,38322] 0 2024-09-12T22:11:28.466 INFO:tasks.workunit.client.0.smithi019.stdout:9/525: truncate d12/d1b/d20/d29/d56/f80 953064 0 2024-09-12T22:11:28.466 INFO:tasks.workunit.client.0.smithi019.stdout:2/460: chown d0/d31/d4/f22 45223535 1 2024-09-12T22:11:28.466 INFO:tasks.workunit.client.0.smithi019.stdout:6/590: dwrite d9/d3d/d4f/f5e [4194304,4194304] 0 2024-09-12T22:11:28.467 INFO:tasks.workunit.client.0.smithi019.stdout:0/544: dread d5/d7/d2c/d44/d6a/d76/f7e [0,4194304] 0 2024-09-12T22:11:28.467 INFO:tasks.workunit.client.0.smithi019.stdout:8/530: link d5/dc/c11 d5/dc/d26/d43/d49/d92/cab 0 2024-09-12T22:11:28.467 INFO:tasks.workunit.client.0.smithi019.stdout:7/570: chown da/d30/d53/db1/db5 4 1 2024-09-12T22:11:28.468 INFO:tasks.workunit.client.0.smithi019.stdout:1/558: fdatasync d1/d2/d18/d35/d84/dc/df/d2c/f63 0 2024-09-12T22:11:28.469 INFO:tasks.workunit.client.0.smithi019.stdout:5/570: dwrite d0/f39 [0,4194304] 0 2024-09-12T22:11:28.469 INFO:tasks.workunit.client.0.smithi019.stdout:3/544: dread d18/d1d/f5d [0,4194304] 0 2024-09-12T22:11:28.470 INFO:tasks.workunit.client.0.smithi019.stdout:9/526: mknod d12/d1b/d40/d52/d62/cb2 0 2024-09-12T22:11:28.472 INFO:tasks.workunit.client.0.smithi019.stdout:2/461: dread - d0/d31/d12/d3b/d5c/d71/f73 zero size 2024-09-12T22:11:28.472 INFO:tasks.workunit.client.0.smithi019.stdout:0/545: mkdir d5/d7/d2c/d44/d6a/d46/db2 0 2024-09-12T22:11:28.472 INFO:tasks.workunit.client.0.smithi019.stdout:2/462: sync 2024-09-12T22:11:28.473 INFO:tasks.workunit.client.0.smithi019.stdout:5/571: mkdir d0/dbf 0 2024-09-12T22:11:28.473 INFO:tasks.workunit.client.0.smithi019.stdout:6/591: rename d9/dc/f44 to d9/dc/d20/d4b/d64/d7d/da7/fbf 0 2024-09-12T22:11:28.473 INFO:tasks.workunit.client.0.smithi019.stdout:1/559: symlink d1/d2/d18/d35/d84/lbe 0 2024-09-12T22:11:28.474 INFO:tasks.workunit.client.0.smithi019.stdout:9/527: mknod d12/d1b/d20/d29/d56/cb3 0 2024-09-12T22:11:28.474 INFO:tasks.workunit.client.0.smithi019.stdout:2/463: creat d0/d31/d12/f95 x:0 0 0 2024-09-12T22:11:28.475 INFO:tasks.workunit.client.0.smithi019.stdout:3/545: rename d18/d58/fa8 to d18/d26/fac 0 2024-09-12T22:11:28.476 INFO:tasks.workunit.client.0.smithi019.stdout:6/592: read - d9/dc/d20/d4b/d64/d7d/fa8 zero size 2024-09-12T22:11:28.476 INFO:tasks.workunit.client.0.smithi019.stdout:5/572: creat d0/d1d/d4f/d47/d57/fc0 x:0 0 0 2024-09-12T22:11:28.477 INFO:tasks.workunit.client.0.smithi019.stdout:0/546: read d5/d7/d10/d26/f3e [4194838,111581] 0 2024-09-12T22:11:28.478 INFO:tasks.workunit.client.0.smithi019.stdout:2/464: creat d0/d3/df/d52/f96 x:0 0 0 2024-09-12T22:11:28.478 INFO:tasks.workunit.client.0.smithi019.stdout:3/546: mkdir d18/d1d/dad 0 2024-09-12T22:11:28.478 INFO:tasks.workunit.client.0.smithi019.stdout:5/573: rmdir d0/d26 39 2024-09-12T22:11:28.479 INFO:tasks.workunit.client.0.smithi019.stdout:8/531: dwrite d5/d53/f89 [0,4194304] 0 2024-09-12T22:11:28.479 INFO:tasks.workunit.client.0.smithi019.stdout:4/517: dread f4 [0,4194304] 0 2024-09-12T22:11:28.479 INFO:tasks.workunit.client.0.smithi019.stdout:7/571: dwrite da/d24/fb7 [0,4194304] 0 2024-09-12T22:11:28.480 INFO:tasks.workunit.client.0.smithi019.stdout:0/547: chown d5/d7/f5f 542 1 2024-09-12T22:11:28.481 INFO:tasks.workunit.client.0.smithi019.stdout:8/532: read - d5/d53/d66/f99 zero size 2024-09-12T22:11:28.481 INFO:tasks.workunit.client.0.smithi019.stdout:4/518: readlink d9/d14/d31/d3f/l82 0 2024-09-12T22:11:28.484 INFO:tasks.workunit.client.0.smithi019.stdout:1/560: link d1/d2/d18/d29/d51/la9 d1/d2/d18/d59/lbf 0 2024-09-12T22:11:28.485 INFO:tasks.workunit.client.0.smithi019.stdout:0/548: rmdir d5/d7/d2c 39 2024-09-12T22:11:28.485 INFO:tasks.workunit.client.0.smithi019.stdout:8/533: truncate d5/dc/d26/f3a 4399698 0 2024-09-12T22:11:28.486 INFO:tasks.workunit.client.0.smithi019.stdout:6/593: dwrite d9/dc/d20/d71/f88 [0,4194304] 0 2024-09-12T22:11:28.486 INFO:tasks.workunit.client.0.smithi019.stdout:8/534: stat d5/dc 0 2024-09-12T22:11:28.487 INFO:tasks.workunit.client.0.smithi019.stdout:5/574: rename d0/c23 to d0/d24/cc1 0 2024-09-12T22:11:28.488 INFO:tasks.workunit.client.0.smithi019.stdout:2/465: dwrite d0/d3/d11/d2e/d64/f79 [4194304,4194304] 0 2024-09-12T22:11:28.489 INFO:tasks.workunit.client.0.smithi019.stdout:1/561: chown d1/d2/d18/d35/d84/dc/df/fb7 14470 1 2024-09-12T22:11:28.489 INFO:tasks.workunit.client.0.smithi019.stdout:0/549: rename d5/lf to d5/d7/d2c/d81/lb3 0 2024-09-12T22:11:28.489 INFO:tasks.workunit.client.0.smithi019.stdout:5/575: chown d0/d1d/d4f/d47/d57/fc0 22 1 2024-09-12T22:11:28.490 INFO:tasks.workunit.client.0.smithi019.stdout:4/519: link d9/db/d2b/d6a/d7d/l86 d9/d73/la3 0 2024-09-12T22:11:28.490 INFO:tasks.workunit.client.0.smithi019.stdout:6/594: mknod d9/cc0 0 2024-09-12T22:11:28.492 INFO:tasks.workunit.client.0.smithi019.stdout:7/572: dwrite da/d24/d28/d1c/f23 [4194304,4194304] 0 2024-09-12T22:11:28.492 INFO:tasks.workunit.client.0.smithi019.stdout:1/562: dread - d1/d2/d18/d29/d51/fb0 zero size 2024-09-12T22:11:28.492 INFO:tasks.workunit.client.0.smithi019.stdout:3/547: dwrite d18/d1d/d35/f8d [0,4194304] 0 2024-09-12T22:11:28.492 INFO:tasks.workunit.client.0.smithi019.stdout:4/520: chown d9/d17/da1 86013210 1 2024-09-12T22:11:28.492 INFO:tasks.workunit.client.0.smithi019.stdout:2/466: write d0/d3/df/f2a [184142,107182] 0 2024-09-12T22:11:28.493 INFO:tasks.workunit.client.0.smithi019.stdout:8/535: getdents d5/dc/d26/d43/d49 0 2024-09-12T22:11:28.493 INFO:tasks.workunit.client.0.smithi019.stdout:0/550: write d5/d7/d10/f55 [691714,18537] 0 2024-09-12T22:11:28.494 INFO:tasks.workunit.client.0.smithi019.stdout:6/595: write d9/dc/d20/d4b/f28 [105837,31508] 0 2024-09-12T22:11:28.495 INFO:tasks.workunit.client.0.smithi019.stdout:5/576: rename d0/d26/c2f to d0/cc2 0 2024-09-12T22:11:28.495 INFO:tasks.workunit.client.0.smithi019.stdout:3/548: chown d18/d26/d30/d4e/c55 153295955 1 2024-09-12T22:11:28.495 INFO:tasks.workunit.client.0.smithi019.stdout:5/577: stat d0/d1d/d6d/lad 0 2024-09-12T22:11:28.496 INFO:tasks.workunit.client.0.smithi019.stdout:8/536: creat d5/d16/d19/d29/fac x:0 0 0 2024-09-12T22:11:28.496 INFO:tasks.workunit.client.0.smithi019.stdout:4/521: truncate d9/db/d2b/f37 4815090 0 2024-09-12T22:11:28.496 INFO:tasks.workunit.client.0.smithi019.stdout:7/573: link da/d19/d25/d39/c80 da/d19/d25/cc6 0 2024-09-12T22:11:28.496 INFO:tasks.workunit.client.0.smithi019.stdout:6/596: link d9/fa d9/dc/d20/d4b/d64/d7e/fc1 0 2024-09-12T22:11:28.496 INFO:tasks.workunit.client.0.smithi019.stdout:2/467: write d0/d3/d11/d77/d78/d2c/d30/d32/f4a [1133734,19196] 0 2024-09-12T22:11:28.497 INFO:tasks.workunit.client.0.smithi019.stdout:8/537: write d5/dc/d26/f36 [4029982,12189] 0 2024-09-12T22:11:28.497 INFO:tasks.workunit.client.0.smithi019.stdout:5/578: mkdir d0/d26/d5f/dc3 0 2024-09-12T22:11:28.497 INFO:tasks.workunit.client.0.smithi019.stdout:4/522: truncate d9/d4c/d9c/f9e 687301 0 2024-09-12T22:11:28.498 INFO:tasks.workunit.client.0.smithi019.stdout:2/468: creat d0/d3/d11/d2e/d70/f97 x:0 0 0 2024-09-12T22:11:28.499 INFO:tasks.workunit.client.0.smithi019.stdout:0/551: write d5/d7/d2c/fa9 [4685017,16758] 0 2024-09-12T22:11:28.499 INFO:tasks.workunit.client.0.smithi019.stdout:8/538: mknod d5/d16/d19/d29/cad 0 2024-09-12T22:11:28.499 INFO:tasks.workunit.client.0.smithi019.stdout:6/597: creat d9/dc/d20/d4b/d7a/fc2 x:0 0 0 2024-09-12T22:11:28.499 INFO:tasks.workunit.client.0.smithi019.stdout:4/523: symlink d9/la4 0 2024-09-12T22:11:28.500 INFO:tasks.workunit.client.0.smithi019.stdout:8/539: chown d5/d16/f28 22792 1 2024-09-12T22:11:28.501 INFO:tasks.workunit.client.0.smithi019.stdout:0/552: chown d5/d7/d10/d26/d2a/f92 31093 1 2024-09-12T22:11:28.502 INFO:tasks.workunit.client.0.smithi019.stdout:2/469: write d0/d3/d11/d77/d78/d2c/f5a [2021834,8295] 0 2024-09-12T22:11:28.504 INFO:tasks.workunit.client.0.smithi019.stdout:0/553: mknod d5/d88/cb4 0 2024-09-12T22:11:28.504 INFO:tasks.workunit.client.0.smithi019.stdout:3/549: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:28.506 INFO:tasks.workunit.client.0.smithi019.stdout:2/470: chown d0/d3/d11/d77/d78/f7c 5564 1 2024-09-12T22:11:28.506 INFO:tasks.workunit.client.0.smithi019.stdout:7/574: truncate da/d24/d28/d1c/d32/f89 3079700 0 2024-09-12T22:11:28.507 INFO:tasks.workunit.client.0.smithi019.stdout:8/540: write d5/f23 [1519695,130580] 0 2024-09-12T22:11:28.509 INFO:tasks.workunit.client.0.smithi019.stdout:3/550: write d18/d26/d30/d4e/f99 [3472782,130941] 0 2024-09-12T22:11:28.509 INFO:tasks.workunit.client.0.smithi019.stdout:5/579: dwrite d0/d1d/d3d/f53 [0,4194304] 0 2024-09-12T22:11:28.510 INFO:tasks.workunit.client.0.smithi019.stdout:0/554: mkdir d5/d7/db5 0 2024-09-12T22:11:28.510 INFO:tasks.workunit.client.0.smithi019.stdout:7/575: readlink da/d24/l81 0 2024-09-12T22:11:28.510 INFO:tasks.workunit.client.0.smithi019.stdout:0/555: sync 2024-09-12T22:11:28.511 INFO:tasks.workunit.client.0.smithi019.stdout:9/528: dread d12/f1f [0,4194304] 0 2024-09-12T22:11:28.511 INFO:tasks.workunit.client.0.smithi019.stdout:9/529: sync 2024-09-12T22:11:28.511 INFO:tasks.workunit.client.0.smithi019.stdout:4/524: dwrite d9/d58/f68 [0,4194304] 0 2024-09-12T22:11:28.513 INFO:tasks.workunit.client.0.smithi019.stdout:8/541: chown d5/d16/d19/d29/d7f/caa 170528021 1 2024-09-12T22:11:28.513 INFO:tasks.workunit.client.0.smithi019.stdout:6/598: dwrite d9/dc/d20/d4b/d7a/f80 [0,4194304] 0 2024-09-12T22:11:28.513 INFO:tasks.workunit.client.0.smithi019.stdout:9/530: dread - d12/d1b/d20/d25/f5d zero size 2024-09-12T22:11:28.513 INFO:tasks.workunit.client.0.smithi019.stdout:7/576: chown da/d30/d9c/la8 333 1 2024-09-12T22:11:28.516 INFO:tasks.workunit.client.0.smithi019.stdout:7/577: stat da/d30/dc5 0 2024-09-12T22:11:28.516 INFO:tasks.workunit.client.0.smithi019.stdout:3/551: mkdir d18/d26/d30/d4e/d9a/dae 0 2024-09-12T22:11:28.516 INFO:tasks.workunit.client.0.smithi019.stdout:5/580: rename d0/d26/d3a/f59 to d0/d24/d58/fc4 0 2024-09-12T22:11:28.516 INFO:tasks.workunit.client.0.smithi019.stdout:9/531: write f11 [1779944,58022] 0 2024-09-12T22:11:28.517 INFO:tasks.workunit.client.0.smithi019.stdout:9/532: fsync d12/f1f 0 2024-09-12T22:11:28.517 INFO:tasks.workunit.client.0.smithi019.stdout:4/525: creat d9/d14/fa5 x:0 0 0 2024-09-12T22:11:28.517 INFO:tasks.workunit.client.0.smithi019.stdout:8/542: rename d5/d16/d19/c2f to d5/d16/cae 0 2024-09-12T22:11:28.518 INFO:tasks.workunit.client.0.smithi019.stdout:5/581: symlink d0/d26/d3a/db6/lc5 0 2024-09-12T22:11:28.519 INFO:tasks.workunit.client.0.smithi019.stdout:6/599: rename d9/dc/d20/d4b/d64/d7d/fa8 to d9/dc/d20/d4b/d64/d7e/fc3 0 2024-09-12T22:11:28.519 INFO:tasks.workunit.client.0.smithi019.stdout:2/471: dwrite d0/d3/d11/d2e/d64/f6d [0,4194304] 0 2024-09-12T22:11:28.519 INFO:tasks.workunit.client.0.smithi019.stdout:5/582: write d0/fa6 [906000,40203] 0 2024-09-12T22:11:28.522 INFO:tasks.workunit.client.0.smithi019.stdout:6/600: creat d9/d3d/d4f/d8d/fc4 x:0 0 0 2024-09-12T22:11:28.522 INFO:tasks.workunit.client.0.smithi019.stdout:2/472: mknod d0/d3/d11/d77/d78/d2c/d56/d60/c98 0 2024-09-12T22:11:28.523 INFO:tasks.workunit.client.0.smithi019.stdout:5/583: link d0/d1d/d6d/f94 d0/d1d/d3d/fc6 0 2024-09-12T22:11:28.525 INFO:tasks.workunit.client.0.smithi019.stdout:2/473: readlink d0/d31/d12/d3b/l5d 0 2024-09-12T22:11:28.525 INFO:tasks.workunit.client.0.smithi019.stdout:5/584: stat d0/d26/d42/faf 0 2024-09-12T22:11:28.525 INFO:tasks.workunit.client.0.smithi019.stdout:9/533: dwrite d12/d1b/d40/f5e [0,4194304] 0 2024-09-12T22:11:28.525 INFO:tasks.workunit.client.0.smithi019.stdout:6/601: creat d9/dc/d20/d4b/d64/fc5 x:0 0 0 2024-09-12T22:11:28.525 INFO:tasks.workunit.client.0.smithi019.stdout:9/534: readlink d12/d1b/l66 0 2024-09-12T22:11:28.525 INFO:tasks.workunit.client.0.smithi019.stdout:5/585: stat d0/d24/l93 0 2024-09-12T22:11:28.525 INFO:tasks.workunit.client.0.smithi019.stdout:2/474: stat d0/d3/df/d52/f96 0 2024-09-12T22:11:28.526 INFO:tasks.workunit.client.0.smithi019.stdout:6/602: mknod d9/cc6 0 2024-09-12T22:11:28.526 INFO:tasks.workunit.client.0.smithi019.stdout:5/586: rename d0/d1d/d4f/d96/fa2 to d0/d4e/fc7 0 2024-09-12T22:11:28.526 INFO:tasks.workunit.client.0.smithi019.stdout:2/475: mknod d0/d3/df/d7b/d80/c99 0 2024-09-12T22:11:28.529 INFO:tasks.workunit.client.0.smithi019.stdout:2/476: read - d0/d3/df/d7b/d44/f93 zero size 2024-09-12T22:11:28.529 INFO:tasks.workunit.client.0.smithi019.stdout:6/603: read d9/dc/f15 [1248297,67163] 0 2024-09-12T22:11:28.530 INFO:tasks.workunit.client.0.smithi019.stdout:1/563: dread d1/d2/d18/d59/f75 [0,4194304] 0 2024-09-12T22:11:28.532 INFO:tasks.workunit.client.0.smithi019.stdout:9/535: truncate d12/d1b/d20/d59/d5b/d9e/f7f 4267068 0 2024-09-12T22:11:28.532 INFO:tasks.workunit.client.0.smithi019.stdout:2/477: mkdir d0/d3/df/d7b/d80/d9a 0 2024-09-12T22:11:28.532 INFO:tasks.workunit.client.0.smithi019.stdout:6/604: chown d9/dc/d20/d4b/d64/d7d/da7/fbf 137 1 2024-09-12T22:11:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:11:28.533 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:28.531+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:28.534 INFO:tasks.workunit.client.0.smithi019.stdout:0/556: dread d5/d7/d2c/d44/f74 [0,4194304] 0 2024-09-12T22:11:28.535 INFO:tasks.workunit.client.0.smithi019.stdout:5/587: dwrite d0/d1d/d4f/d96/fa9 [0,4194304] 0 2024-09-12T22:11:28.536 INFO:tasks.workunit.client.0.smithi019.stdout:2/478: write d0/d3/df/d7b/d44/f93 [877561,118265] 0 2024-09-12T22:11:28.537 INFO:tasks.workunit.client.0.smithi019.stdout:6/605: mknod d9/cc7 0 2024-09-12T22:11:28.537 INFO:tasks.workunit.client.0.smithi019.stdout:0/557: getdents d5/d7/db5 0 2024-09-12T22:11:28.537 INFO:tasks.workunit.client.0.smithi019.stdout:5/588: fdatasync d0/d1d/d4f/f1a 0 2024-09-12T22:11:28.538 INFO:tasks.workunit.client.0.smithi019.stdout:6/606: write d9/d3d/d6f/f5c [1067749,95659] 0 2024-09-12T22:11:28.539 INFO:tasks.workunit.client.0.smithi019.stdout:2/479: readlink d0/d3/d11/d77/d78/d2c/d2d/l72 0 2024-09-12T22:11:28.539 INFO:tasks.workunit.client.0.smithi019.stdout:5/589: symlink d0/d1d/d4f/lc8 0 2024-09-12T22:11:28.541 INFO:tasks.workunit.client.0.smithi019.stdout:2/480: symlink d0/d3/d11/l9b 0 2024-09-12T22:11:28.541 INFO:tasks.workunit.client.0.smithi019.stdout:5/590: creat d0/d1d/d4f/d96/fc9 x:0 0 0 2024-09-12T22:11:28.542 INFO:tasks.workunit.client.0.smithi019.stdout:6/607: link d9/d3d/d6f/ca5 d9/dc/d20/cc8 0 2024-09-12T22:11:28.543 INFO:tasks.workunit.client.0.smithi019.stdout:2/481: symlink d0/d3/d11/d2e/d34/d51/l9c 0 2024-09-12T22:11:28.543 INFO:tasks.workunit.client.0.smithi019.stdout:5/591: rename d0/d26/d3a/db6 to d0/d1d/d6d/dca 0 2024-09-12T22:11:28.544 INFO:tasks.workunit.client.0.smithi019.stdout:0/558: dwrite d5/d7/de/f3c [0,4194304] 0 2024-09-12T22:11:28.545 INFO:tasks.workunit.client.0.smithi019.stdout:6/608: unlink d9/dc/d20/d4b/d6c/d8c/l97 0 2024-09-12T22:11:28.545 INFO:tasks.workunit.client.0.smithi019.stdout:0/559: mkdir d5/d7/dac/db6 0 2024-09-12T22:11:28.546 INFO:tasks.workunit.client.0.smithi019.stdout:6/609: creat d9/d3d/d4f/d59/fc9 x:0 0 0 2024-09-12T22:11:28.548 INFO:tasks.workunit.client.0.smithi019.stdout:6/610: mknod d9/dc/d20/d4b/cca 0 2024-09-12T22:11:28.548 INFO:tasks.workunit.client.0.smithi019.stdout:4/526: dread d9/f3b [0,4194304] 0 2024-09-12T22:11:28.552 INFO:tasks.workunit.client.0.smithi019.stdout:9/536: truncate d12/d1b/d20/d59/d5b/d9e/f7f 5080315 0 2024-09-12T22:11:28.552 INFO:tasks.workunit.client.0.smithi019.stdout:4/527: symlink d9/d6c/la6 0 2024-09-12T22:11:28.553 INFO:tasks.workunit.client.0.smithi019.stdout:2/482: dwrite d0/d3/d11/d77/d78/d2c/d30/f87 [0,4194304] 0 2024-09-12T22:11:28.555 INFO:tasks.workunit.client.0.smithi019.stdout:0/560: dwrite d5/d7/d2c/d44/d6a/d76/fa1 [0,4194304] 0 2024-09-12T22:11:28.556 INFO:tasks.workunit.client.0.smithi019.stdout:4/528: write d9/d14/d57/f7c [4870519,50837] 0 2024-09-12T22:11:28.558 INFO:tasks.workunit.client.0.smithi019.stdout:7/578: dread da/d24/d28/d1c/d32/f3c [0,4194304] 0 2024-09-12T22:11:28.559 INFO:tasks.workunit.client.0.smithi019.stdout:5/592: dwrite d0/d4e/fbc [0,4194304] 0 2024-09-12T22:11:28.560 INFO:tasks.workunit.client.0.smithi019.stdout:4/529: mkdir d9/d4c/d76/da7 0 2024-09-12T22:11:28.561 INFO:tasks.workunit.client.0.smithi019.stdout:0/561: mkdir d5/d7/d2c/d44/db7 0 2024-09-12T22:11:28.563 INFO:tasks.workunit.client.0.smithi019.stdout:2/483: rename d0/d3/d11/d77/d78/d2c/c68 to d0/d3/d11/d2e/d34/c9d 0 2024-09-12T22:11:28.563 INFO:tasks.workunit.client.0.smithi019.stdout:6/611: dwrite d9/dc/d20/f14 [0,4194304] 0 2024-09-12T22:11:28.563 INFO:tasks.workunit.client.0.smithi019.stdout:4/530: chown d9/d14/d33/d4e 57710256 1 2024-09-12T22:11:28.563 INFO:tasks.workunit.client.0.smithi019.stdout:7/579: dread - da/d19/d25/d39/d51/fbf zero size 2024-09-12T22:11:28.564 INFO:tasks.workunit.client.0.smithi019.stdout:3/552: dread d18/d1d/f3f [0,4194304] 0 2024-09-12T22:11:28.564 INFO:tasks.workunit.client.0.smithi019.stdout:0/562: creat d5/d7/d2c/d44/d6a/d76/fb8 x:0 0 0 2024-09-12T22:11:28.565 INFO:tasks.workunit.client.0.smithi019.stdout:8/543: dread d5/f15 [8388608,4194304] 0 2024-09-12T22:11:28.568 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:28.568 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:28.568 INFO:tasks.workunit.client.0.smithi019.stdout:9/537: dwrite d12/d1b/d20/d29/f50 [0,4194304] 0 2024-09-12T22:11:28.570 INFO:tasks.workunit.client.0.smithi019.stdout:0/563: truncate d5/fae 1019611 0 2024-09-12T22:11:28.570 INFO:tasks.workunit.client.0.smithi019.stdout:4/531: mknod d9/d73/d8f/d93/ca8 0 2024-09-12T22:11:28.570 INFO:tasks.workunit.client.0.smithi019.stdout:9/538: chown d12/d1b/d20/d25/fad 2 1 2024-09-12T22:11:28.570 INFO:tasks.workunit.client.0.smithi019.stdout:1/564: dread d1/fb1 [0,4194304] 0 2024-09-12T22:11:28.571 INFO:tasks.workunit.client.0.smithi019.stdout:0/564: fsync d5/d7/d2c/d44/f45 0 2024-09-12T22:11:28.573 INFO:tasks.workunit.client.0.smithi019.stdout:2/484: dwrite d0/d3/d11/d77/d78/d2c/d30/d32/f81 [0,4194304] 0 2024-09-12T22:11:28.578 INFO:tasks.workunit.client.0.smithi019.stdout:7/580: unlink da/d24/c7d 0 2024-09-12T22:11:28.578 INFO:tasks.workunit.client.0.smithi019.stdout:8/544: mknod d5/dc/d26/d43/d49/d7a/caf 0 2024-09-12T22:11:28.578 INFO:tasks.workunit.client.0.smithi019.stdout:4/532: symlink d9/d4c/d76/la9 0 2024-09-12T22:11:28.578 INFO:tasks.workunit.client.0.smithi019.stdout:3/553: chown d18/d1d/d35/c7a 47 1 2024-09-12T22:11:28.578 INFO:tasks.workunit.client.0.smithi019.stdout:2/485: mknod d0/d3/df/d7b/d44/c9e 0 2024-09-12T22:11:28.578 INFO:tasks.workunit.client.0.smithi019.stdout:6/612: link d9/dc/d20/d30/l45 d9/dc/d20/d4b/d64/d7d/da7/lcb 0 2024-09-12T22:11:28.578 INFO:tasks.workunit.client.0.smithi019.stdout:0/565: rename d5/d7/d2c/d81/lb3 to d5/d7/d10/lb9 0 2024-09-12T22:11:28.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:28.580 INFO:tasks.workunit.client.0.smithi019.stdout:3/554: readlink d18/d26/d30/d4e/d80/la2 0 2024-09-12T22:11:28.580 INFO:tasks.workunit.client.0.smithi019.stdout:7/581: unlink da/d24/d28/d1c/d32/d5e/c97 0 2024-09-12T22:11:28.580 INFO:tasks.workunit.client.0.smithi019.stdout:6/613: dread - d9/d3d/d4f/d8d/fc4 zero size 2024-09-12T22:11:28.580 INFO:tasks.workunit.client.0.smithi019.stdout:2/486: write d0/d3/d11/f10 [429341,110323] 0 2024-09-12T22:11:28.580 INFO:tasks.workunit.client.0.smithi019.stdout:7/582: symlink da/d19/d25/d39/lc7 0 2024-09-12T22:11:28.580 INFO:tasks.workunit.client.0.smithi019.stdout:3/555: symlink d18/d26/d30/laf 0 2024-09-12T22:11:28.581 INFO:tasks.workunit.client.0.smithi019.stdout:3/556: write d18/f34 [2830245,15062] 0 2024-09-12T22:11:28.581 INFO:tasks.workunit.client.0.smithi019.stdout:1/565: rename d1/d2/d18/d35/dad to d1/d2/d18/d35/d84/dc/df/d53/dc0 0 2024-09-12T22:11:28.581 INFO:tasks.workunit.client.0.smithi019.stdout:0/566: link d5/f41 d5/d7/d2c/d81/fba 0 2024-09-12T22:11:28.581 INFO:tasks.workunit.client.0.smithi019.stdout:6/614: mknod d9/dc/d20/d4b/d64/d7e/ccc 0 2024-09-12T22:11:28.582 INFO:tasks.workunit.client.0.smithi019.stdout:2/487: link d0/d3/df/f2a d0/d31/d12/d15/f9f 0 2024-09-12T22:11:28.582 INFO:tasks.workunit.client.0.smithi019.stdout:6/615: write d9/d3d/d6f/f86 [4628800,70187] 0 2024-09-12T22:11:28.582 INFO:tasks.workunit.client.0.smithi019.stdout:3/557: read d18/d1d/f2b [816854,42502] 0 2024-09-12T22:11:28.583 INFO:tasks.workunit.client.0.smithi019.stdout:2/488: creat d0/d31/d12/d15/fa0 x:0 0 0 2024-09-12T22:11:28.583 INFO:tasks.workunit.client.0.smithi019.stdout:1/566: creat d1/d2/d18/d35/d84/d98/dbc/fc1 x:0 0 0 2024-09-12T22:11:28.585 INFO:tasks.workunit.client.0.smithi019.stdout:5/593: dread d0/d4e/f5a [0,4194304] 0 2024-09-12T22:11:28.586 INFO:tasks.workunit.client.0.smithi019.stdout:6/616: creat d9/dc/d20/d4b/d6c/d8c/fcd x:0 0 0 2024-09-12T22:11:28.586 INFO:tasks.workunit.client.0.smithi019.stdout:3/558: rename d18/f7e to d18/d26/fb0 0 2024-09-12T22:11:28.586 INFO:tasks.workunit.client.0.smithi019.stdout:0/567: dread d5/d7/f91 [0,4194304] 0 2024-09-12T22:11:28.586 INFO:tasks.workunit.client.0.smithi019.stdout:7/583: dwrite da/d24/fbb [0,4194304] 0 2024-09-12T22:11:28.586 INFO:tasks.workunit.client.0.smithi019.stdout:1/567: creat d1/d2/d18/d35/d84/d98/fc2 x:0 0 0 2024-09-12T22:11:28.587 INFO:tasks.workunit.client.0.smithi019.stdout:0/568: write d5/d7/f12 [1415322,50651] 0 2024-09-12T22:11:28.588 INFO:tasks.workunit.client.0.smithi019.stdout:5/594: rename d0/d26/d6f/c81 to d0/d26/d42/ccb 0 2024-09-12T22:11:28.589 INFO:tasks.workunit.client.0.smithi019.stdout:1/568: truncate d1/d2/d18/d35/d84/dc/df/d53/d55/f6b 1239477 0 2024-09-12T22:11:28.591 INFO:tasks.workunit.client.0.smithi019.stdout:6/617: read d9/d3d/d6f/f67 [1547082,9895] 0 2024-09-12T22:11:28.594 INFO:tasks.workunit.client.0.smithi019.stdout:5/595: dwrite d0/d1d/d3d/f69 [0,4194304] 0 2024-09-12T22:11:28.599 INFO:tasks.workunit.client.0.smithi019.stdout:8/545: dread d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:28.600 INFO:tasks.workunit.client.0.smithi019.stdout:2/489: getdents d0/d3 0 2024-09-12T22:11:28.601 INFO:tasks.workunit.client.0.smithi019.stdout:1/569: unlink d1/d2/d18/d35/d84/dc/df/d53/c90 0 2024-09-12T22:11:28.602 INFO:tasks.workunit.client.0.smithi019.stdout:5/596: rename d0/d26/d5f/fa7 to d0/d4e/d50/fcc 0 2024-09-12T22:11:28.603 INFO:tasks.workunit.client.0.smithi019.stdout:8/546: creat d5/dc/d8d/fb0 x:0 0 0 2024-09-12T22:11:28.603 INFO:tasks.workunit.client.0.smithi019.stdout:5/597: symlink d0/d24/lcd 0 2024-09-12T22:11:28.604 INFO:tasks.workunit.client.0.smithi019.stdout:1/570: symlink d1/d2/d18/d35/d84/dc/df/d2c/d5d/lc3 0 2024-09-12T22:11:28.605 INFO:tasks.workunit.client.0.smithi019.stdout:6/618: dwrite d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:28.606 INFO:tasks.workunit.client.0.smithi019.stdout:8/547: getdents d5/d16 0 2024-09-12T22:11:28.606 INFO:tasks.workunit.client.0.smithi019.stdout:0/569: dread d5/d7/d10/d26/d2a/f5d [0,4194304] 0 2024-09-12T22:11:28.608 INFO:tasks.workunit.client.0.smithi019.stdout:1/571: write d1/d2/d18/d59/f75 [1604903,8958] 0 2024-09-12T22:11:28.608 INFO:tasks.workunit.client.0.smithi019.stdout:2/490: dwrite d0/d3/d11/d77/d78/d2c/d30/d32/f4a [0,4194304] 0 2024-09-12T22:11:28.609 INFO:tasks.workunit.client.0.smithi019.stdout:2/491: dread - d0/d31/d12/d15/fa0 zero size 2024-09-12T22:11:28.610 INFO:tasks.workunit.client.0.smithi019.stdout:6/619: truncate d9/d3d/f2f 1089633 0 2024-09-12T22:11:28.610 INFO:tasks.workunit.client.0.smithi019.stdout:1/572: truncate d1/d2/d18/d35/d84/dc/f50 1475 0 2024-09-12T22:11:28.611 INFO:tasks.workunit.client.0.smithi019.stdout:3/559: truncate d18/d1d/f3f 502112 0 2024-09-12T22:11:28.612 INFO:tasks.workunit.client.0.smithi019.stdout:0/570: chown d5/d7/d10/d26/c9f 1330936157 1 2024-09-12T22:11:28.612 INFO:tasks.workunit.client.0.smithi019.stdout:8/548: symlink d5/dc/d26/d43/lb1 0 2024-09-12T22:11:28.612 INFO:tasks.workunit.client.0.smithi019.stdout:3/560: symlink d18/d1d/d8b/lb1 0 2024-09-12T22:11:28.612 INFO:tasks.workunit.client.0.smithi019.stdout:2/492: rmdir d0/d31/d12/d3b/d5c 39 2024-09-12T22:11:28.613 INFO:tasks.workunit.client.0.smithi019.stdout:6/620: creat d9/dc/d20/d4b/d64/d7e/fce x:0 0 0 2024-09-12T22:11:28.613 INFO:tasks.workunit.client.0.smithi019.stdout:1/573: truncate d1/d2/d18/d29/d51/f5c 4903951 0 2024-09-12T22:11:28.613 INFO:tasks.workunit.client.0.smithi019.stdout:1/574: readlink d1/d2/d18/d35/d84/l15 0 2024-09-12T22:11:28.613 INFO:tasks.workunit.client.0.smithi019.stdout:1/575: chown d1/d83/lac 19092413 1 2024-09-12T22:11:28.614 INFO:tasks.workunit.client.0.smithi019.stdout:2/493: unlink d0/d3/d11/d77/d78/d2c/d30/f87 0 2024-09-12T22:11:28.614 INFO:tasks.workunit.client.0.smithi019.stdout:8/549: rename d5/d16/d19/d29/ca4 to d5/dc/d26/d43/cb2 0 2024-09-12T22:11:28.614 INFO:tasks.workunit.client.0.smithi019.stdout:2/494: creat d0/d3/df/d7b/fa1 x:0 0 0 2024-09-12T22:11:28.615 INFO:tasks.workunit.client.0.smithi019.stdout:3/561: getdents d18/d1d/d8b 0 2024-09-12T22:11:28.615 INFO:tasks.workunit.client.0.smithi019.stdout:0/571: dread d5/d7/de/f7f [0,4194304] 0 2024-09-12T22:11:28.615 INFO:tasks.workunit.client.0.smithi019.stdout:8/550: rename d5/la8 to d5/dc/d8d/d96/da7/lb3 0 2024-09-12T22:11:28.616 INFO:tasks.workunit.client.0.smithi019.stdout:3/562: mknod d18/d1d/d35/d9c/cb2 0 2024-09-12T22:11:28.616 INFO:tasks.workunit.client.0.smithi019.stdout:8/551: readlink d5/dc/d17/l35 0 2024-09-12T22:11:28.616 INFO:tasks.workunit.client.0.smithi019.stdout:8/552: stat d5/l2d 0 2024-09-12T22:11:28.617 INFO:tasks.workunit.client.0.smithi019.stdout:3/563: chown d18/d26/c3a 0 1 2024-09-12T22:11:28.620 INFO:tasks.workunit.client.0.smithi019.stdout:1/576: truncate d1/d2/d18/d35/d84/dc/df/d53/d55/f6b 562312 0 2024-09-12T22:11:28.620 INFO:tasks.workunit.client.0.smithi019.stdout:8/553: truncate d5/dc/d26/d43/f4c 1119594 0 2024-09-12T22:11:28.621 INFO:tasks.workunit.client.0.smithi019.stdout:8/554: symlink d5/d53/d66/d69/lb4 0 2024-09-12T22:11:28.622 INFO:tasks.workunit.client.0.smithi019.stdout:3/564: dwrite d18/d26/f4b [4194304,4194304] 0 2024-09-12T22:11:28.627 INFO:tasks.workunit.client.0.smithi019.stdout:3/565: dread d18/d26/d30/d4e/f59 [0,4194304] 0 2024-09-12T22:11:28.628 INFO:tasks.workunit.client.0.smithi019.stdout:5/598: dread d0/d26/d3a/fa4 [0,4194304] 0 2024-09-12T22:11:28.630 INFO:tasks.workunit.client.0.smithi019.stdout:5/599: chown d0/c21 1558307907 1 2024-09-12T22:11:28.630 INFO:tasks.workunit.client.0.smithi019.stdout:1/577: dwrite d1/d2/d18/d35/d84/dc/df/d2c/f63 [0,4194304] 0 2024-09-12T22:11:28.630 INFO:tasks.workunit.client.0.smithi019.stdout:2/495: dread d0/d31/d4/f22 [0,4194304] 0 2024-09-12T22:11:28.630 INFO:tasks.workunit.client.0.smithi019.stdout:8/555: dwrite d5/d16/d19/f5b [0,4194304] 0 2024-09-12T22:11:28.631 INFO:tasks.workunit.client.0.smithi019.stdout:1/578: rmdir d1/d2/d18 39 2024-09-12T22:11:28.631 INFO:tasks.workunit.client.0.smithi019.stdout:9/539: sync 2024-09-12T22:11:28.631 INFO:tasks.workunit.client.0.smithi019.stdout:6/621: sync 2024-09-12T22:11:28.631 INFO:tasks.workunit.client.0.smithi019.stdout:8/556: fsync d5/f42 0 2024-09-12T22:11:28.632 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:28.631+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:28.633 INFO:tasks.workunit.client.0.smithi019.stdout:6/622: write d9/dc/d20/d30/d5b/fb9 [172312,49420] 0 2024-09-12T22:11:28.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/557: creat d5/d53/d66/fb5 x:0 0 0 2024-09-12T22:11:28.633 INFO:tasks.workunit.client.0.smithi019.stdout:9/540: mkdir d12/d1b/d20/d64/d83/db4 0 2024-09-12T22:11:28.633 INFO:tasks.workunit.client.0.smithi019.stdout:5/600: write d0/d1d/d4f/d47/f70 [961659,34136] 0 2024-09-12T22:11:28.633 INFO:tasks.workunit.client.0.smithi019.stdout:2/496: getdents d0/d3/d11/d77/d78/d2c/d56/d60 0 2024-09-12T22:11:28.634 INFO:tasks.workunit.client.0.smithi019.stdout:9/541: write d12/d1b/f42 [529928,67759] 0 2024-09-12T22:11:28.634 INFO:tasks.workunit.client.0.smithi019.stdout:8/558: unlink d5/d16/d19/c5e 0 2024-09-12T22:11:28.634 INFO:tasks.workunit.client.0.smithi019.stdout:6/623: mknod d9/dc/d20/ccf 0 2024-09-12T22:11:28.635 INFO:tasks.workunit.client.0.smithi019.stdout:5/601: creat d0/d24/d97/fce x:0 0 0 2024-09-12T22:11:28.635 INFO:tasks.workunit.client.0.smithi019.stdout:2/497: creat d0/d3/d11/d77/fa2 x:0 0 0 2024-09-12T22:11:28.635 INFO:tasks.workunit.client.0.smithi019.stdout:8/559: unlink d5/dc/d26/d43/f6a 0 2024-09-12T22:11:28.635 INFO:tasks.workunit.client.0.smithi019.stdout:6/624: unlink d9/dc/d20/c1c 0 2024-09-12T22:11:28.635 INFO:tasks.workunit.client.0.smithi019.stdout:5/602: write d0/fa6 [938973,31901] 0 2024-09-12T22:11:28.636 INFO:tasks.workunit.client.0.smithi019.stdout:1/579: write d1/d2/d18/d35/d84/dc/df/d61/f34 [1827365,66552] 0 2024-09-12T22:11:28.636 INFO:tasks.workunit.client.0.smithi019.stdout:1/580: fdatasync d1/fa8 0 2024-09-12T22:11:28.638 INFO:tasks.workunit.client.0.smithi019.stdout:9/542: chown d12/d1b/d40/d52/l5f 51744977 1 2024-09-12T22:11:28.638 INFO:tasks.workunit.client.0.smithi019.stdout:6/625: write d9/d3d/d4f/d59/f76 [927113,76666] 0 2024-09-12T22:11:28.638 INFO:tasks.workunit.client.0.smithi019.stdout:5/603: rmdir d0/d24/d58 39 2024-09-12T22:11:28.638 INFO:tasks.workunit.client.0.smithi019.stdout:8/560: creat d5/dc/d26/d43/d49/d92/fb6 x:0 0 0 2024-09-12T22:11:28.638 INFO:tasks.workunit.client.0.smithi019.stdout:2/498: getdents d0/d3/d11/d77/d78/d2c/d30/d32 0 2024-09-12T22:11:28.638 INFO:tasks.workunit.client.0.smithi019.stdout:9/543: unlink f5 0 2024-09-12T22:11:28.638 INFO:tasks.workunit.client.0.smithi019.stdout:5/604: chown d0/d1d/d4f/d47/d57/d98/fb9 60893 1 2024-09-12T22:11:28.639 INFO:tasks.workunit.client.0.smithi019.stdout:1/581: mknod d1/d2/d18/d35/d84/dc/cc4 0 2024-09-12T22:11:28.639 INFO:tasks.workunit.client.0.smithi019.stdout:8/561: fdatasync d5/d16/f83 0 2024-09-12T22:11:28.640 INFO:tasks.workunit.client.0.smithi019.stdout:6/626: link d9/dc/f52 d9/dc/d20/d71/fd0 0 2024-09-12T22:11:28.640 INFO:tasks.workunit.client.0.smithi019.stdout:2/499: creat d0/d31/fa3 x:0 0 0 2024-09-12T22:11:28.641 INFO:tasks.workunit.client.0.smithi019.stdout:1/582: stat d1/d2/da2/fa5 0 2024-09-12T22:11:28.641 INFO:tasks.workunit.client.0.smithi019.stdout:9/544: mknod d12/d1b/d20/d29/d74/cb5 0 2024-09-12T22:11:28.641 INFO:tasks.workunit.client.0.smithi019.stdout:2/500: dread - d0/d3/d11/d2e/d70/f97 zero size 2024-09-12T22:11:28.642 INFO:tasks.workunit.client.0.smithi019.stdout:9/545: stat f4 0 2024-09-12T22:11:28.642 INFO:tasks.workunit.client.0.smithi019.stdout:8/562: write d5/d16/d19/f31 [2406743,63727] 0 2024-09-12T22:11:28.642 INFO:tasks.workunit.client.0.smithi019.stdout:6/627: symlink d9/dc/d20/ld1 0 2024-09-12T22:11:28.643 INFO:tasks.workunit.client.0.smithi019.stdout:2/501: write d0/d3/df/d6b/f86 [526010,30960] 0 2024-09-12T22:11:28.643 INFO:tasks.workunit.client.0.smithi019.stdout:5/605: dread d0/d1d/d4f/d96/fa9 [0,4194304] 0 2024-09-12T22:11:28.643 INFO:tasks.workunit.client.0.smithi019.stdout:6/628: chown d9/d3d/f90 565737 1 2024-09-12T22:11:28.644 INFO:tasks.workunit.client.0.smithi019.stdout:1/583: chown d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/cb9 6898893 1 2024-09-12T22:11:28.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/629: read d9/d3d/f2f [713430,84299] 0 2024-09-12T22:11:28.647 INFO:tasks.workunit.client.0.smithi019.stdout:8/563: dread d5/d53/f89 [0,4194304] 0 2024-09-12T22:11:28.648 INFO:tasks.workunit.client.0.smithi019.stdout:9/546: dwrite d12/f17 [0,4194304] 0 2024-09-12T22:11:28.650 INFO:tasks.workunit.client.0.smithi019.stdout:8/564: mknod d5/cb7 0 2024-09-12T22:11:28.650 INFO:tasks.workunit.client.0.smithi019.stdout:1/584: rename d1/d2/d18/d35/d84/dc/df/d2c/c2e to d1/d2/d18/d35/d84/dc/df/d53/d55/cc5 0 2024-09-12T22:11:28.650 INFO:tasks.workunit.client.0.smithi019.stdout:9/547: readlink d12/d1b/d20/d64/l9c 0 2024-09-12T22:11:28.650 INFO:tasks.workunit.client.0.smithi019.stdout:6/630: rename d9/dc/d20/d4b/d64/d7e/fc3 to d9/d3d/d4f/d8d/fd2 0 2024-09-12T22:11:28.651 INFO:tasks.workunit.client.0.smithi019.stdout:2/502: dread d0/d3/d11/f8a [0,4194304] 0 2024-09-12T22:11:28.651 INFO:tasks.workunit.client.0.smithi019.stdout:8/565: creat d5/dc/d26/d4b/fb8 x:0 0 0 2024-09-12T22:11:28.652 INFO:tasks.workunit.client.0.smithi019.stdout:9/548: link d12/d1b/d40/d85/la9 d12/d48/lb6 0 2024-09-12T22:11:28.652 INFO:tasks.workunit.client.0.smithi019.stdout:1/585: rmdir d1/d2/d18/d35/d84/dc/df/d53/d66/dba 0 2024-09-12T22:11:28.653 INFO:tasks.workunit.client.0.smithi019.stdout:6/631: link d9/dc/d20/d4b/d6c/cb5 d9/d3d/db8/cd3 0 2024-09-12T22:11:28.653 INFO:tasks.workunit.client.0.smithi019.stdout:8/566: truncate d5/d16/d19/f50 4684959 0 2024-09-12T22:11:28.654 INFO:tasks.workunit.client.0.smithi019.stdout:6/632: mknod d9/dc/d20/d4b/d64/d78/da1/cd4 0 2024-09-12T22:11:28.656 INFO:tasks.workunit.client.0.smithi019.stdout:6/633: stat d9/dc/d20/d4b/d64/d78/da1 0 2024-09-12T22:11:28.656 INFO:tasks.workunit.client.0.smithi019.stdout:2/503: dread d0/d3/d11/d77/d78/d2c/d30/d32/f81 [0,4194304] 0 2024-09-12T22:11:28.656 INFO:tasks.workunit.client.0.smithi019.stdout:9/549: write d12/d1b/d20/d59/d5b/d9e/f76 [1164495,104755] 0 2024-09-12T22:11:28.658 INFO:tasks.workunit.client.0.smithi019.stdout:2/504: symlink d0/d3/d11/d2e/d34/d51/la4 0 2024-09-12T22:11:28.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/634: creat d9/dc/d20/d4b/d64/d78/fd5 x:0 0 0 2024-09-12T22:11:28.659 INFO:tasks.workunit.client.0.smithi019.stdout:1/586: dwrite d1/d2/d18/d35/d84/dc/df/d2c/f63 [0,4194304] 0 2024-09-12T22:11:28.659 INFO:tasks.workunit.client.0.smithi019.stdout:2/505: write d0/d3/d11/f10 [4344453,35309] 0 2024-09-12T22:11:28.660 INFO:tasks.workunit.client.0.smithi019.stdout:6/635: mknod d9/d3d/d6f/cd6 0 2024-09-12T22:11:28.660 INFO:tasks.workunit.client.0.smithi019.stdout:9/550: write d12/d1b/d20/f2a [1066299,53283] 0 2024-09-12T22:11:28.661 INFO:tasks.workunit.client.0.smithi019.stdout:1/587: symlink d1/d2/d18/d29/d27/lc6 0 2024-09-12T22:11:28.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/636: chown d9/d3d/d6f 0 1 2024-09-12T22:11:28.661 INFO:tasks.workunit.client.0.smithi019.stdout:2/506: creat d0/d3/d11/d2e/d34/fa5 x:0 0 0 2024-09-12T22:11:28.661 INFO:tasks.workunit.client.0.smithi019.stdout:9/551: creat d12/d1b/d20/da0/fb7 x:0 0 0 2024-09-12T22:11:28.661 INFO:tasks.workunit.client.0.smithi019.stdout:1/588: write d1/d2/f7 [1087170,88729] 0 2024-09-12T22:11:28.662 INFO:tasks.workunit.client.0.smithi019.stdout:2/507: read d0/d3/d11/f8a [1250617,127117] 0 2024-09-12T22:11:28.663 INFO:tasks.workunit.client.0.smithi019.stdout:9/552: write d12/d1b/d20/f2b [2779418,104993] 0 2024-09-12T22:11:28.663 INFO:tasks.workunit.client.0.smithi019.stdout:5/606: dread d0/d1d/f20 [0,4194304] 0 2024-09-12T22:11:28.665 INFO:tasks.workunit.client.0.smithi019.stdout:2/508: mknod d0/d31/d12/d3b/ca6 0 2024-09-12T22:11:28.665 INFO:tasks.workunit.client.0.smithi019.stdout:1/589: read - d1/d2/d18/d35/d84/dc/df/d2c/f42 zero size 2024-09-12T22:11:28.665 INFO:tasks.workunit.client.0.smithi019.stdout:5/607: rmdir d0/d1d 39 2024-09-12T22:11:28.665 INFO:tasks.workunit.client.0.smithi019.stdout:9/553: write d12/d48/f93 [260127,62707] 0 2024-09-12T22:11:28.665 INFO:tasks.workunit.client.0.smithi019.stdout:5/608: mkdir d0/d24/d97/dcf 0 2024-09-12T22:11:28.666 INFO:tasks.workunit.client.0.smithi019.stdout:6/637: truncate d9/dc/d20/f2e 196536 0 2024-09-12T22:11:28.666 INFO:tasks.workunit.client.0.smithi019.stdout:9/554: write d12/d1b/f7d [4099438,2444] 0 2024-09-12T22:11:28.666 INFO:tasks.workunit.client.0.smithi019.stdout:4/533: sync 2024-09-12T22:11:28.666 INFO:tasks.workunit.client.0.smithi019.stdout:0/572: sync 2024-09-12T22:11:28.666 INFO:tasks.workunit.client.0.smithi019.stdout:7/584: sync 2024-09-12T22:11:28.666 INFO:tasks.workunit.client.0.smithi019.stdout:3/566: sync 2024-09-12T22:11:28.666 INFO:tasks.workunit.client.0.smithi019.stdout:1/590: rename d1/d2/d18/d29/d27/l3f to d1/d2/d18/d70/lc7 0 2024-09-12T22:11:28.667 INFO:tasks.workunit.client.0.smithi019.stdout:9/555: readlink d12/d1b/d40/d85/la9 0 2024-09-12T22:11:28.668 INFO:tasks.workunit.client.0.smithi019.stdout:3/567: write d18/d26/d30/d64/f88 [2308876,83886] 0 2024-09-12T22:11:28.668 INFO:tasks.workunit.client.0.smithi019.stdout:7/585: mkdir da/d24/d28/d1c/d32/d99/dc8 0 2024-09-12T22:11:28.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/556: truncate d12/f15 580328 0 2024-09-12T22:11:28.672 INFO:tasks.workunit.client.0.smithi019.stdout:0/573: symlink d5/d7/d2c/d44/d6a/d46/db2/lbb 0 2024-09-12T22:11:28.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/557: chown d12 7 1 2024-09-12T22:11:28.672 INFO:tasks.workunit.client.0.smithi019.stdout:7/586: mknod da/d30/cc9 0 2024-09-12T22:11:28.673 INFO:tasks.workunit.client.0.smithi019.stdout:0/574: write d5/d7/d2c/d81/f9c [4910506,53835] 0 2024-09-12T22:11:28.673 INFO:tasks.workunit.client.0.smithi019.stdout:7/587: write da/f5b [1535882,88245] 0 2024-09-12T22:11:28.673 INFO:tasks.workunit.client.0.smithi019.stdout:8/567: dread d5/dc/d26/d5c/f93 [0,4194304] 0 2024-09-12T22:11:28.674 INFO:tasks.workunit.client.0.smithi019.stdout:9/558: link d12/d1b/d40/f57 d12/d1b/d40/d52/fb8 0 2024-09-12T22:11:28.674 INFO:tasks.workunit.client.0.smithi019.stdout:7/588: stat da/d30/d53/db1 0 2024-09-12T22:11:28.675 INFO:tasks.workunit.client.0.smithi019.stdout:6/638: dwrite d9/dc/d20/d4b/d7a/fc2 [0,4194304] 0 2024-09-12T22:11:28.676 INFO:tasks.workunit.client.0.smithi019.stdout:3/568: dread d18/d26/d30/d4e/f59 [0,4194304] 0 2024-09-12T22:11:28.677 INFO:tasks.workunit.client.0.smithi019.stdout:0/575: mkdir d5/d7/d10/d26/d2a/d94/dbc 0 2024-09-12T22:11:28.677 INFO:tasks.workunit.client.0.smithi019.stdout:8/568: creat d5/dc/d8d/d96/fb9 x:0 0 0 2024-09-12T22:11:28.678 INFO:tasks.workunit.client.0.smithi019.stdout:9/559: rename f11 to d12/d1b/d20/d25/fb9 0 2024-09-12T22:11:28.678 INFO:tasks.workunit.client.0.smithi019.stdout:3/569: write d18/d1d/d8b/fa0 [393729,82694] 0 2024-09-12T22:11:28.678 INFO:tasks.workunit.client.0.smithi019.stdout:3/570: sync 2024-09-12T22:11:28.679 INFO:tasks.workunit.client.0.smithi019.stdout:8/569: rmdir d5/d16/d19/d29 39 2024-09-12T22:11:28.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/576: mknod d5/d7/de/da3/cbd 0 2024-09-12T22:11:28.679 INFO:tasks.workunit.client.0.smithi019.stdout:6/639: creat d9/dc/d20/d4b/d64/d7d/fd7 x:0 0 0 2024-09-12T22:11:28.679 INFO:tasks.workunit.client.0.smithi019.stdout:7/589: mkdir da/d24/d28/d1c/d32/dc2/dca 0 2024-09-12T22:11:28.679 INFO:tasks.workunit.client.0.smithi019.stdout:3/571: chown d18/d1d/l22 16398253 1 2024-09-12T22:11:28.679 INFO:tasks.workunit.client.0.smithi019.stdout:5/609: dread d0/f3 [0,4194304] 0 2024-09-12T22:11:28.681 INFO:tasks.workunit.client.0.smithi019.stdout:6/640: chown d9/dc/f13 1 1 2024-09-12T22:11:28.681 INFO:tasks.workunit.client.0.smithi019.stdout:6/641: sync 2024-09-12T22:11:28.681 INFO:tasks.workunit.client.0.smithi019.stdout:0/577: rmdir d5/d7/d10/d26/d2a/d94 39 2024-09-12T22:11:28.682 INFO:tasks.workunit.client.0.smithi019.stdout:8/570: creat d5/d16/d19/fba x:0 0 0 2024-09-12T22:11:28.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/509: dread d0/d3/d11/f10 [0,4194304] 0 2024-09-12T22:11:28.683 INFO:tasks.workunit.client.0.smithi019.stdout:7/590: creat da/d24/d28/d1c/db9/fcb x:0 0 0 2024-09-12T22:11:28.683 INFO:tasks.workunit.client.0.smithi019.stdout:8/571: mknod d5/dc/d8a/cbb 0 2024-09-12T22:11:28.686 INFO:tasks.workunit.client.0.smithi019.stdout:9/560: dwrite d12/d1b/d40/d52/d62/f8c [4194304,4194304] 0 2024-09-12T22:11:28.687 INFO:tasks.workunit.client.0.smithi019.stdout:8/572: read - d5/d16/d19/d29/fac zero size 2024-09-12T22:11:28.687 INFO:tasks.workunit.client.0.smithi019.stdout:8/573: sync 2024-09-12T22:11:28.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/534: dread d9/db/d2b/d6a/f90 [0,4194304] 0 2024-09-12T22:11:28.693 INFO:tasks.workunit.client.0.smithi019.stdout:8/574: stat d5/dc/d26/d43/d49/d92/ca0 0 2024-09-12T22:11:28.694 INFO:tasks.workunit.client.0.smithi019.stdout:1/591: dread d1/d2/d18/d35/d84/dc/f19 [0,4194304] 0 2024-09-12T22:11:28.694 INFO:tasks.workunit.client.0.smithi019.stdout:6/642: dwrite d9/dc/d20/f14 [0,4194304] 0 2024-09-12T22:11:28.695 INFO:tasks.workunit.client.0.smithi019.stdout:0/578: dwrite d5/d7/d2c/f75 [0,4194304] 0 2024-09-12T22:11:28.696 INFO:tasks.workunit.client.0.smithi019.stdout:4/535: fsync d9/f3b 0 2024-09-12T22:11:28.696 INFO:tasks.workunit.client.0.smithi019.stdout:9/561: truncate d12/d1b/d40/d52/f65 1391529 0 2024-09-12T22:11:28.697 INFO:tasks.workunit.client.0.smithi019.stdout:1/592: rmdir d1/d37 39 2024-09-12T22:11:28.697 INFO:tasks.workunit.client.0.smithi019.stdout:8/575: creat d5/dc/d8a/fbc x:0 0 0 2024-09-12T22:11:28.697 INFO:tasks.workunit.client.0.smithi019.stdout:2/510: dwrite d0/d3/d11/d77/fa2 [0,4194304] 0 2024-09-12T22:11:28.697 INFO:tasks.workunit.client.0.smithi019.stdout:6/643: dread - d9/dc/d20/d4b/fb3 zero size 2024-09-12T22:11:28.698 INFO:tasks.workunit.client.0.smithi019.stdout:3/572: dwrite f13 [0,4194304] 0 2024-09-12T22:11:28.698 INFO:tasks.workunit.client.0.smithi019.stdout:4/536: rmdir d9/d4c/d76/da7 0 2024-09-12T22:11:28.699 INFO:tasks.workunit.client.0.smithi019.stdout:6/644: fsync d9/dc/f23 0 2024-09-12T22:11:28.699 INFO:tasks.workunit.client.0.smithi019.stdout:4/537: write f5 [909056,56410] 0 2024-09-12T22:11:28.700 INFO:tasks.workunit.client.0.smithi019.stdout:9/562: symlink d12/d1b/d40/d85/lba 0 2024-09-12T22:11:28.700 INFO:tasks.workunit.client.0.smithi019.stdout:8/576: symlink d5/dc/d26/d43/d49/lbd 0 2024-09-12T22:11:28.700 INFO:tasks.workunit.client.0.smithi019.stdout:1/593: fsync d1/d2/d18/d35/d84/dc/df/d61/f52 0 2024-09-12T22:11:28.701 INFO:tasks.workunit.client.0.smithi019.stdout:2/511: rename d0/d3/df/d7b/l8f to d0/d31/d4/d7/la7 0 2024-09-12T22:11:28.701 INFO:tasks.workunit.client.0.smithi019.stdout:0/579: link d5/d7/d10/d26/d2a/c57 d5/d7/d2c/d81/cbe 0 2024-09-12T22:11:28.702 INFO:tasks.workunit.client.0.smithi019.stdout:1/594: chown d1/d83/lac 81147547 1 2024-09-12T22:11:28.702 INFO:tasks.workunit.client.0.smithi019.stdout:9/563: write d12/d1b/d20/d25/fad [290611,59371] 0 2024-09-12T22:11:28.702 INFO:tasks.workunit.client.0.smithi019.stdout:4/538: rename d9/f2f to d9/d14/d57/d95/d96/faa 0 2024-09-12T22:11:28.702 INFO:tasks.workunit.client.0.smithi019.stdout:9/564: sync 2024-09-12T22:11:28.702 INFO:tasks.workunit.client.0.smithi019.stdout:3/573: link d18/d1d/l39 d18/d1d/dad/lb3 0 2024-09-12T22:11:28.703 INFO:tasks.workunit.client.0.smithi019.stdout:2/512: write d0/d3/df/d6b/f86 [1022607,11964] 0 2024-09-12T22:11:28.703 INFO:tasks.workunit.client.0.smithi019.stdout:1/595: creat d1/d83/fc8 x:0 0 0 2024-09-12T22:11:28.704 INFO:tasks.workunit.client.0.smithi019.stdout:1/596: fsync d1/d2/f24 0 2024-09-12T22:11:28.705 INFO:tasks.workunit.client.0.smithi019.stdout:4/539: creat d9/d17/da1/fab x:0 0 0 2024-09-12T22:11:28.706 INFO:tasks.workunit.client.0.smithi019.stdout:2/513: write d0/d3/d11/d2e/f49 [186425,57589] 0 2024-09-12T22:11:28.706 INFO:tasks.workunit.client.0.smithi019.stdout:0/580: dwrite d5/d7/f12 [0,4194304] 0 2024-09-12T22:11:28.707 INFO:tasks.workunit.client.0.smithi019.stdout:2/514: unlink d0/d3/d11/fc 0 2024-09-12T22:11:28.708 INFO:tasks.workunit.client.0.smithi019.stdout:2/515: write d0/d3/d11/d77/fa2 [4775697,60389] 0 2024-09-12T22:11:28.709 INFO:tasks.workunit.client.0.smithi019.stdout:6/645: read d9/d3d/f6e [1706816,30882] 0 2024-09-12T22:11:28.709 INFO:tasks.workunit.client.0.smithi019.stdout:2/516: dread - d0/d3/df/f61 zero size 2024-09-12T22:11:28.709 INFO:tasks.workunit.client.0.smithi019.stdout:3/574: dread f17 [0,4194304] 0 2024-09-12T22:11:28.710 INFO:tasks.workunit.client.0.smithi019.stdout:2/517: readlink d0/d3/df/l2f 0 2024-09-12T22:11:28.711 INFO:tasks.workunit.client.0.smithi019.stdout:6/646: rmdir d9/dc/d20/d4b/d64/d7e 39 2024-09-12T22:11:28.711 INFO:tasks.workunit.client.0.smithi019.stdout:2/518: chown d0/d3/d11/d77/d78/d2c 554 1 2024-09-12T22:11:28.711 INFO:tasks.workunit.client.0.smithi019.stdout:2/519: readlink d0/d3/d11/l8c 0 2024-09-12T22:11:28.712 INFO:tasks.workunit.client.0.smithi019.stdout:6/647: unlink d9/dc/d20/d30/d5b/fb9 0 2024-09-12T22:11:28.712 INFO:tasks.workunit.client.0.smithi019.stdout:3/575: dread d18/d26/d30/d4e/f73 [0,4194304] 0 2024-09-12T22:11:28.713 INFO:tasks.workunit.client.0.smithi019.stdout:2/520: rename d0/d31/d4/l2b to d0/d3/df/d6b/la8 0 2024-09-12T22:11:28.713 INFO:tasks.workunit.client.0.smithi019.stdout:2/521: fdatasync d0/d31/d12/f95 0 2024-09-12T22:11:28.713 INFO:tasks.workunit.client.0.smithi019.stdout:6/648: rename d9/d6b/f95 to d9/dc/d20/d4b/d6c/d8c/fd8 0 2024-09-12T22:11:28.714 INFO:tasks.workunit.client.0.smithi019.stdout:3/576: creat d18/d26/d30/d71/fb4 x:0 0 0 2024-09-12T22:11:28.714 INFO:tasks.workunit.client.0.smithi019.stdout:6/649: mkdir d9/dc/dd9 0 2024-09-12T22:11:28.715 INFO:tasks.workunit.client.0.smithi019.stdout:2/522: dread - d0/d31/d12/d3b/d5c/d71/f73 zero size 2024-09-12T22:11:28.715 INFO:tasks.workunit.client.0.smithi019.stdout:3/577: mkdir d18/d1d/d8b/db5 0 2024-09-12T22:11:28.716 INFO:tasks.workunit.client.0.smithi019.stdout:6/650: creat d9/d3d/d4f/d59/fda x:0 0 0 2024-09-12T22:11:28.716 INFO:tasks.workunit.client.0.smithi019.stdout:3/578: mknod d18/d26/d30/d71/cb6 0 2024-09-12T22:11:28.718 INFO:tasks.workunit.client.0.smithi019.stdout:1/597: write d1/d2/d18/d35/d84/dc/df/d53/d55/f6b [576219,58771] 0 2024-09-12T22:11:28.718 INFO:tasks.workunit.client.0.smithi019.stdout:6/651: stat d9/dc/d20/d4b/d64/d7e/fce 0 2024-09-12T22:11:28.718 INFO:tasks.workunit.client.0.smithi019.stdout:5/610: dread d0/f11 [0,4194304] 0 2024-09-12T22:11:28.719 INFO:tasks.workunit.client.0.smithi019.stdout:5/611: creat d0/d26/d42/fd0 x:0 0 0 2024-09-12T22:11:28.719 INFO:tasks.workunit.client.0.smithi019.stdout:1/598: fdatasync d1/d2/d18/d35/d84/dc/df/d2c/d5d/f8e 0 2024-09-12T22:11:28.719 INFO:tasks.workunit.client.0.smithi019.stdout:4/540: dread d9/d17/f2c [0,4194304] 0 2024-09-12T22:11:28.722 INFO:tasks.workunit.client.0.smithi019.stdout:4/541: creat d9/d17/fac x:0 0 0 2024-09-12T22:11:28.724 INFO:tasks.workunit.client.0.smithi019.stdout:0/581: fdatasync d5/d7/d2c/d44/d6a/d46/f73 0 2024-09-12T22:11:28.724 INFO:tasks.workunit.client.0.smithi019.stdout:7/591: dread da/d24/d28/d1c/d32/f89 [0,4194304] 0 2024-09-12T22:11:28.726 INFO:tasks.workunit.client.0.smithi019.stdout:0/582: fdatasync d5/d7/f11 0 2024-09-12T22:11:28.726 INFO:tasks.workunit.client.0.smithi019.stdout:3/579: dwrite d18/d26/d30/d71/d86/fa1 [0,4194304] 0 2024-09-12T22:11:28.727 INFO:tasks.workunit.client.0.smithi019.stdout:6/652: dwrite d9/dc/d20/fba [0,4194304] 0 2024-09-12T22:11:28.727 INFO:tasks.workunit.client.0.smithi019.stdout:1/599: link d1/d2/d18/d35/d84/d98/fc2 d1/d2/d18/d35/d84/dc/fc9 0 2024-09-12T22:11:28.729 INFO:tasks.workunit.client.0.smithi019.stdout:8/577: dread d5/d16/f63 [0,4194304] 0 2024-09-12T22:11:28.730 INFO:tasks.workunit.client.0.smithi019.stdout:6/653: dread - d9/dc/d20/d71/fbc zero size 2024-09-12T22:11:28.730 INFO:tasks.workunit.client.0.smithi019.stdout:1/600: rmdir d1/d2/d18/d59 39 2024-09-12T22:11:28.731 INFO:tasks.workunit.client.0.smithi019.stdout:7/592: rename da/cad to da/d24/d28/d1c/d32/dc2/ccc 0 2024-09-12T22:11:28.733 INFO:tasks.workunit.client.0.smithi019.stdout:3/580: write d18/f56 [376318,10871] 0 2024-09-12T22:11:28.733 INFO:tasks.workunit.client.0.smithi019.stdout:5/612: dwrite d0/f2 [4194304,4194304] 0 2024-09-12T22:11:28.733 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:28.732+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:28.735 INFO:tasks.workunit.client.0.smithi019.stdout:9/565: dread d12/d1b/d20/d59/d5b/d9e/f7f [0,4194304] 0 2024-09-12T22:11:28.735 INFO:tasks.workunit.client.0.smithi019.stdout:5/613: stat d0/d24/l40 0 2024-09-12T22:11:28.735 INFO:tasks.workunit.client.0.smithi019.stdout:0/583: rmdir d5/d7/d10/d26/d2a/d94/dbc 0 2024-09-12T22:11:28.735 INFO:tasks.workunit.client.0.smithi019.stdout:6/654: read - d9/dc/d20/d4b/d64/d7d/da7/fb0 zero size 2024-09-12T22:11:28.735 INFO:tasks.workunit.client.0.smithi019.stdout:4/542: dwrite d9/db/d2b/f30 [8388608,4194304] 0 2024-09-12T22:11:28.736 INFO:tasks.workunit.client.0.smithi019.stdout:8/578: creat d5/d16/d19/d29/d7f/fbe x:0 0 0 2024-09-12T22:11:28.737 INFO:tasks.workunit.client.0.smithi019.stdout:7/593: getdents da/d30/dc5 0 2024-09-12T22:11:28.737 INFO:tasks.workunit.client.0.smithi019.stdout:0/584: unlink d5/d7/l51 0 2024-09-12T22:11:28.738 INFO:tasks.workunit.client.0.smithi019.stdout:3/581: creat d18/d26/d30/d4e/d9a/dae/fb7 x:0 0 0 2024-09-12T22:11:28.738 INFO:tasks.workunit.client.0.smithi019.stdout:5/614: creat d0/d24/d58/fd1 x:0 0 0 2024-09-12T22:11:28.738 INFO:tasks.workunit.client.0.smithi019.stdout:4/543: mkdir d9/d73/d8f/d93/dad 0 2024-09-12T22:11:28.739 INFO:tasks.workunit.client.0.smithi019.stdout:9/566: mknod d12/d1b/d20/d29/d92/d9d/da5/cbb 0 2024-09-12T22:11:28.739 INFO:tasks.workunit.client.0.smithi019.stdout:8/579: rmdir d5/d16/d19/d29/d7f 39 2024-09-12T22:11:28.741 INFO:tasks.workunit.client.0.smithi019.stdout:3/582: chown d18/d1d/c1e 504 1 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:5/615: creat d0/d26/d5f/dc3/fd2 x:0 0 0 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:9/567: mkdir d12/d1b/d20/dbc 0 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:4/544: rename d9/d87/f98 to d9/d87/fae 0 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:3/583: sync 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:8/580: unlink d5/d16/d19/d29/fac 0 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:4/545: sync 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:1/601: dwrite d1/d2/d18/d29/f9b [0,4194304] 0 2024-09-12T22:11:28.742 INFO:tasks.workunit.client.0.smithi019.stdout:0/585: write d5/d7/d2c/d44/f45 [856388,57673] 0 2024-09-12T22:11:28.743 INFO:tasks.workunit.client.0.smithi019.stdout:5/616: fdatasync d0/d1d/d4f/f1a 0 2024-09-12T22:11:28.744 INFO:tasks.workunit.client.0.smithi019.stdout:9/568: chown d12/d1b/d20/d29/d56/f80 484765 1 2024-09-12T22:11:28.745 INFO:tasks.workunit.client.0.smithi019.stdout:6/655: dwrite d9/dc/d20/f14 [4194304,4194304] 0 2024-09-12T22:11:28.745 INFO:tasks.workunit.client.0.smithi019.stdout:4/546: write d9/d17/da1/fab [474170,6082] 0 2024-09-12T22:11:28.745 INFO:tasks.workunit.client.0.smithi019.stdout:3/584: symlink d18/d26/d30/d71/d86/lb8 0 2024-09-12T22:11:28.746 INFO:tasks.workunit.client.0.smithi019.stdout:5/617: symlink d0/d26/d3a/ld3 0 2024-09-12T22:11:28.748 INFO:tasks.workunit.client.0.smithi019.stdout:1/602: write d1/d37/f65 [4317680,39887] 0 2024-09-12T22:11:28.749 INFO:tasks.workunit.client.0.smithi019.stdout:9/569: mkdir d12/d1b/d20/d29/d74/d77/d86/dbd 0 2024-09-12T22:11:28.749 INFO:tasks.workunit.client.0.smithi019.stdout:2/523: dread d0/d3/f66 [0,4194304] 0 2024-09-12T22:11:28.749 INFO:tasks.workunit.client.0.smithi019.stdout:3/585: write d18/d1d/f2a [1213177,88250] 0 2024-09-12T22:11:28.749 INFO:tasks.workunit.client.0.smithi019.stdout:5/618: fsync d0/d1d/d4f/f1a 0 2024-09-12T22:11:28.749 INFO:tasks.workunit.client.0.smithi019.stdout:0/586: link d5/d7/d10/c58 d5/d7/d2c/cbf 0 2024-09-12T22:11:28.750 INFO:tasks.workunit.client.0.smithi019.stdout:4/547: rename d9/db/d2b/d6a/d7d to d9/d73/d8f/d93/daf 0 2024-09-12T22:11:28.750 INFO:tasks.workunit.client.0.smithi019.stdout:2/524: dread - d0/d3/df/d52/f96 zero size 2024-09-12T22:11:28.751 INFO:tasks.workunit.client.0.smithi019.stdout:9/570: truncate d12/d1b/f7d 5067920 0 2024-09-12T22:11:28.751 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:28.751 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:28.752 INFO:tasks.workunit.client.0.smithi019.stdout:4/548: fdatasync d9/db/d2b/f30 0 2024-09-12T22:11:28.752 INFO:tasks.workunit.client.0.smithi019.stdout:0/587: unlink d5/d7/d2c/d44/f7d 0 2024-09-12T22:11:28.752 INFO:tasks.workunit.client.0.smithi019.stdout:3/586: write d18/d26/d30/d71/d86/f90 [760325,122495] 0 2024-09-12T22:11:28.753 INFO:tasks.workunit.client.0.smithi019.stdout:5/619: truncate d0/d26/d6f/f9d 34687 0 2024-09-12T22:11:28.753 INFO:tasks.workunit.client.0.smithi019.stdout:1/603: write d1/d2/d18/d35/d84/dc/df/d53/d55/faa [616590,69874] 0 2024-09-12T22:11:28.753 INFO:tasks.workunit.client.0.smithi019.stdout:8/581: dwrite d5/d16/d19/d29/f4d [4194304,4194304] 0 2024-09-12T22:11:28.754 INFO:tasks.workunit.client.0.smithi019.stdout:9/571: fsync d12/d1b/d20/d29/d56/d60/f7a 0 2024-09-12T22:11:28.755 INFO:tasks.workunit.client.0.smithi019.stdout:0/588: write d5/f4c [1680811,57796] 0 2024-09-12T22:11:28.755 INFO:tasks.workunit.client.0.smithi019.stdout:3/587: write d18/f34 [5113158,25308] 0 2024-09-12T22:11:28.756 INFO:tasks.workunit.client.0.smithi019.stdout:6/656: dwrite d9/d3d/d6f/fbe [0,4194304] 0 2024-09-12T22:11:28.756 INFO:tasks.workunit.client.0.smithi019.stdout:8/582: write d5/d16/f28 [2611249,57434] 0 2024-09-12T22:11:28.757 INFO:tasks.workunit.client.0.smithi019.stdout:5/620: truncate d0/d1d/f33 731815 0 2024-09-12T22:11:28.757 INFO:tasks.workunit.client.0.smithi019.stdout:6/657: creat d9/d3d/d4f/d8d/fdb x:0 0 0 2024-09-12T22:11:28.757 INFO:tasks.workunit.client.0.smithi019.stdout:0/589: creat d5/d7/de/d8d/fc0 x:0 0 0 2024-09-12T22:11:28.759 INFO:tasks.workunit.client.0.smithi019.stdout:8/583: rmdir d5/d16/d19/d29/da5 0 2024-09-12T22:11:28.759 INFO:tasks.workunit.client.0.smithi019.stdout:5/621: mknod d0/d1d/d4f/d96/cd4 0 2024-09-12T22:11:28.759 INFO:tasks.workunit.client.0.smithi019.stdout:0/590: mkdir d5/d7/d2c/dc1 0 2024-09-12T22:11:28.760 INFO:tasks.workunit.client.0.smithi019.stdout:3/588: link d18/l5e d18/d26/da5/lb9 0 2024-09-12T22:11:28.760 INFO:tasks.workunit.client.0.smithi019.stdout:1/604: truncate d1/d2/d18/d35/d84/d98/dbc/fc1 989747 0 2024-09-12T22:11:28.760 INFO:tasks.workunit.client.0.smithi019.stdout:4/549: read d9/d14/d31/f5c [3036879,84960] 0 2024-09-12T22:11:28.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:2/525: read d0/d31/d12/d15/f33 [3603196,125226] 0 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:1/605: fsync d1/d2/f7 0 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:0/591: chown d5/d7/d2c/d44/d6a/d46 4044 1 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:8/584: mknod d5/d16/d19/d29/d7f/cbf 0 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:2/526: mkdir d0/d3/d11/da9 0 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:6/658: truncate d9/dc/d20/d4b/d64/d7e/fc1 524579 0 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:3/589: read d18/f56 [102060,60694] 0 2024-09-12T22:11:28.763 INFO:tasks.workunit.client.0.smithi019.stdout:9/572: dread f4 [0,4194304] 0 2024-09-12T22:11:28.765 INFO:tasks.workunit.client.0.smithi019.stdout:7/594: dread da/f11 [0,4194304] 0 2024-09-12T22:11:28.765 INFO:tasks.workunit.client.0.smithi019.stdout:6/659: chown d9/dc/d20/d30 3144649 1 2024-09-12T22:11:28.766 INFO:tasks.workunit.client.0.smithi019.stdout:0/592: creat d5/d7/d2c/d44/d6a/d76/fc2 x:0 0 0 2024-09-12T22:11:28.766 INFO:tasks.workunit.client.0.smithi019.stdout:3/590: symlink d18/lba 0 2024-09-12T22:11:28.766 INFO:tasks.workunit.client.0.smithi019.stdout:8/585: mknod d5/dc/d26/d43/d49/d7a/cc0 0 2024-09-12T22:11:28.766 INFO:tasks.workunit.client.0.smithi019.stdout:4/550: dread d9/d17/f4f [0,4194304] 0 2024-09-12T22:11:28.767 INFO:tasks.workunit.client.0.smithi019.stdout:1/606: stat d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f99 0 2024-09-12T22:11:28.767 INFO:tasks.workunit.client.0.smithi019.stdout:2/527: mkdir d0/d3/df/d7b/d80/d9a/daa 0 2024-09-12T22:11:28.767 INFO:tasks.workunit.client.0.smithi019.stdout:9/573: mknod d12/d1b/d20/d64/cbe 0 2024-09-12T22:11:28.767 INFO:tasks.workunit.client.0.smithi019.stdout:6/660: mkdir d9/dc/d20/d4b/d64/d7d/da7/ddc 0 2024-09-12T22:11:28.767 INFO:tasks.workunit.client.0.smithi019.stdout:0/593: symlink d5/d7/d2c/d44/d6a/d76/lc3 0 2024-09-12T22:11:28.768 INFO:tasks.workunit.client.0.smithi019.stdout:5/622: dwrite d0/d4e/d50/f7c [0,4194304] 0 2024-09-12T22:11:28.768 INFO:tasks.workunit.client.0.smithi019.stdout:7/595: rename da/d24/d28/d1c/f20 to da/d30/da5/fcd 0 2024-09-12T22:11:28.770 INFO:tasks.workunit.client.0.smithi019.stdout:0/594: chown d5/d7/de/l13 0 1 2024-09-12T22:11:28.770 INFO:tasks.workunit.client.0.smithi019.stdout:7/596: dread - da/d24/d28/f8b zero size 2024-09-12T22:11:28.773 INFO:tasks.workunit.client.0.smithi019.stdout:9/574: rename d12/d1b/d40/f5e to d12/d1b/fbf 0 2024-09-12T22:11:28.773 INFO:tasks.workunit.client.0.smithi019.stdout:1/607: link d1/d2/d18/d59/l87 d1/d83/lca 0 2024-09-12T22:11:28.773 INFO:tasks.workunit.client.0.smithi019.stdout:0/595: symlink d5/d7/lc4 0 2024-09-12T22:11:28.775 INFO:tasks.workunit.client.0.smithi019.stdout:8/586: dwrite d5/f42 [0,4194304] 0 2024-09-12T22:11:28.777 INFO:tasks.workunit.client.0.smithi019.stdout:4/551: dwrite d9/d14/f38 [4194304,4194304] 0 2024-09-12T22:11:28.777 INFO:tasks.workunit.client.0.smithi019.stdout:5/623: truncate d0/f1b 8547118 0 2024-09-12T22:11:28.777 INFO:tasks.workunit.client.0.smithi019.stdout:9/575: write d12/f55 [175419,84088] 0 2024-09-12T22:11:28.778 INFO:tasks.workunit.client.0.smithi019.stdout:1/608: write d1/d2/d18/d29/f9b [591683,119440] 0 2024-09-12T22:11:28.779 INFO:tasks.workunit.client.0.smithi019.stdout:6/661: dwrite d9/d3d/d4f/d8d/fa6 [0,4194304] 0 2024-09-12T22:11:28.779 INFO:tasks.workunit.client.0.smithi019.stdout:4/552: creat d9/d58/fb0 x:0 0 0 2024-09-12T22:11:28.779 INFO:tasks.workunit.client.0.smithi019.stdout:3/591: dwrite d18/d26/d30/d64/f88 [4194304,4194304] 0 2024-09-12T22:11:28.779 INFO:tasks.workunit.client.0.smithi019.stdout:5/624: fsync d0/d1d/d4f/d47/f4a 0 2024-09-12T22:11:28.780 INFO:tasks.workunit.client.0.smithi019.stdout:4/553: mknod d9/d14/d33/cb1 0 2024-09-12T22:11:28.782 INFO:tasks.workunit.client.0.smithi019.stdout:9/576: truncate d12/d1b/d20/d29/d56/f79 1457471 0 2024-09-12T22:11:28.782 INFO:tasks.workunit.client.0.smithi019.stdout:1/609: write d1/d2/d18/d35/d84/dc/df/d53/d55/f8f [798203,78798] 0 2024-09-12T22:11:28.782 INFO:tasks.workunit.client.0.smithi019.stdout:5/625: symlink d0/d24/d58/ld5 0 2024-09-12T22:11:28.782 INFO:tasks.workunit.client.0.smithi019.stdout:8/587: getdents d5/dc/d26 0 2024-09-12T22:11:28.782 INFO:tasks.workunit.client.0.smithi019.stdout:4/554: chown d9/d73/la0 206791238 1 2024-09-12T22:11:28.782 INFO:tasks.workunit.client.0.smithi019.stdout:6/662: getdents d9/dc/d20/d30/db7 0 2024-09-12T22:11:28.782 INFO:tasks.workunit.client.0.smithi019.stdout:5/626: unlink d0/fa6 0 2024-09-12T22:11:28.783 INFO:tasks.workunit.client.0.smithi019.stdout:8/588: unlink d5/d16/d19/d29/d7f/l8f 0 2024-09-12T22:11:28.783 INFO:tasks.workunit.client.0.smithi019.stdout:4/555: mknod d9/d14/d57/d9b/cb2 0 2024-09-12T22:11:28.783 INFO:tasks.workunit.client.0.smithi019.stdout:6/663: symlink d9/d3d/d4f/d59/ldd 0 2024-09-12T22:11:28.784 INFO:tasks.workunit.client.0.smithi019.stdout:5/627: rmdir d0/d1d/d4f/d47 39 2024-09-12T22:11:28.784 INFO:tasks.workunit.client.0.smithi019.stdout:1/610: chown d1/d37/f4c 760 1 2024-09-12T22:11:28.785 INFO:tasks.workunit.client.0.smithi019.stdout:9/577: truncate d12/d1b/d20/d59/d5b/d9a/fa7 333725 0 2024-09-12T22:11:28.785 INFO:tasks.workunit.client.0.smithi019.stdout:6/664: chown d9/d3d/d6f/f65 53919 1 2024-09-12T22:11:28.785 INFO:tasks.workunit.client.0.smithi019.stdout:1/611: read - d1/fa8 zero size 2024-09-12T22:11:28.787 INFO:tasks.workunit.client.0.smithi019.stdout:6/665: dread - d9/dc/f4d zero size 2024-09-12T22:11:28.787 INFO:tasks.workunit.client.0.smithi019.stdout:5/628: read - d0/d1d/d4f/d47/d57/d98/fb9 zero size 2024-09-12T22:11:28.788 INFO:tasks.workunit.client.0.smithi019.stdout:3/592: dwrite d18/d1d/f2b [0,4194304] 0 2024-09-12T22:11:28.789 INFO:tasks.workunit.client.0.smithi019.stdout:5/629: truncate d0/ff 1173146 0 2024-09-12T22:11:28.790 INFO:tasks.workunit.client.0.smithi019.stdout:1/612: chown d1/d2/d18/d35/d84/dc/df/d2c/d5d/c6d 102777 1 2024-09-12T22:11:28.791 INFO:tasks.workunit.client.0.smithi019.stdout:6/666: rmdir d9/d3d/d4f/d8d 39 2024-09-12T22:11:28.791 INFO:tasks.workunit.client.0.smithi019.stdout:5/630: mkdir d0/d1d/d4f/d47/d57/d98/dd6 0 2024-09-12T22:11:28.792 INFO:tasks.workunit.client.0.smithi019.stdout:4/556: dwrite d9/db/d2b/d6a/f81 [0,4194304] 0 2024-09-12T22:11:28.792 INFO:tasks.workunit.client.0.smithi019.stdout:3/593: getdents d18/d1d/d8b/db5 0 2024-09-12T22:11:28.793 INFO:tasks.workunit.client.0.smithi019.stdout:5/631: creat d0/d24/fd7 x:0 0 0 2024-09-12T22:11:28.795 INFO:tasks.workunit.client.0.smithi019.stdout:1/613: truncate d1/d2/d18/d35/d84/dc/df/d2c/f42 347183 0 2024-09-12T22:11:28.795 INFO:tasks.workunit.client.0.smithi019.stdout:1/614: chown d1/d83/fbd 0 1 2024-09-12T22:11:28.795 INFO:tasks.workunit.client.0.smithi019.stdout:6/667: rmdir d9/dc/d20/d4b/d64/d7d/da7/ddc 0 2024-09-12T22:11:28.796 INFO:tasks.workunit.client.0.smithi019.stdout:3/594: chown d18/d26/d30/d4a/f68 5 1 2024-09-12T22:11:28.796 INFO:tasks.workunit.client.0.smithi019.stdout:6/668: fdatasync d9/dc/d20/d4b/f75 0 2024-09-12T22:11:28.797 INFO:tasks.workunit.client.0.smithi019.stdout:3/595: chown d18/d26/d30/d71/d86/fa1 9 1 2024-09-12T22:11:28.797 INFO:tasks.workunit.client.0.smithi019.stdout:1/615: symlink d1/d2/d18/d35/d84/dc/df/d2c/lcb 0 2024-09-12T22:11:28.798 INFO:tasks.workunit.client.0.smithi019.stdout:1/616: fsync d1/d2/d18/d35/d84/dc/df/d53/d66/f8c 0 2024-09-12T22:11:28.798 INFO:tasks.workunit.client.0.smithi019.stdout:5/632: dwrite d0/d26/f32 [0,4194304] 0 2024-09-12T22:11:28.799 INFO:tasks.workunit.client.0.smithi019.stdout:3/596: read d18/d1d/f2b [670745,101720] 0 2024-09-12T22:11:28.800 INFO:tasks.workunit.client.0.smithi019.stdout:3/597: write f8 [3514128,128859] 0 2024-09-12T22:11:28.800 INFO:tasks.workunit.client.0.smithi019.stdout:1/617: write d1/d2/f24 [564818,33284] 0 2024-09-12T22:11:28.802 INFO:tasks.workunit.client.0.smithi019.stdout:1/618: chown d1/d2/d18/d35/d84/dc/df/d61 570930640 1 2024-09-12T22:11:28.802 INFO:tasks.workunit.client.0.smithi019.stdout:3/598: mkdir d18/d1d/d35/d9c/dbb 0 2024-09-12T22:11:28.803 INFO:tasks.workunit.client.0.smithi019.stdout:6/669: dwrite d9/dc/d20/d4b/fb3 [0,4194304] 0 2024-09-12T22:11:28.803 INFO:tasks.workunit.client.0.smithi019.stdout:2/528: dread d0/d31/d12/d15/f33 [0,4194304] 0 2024-09-12T22:11:28.804 INFO:tasks.workunit.client.0.smithi019.stdout:6/670: dread - d9/dc/d20/d71/fd0 zero size 2024-09-12T22:11:28.804 INFO:tasks.workunit.client.0.smithi019.stdout:2/529: chown d0/d3/df/d52 5 1 2024-09-12T22:11:28.806 INFO:tasks.workunit.client.0.smithi019.stdout:7/597: sync 2024-09-12T22:11:28.806 INFO:tasks.workunit.client.0.smithi019.stdout:0/596: sync 2024-09-12T22:11:28.806 INFO:tasks.workunit.client.0.smithi019.stdout:1/619: symlink d1/lcc 0 2024-09-12T22:11:28.808 INFO:tasks.workunit.client.0.smithi019.stdout:7/598: fdatasync da/d24/d28/d1c/f23 0 2024-09-12T22:11:28.809 INFO:tasks.workunit.client.0.smithi019.stdout:1/620: chown d1/d2/d18/d35/d84/dc/df/d53 9 1 2024-09-12T22:11:28.809 INFO:tasks.workunit.client.0.smithi019.stdout:6/671: rename d9/dc/d20/d4b/d64/d7e/f87 to d9/dc/d20/d4b/d64/d78/fde 0 2024-09-12T22:11:28.809 INFO:tasks.workunit.client.0.smithi019.stdout:3/599: dwrite d18/d1d/f3b [0,4194304] 0 2024-09-12T22:11:28.810 INFO:tasks.workunit.client.0.smithi019.stdout:1/621: dread - d1/d83/fbd zero size 2024-09-12T22:11:28.811 INFO:tasks.workunit.client.0.smithi019.stdout:2/530: dread d0/d3/d11/f10 [0,4194304] 0 2024-09-12T22:11:28.811 INFO:tasks.workunit.client.0.smithi019.stdout:1/622: readlink d1/d2/d18/d35/d84/la3 0 2024-09-12T22:11:28.811 INFO:tasks.workunit.client.0.smithi019.stdout:2/531: chown d0/l1e 75367 1 2024-09-12T22:11:28.812 INFO:tasks.workunit.client.0.smithi019.stdout:0/597: rename d5/d7/d2c/d44/d6a/d76/c83 to d5/d87/cc5 0 2024-09-12T22:11:28.812 INFO:tasks.workunit.client.0.smithi019.stdout:7/599: symlink da/d30/da5/lce 0 2024-09-12T22:11:28.812 INFO:tasks.workunit.client.0.smithi019.stdout:3/600: mknod d18/d26/da5/cbc 0 2024-09-12T22:11:28.813 INFO:tasks.workunit.client.0.smithi019.stdout:2/532: creat d0/d3/df/d6b/fab x:0 0 0 2024-09-12T22:11:28.813 INFO:tasks.workunit.client.0.smithi019.stdout:7/600: write da/d24/d28/d1c/d32/f60 [325768,1529] 0 2024-09-12T22:11:28.815 INFO:tasks.workunit.client.0.smithi019.stdout:6/672: dwrite d9/d3d/f3c [4194304,4194304] 0 2024-09-12T22:11:28.818 INFO:tasks.workunit.client.0.smithi019.stdout:9/578: dread d12/d1b/d20/d29/f50 [0,4194304] 0 2024-09-12T22:11:28.818 INFO:tasks.workunit.client.0.smithi019.stdout:6/673: write d9/d3d/d6f/f65 [2348886,50335] 0 2024-09-12T22:11:28.819 INFO:tasks.workunit.client.0.smithi019.stdout:3/601: dread d18/d26/d30/d71/d86/fa1 [0,4194304] 0 2024-09-12T22:11:28.820 INFO:tasks.workunit.client.0.smithi019.stdout:8/589: dread d5/dc/d17/f2b [0,4194304] 0 2024-09-12T22:11:28.821 INFO:tasks.workunit.client.0.smithi019.stdout:0/598: truncate d5/d7/d2c/d44/d6a/d46/f73 3932709 0 2024-09-12T22:11:28.821 INFO:tasks.workunit.client.0.smithi019.stdout:2/533: dwrite d0/d3/d11/d2e/d70/f97 [0,4194304] 0 2024-09-12T22:11:28.822 INFO:tasks.workunit.client.0.smithi019.stdout:6/674: creat d9/d3d/db8/fdf x:0 0 0 2024-09-12T22:11:28.822 INFO:tasks.workunit.client.0.smithi019.stdout:3/602: mkdir d18/d26/da5/dbd 0 2024-09-12T22:11:28.823 INFO:tasks.workunit.client.0.smithi019.stdout:7/601: dwrite da/d24/d28/d1c/d32/f5c [0,4194304] 0 2024-09-12T22:11:28.824 INFO:tasks.workunit.client.0.smithi019.stdout:7/602: truncate da/d19/d25/d39/fa0 254497 0 2024-09-12T22:11:28.825 INFO:tasks.workunit.client.0.smithi019.stdout:7/603: readlink da/d19/d25/d39/lc7 0 2024-09-12T22:11:28.827 INFO:tasks.workunit.client.0.smithi019.stdout:7/604: dread - da/d24/d28/f8b zero size 2024-09-12T22:11:28.827 INFO:tasks.workunit.client.0.smithi019.stdout:2/534: rename d0/d31/d4/c6f to d0/d3/d11/d77/d78/d2c/d56/d60/cac 0 2024-09-12T22:11:28.827 INFO:tasks.workunit.client.0.smithi019.stdout:6/675: write d9/dc/d20/d4b/d64/d7d/da7/fbf [1318364,55139] 0 2024-09-12T22:11:28.828 INFO:tasks.workunit.client.0.smithi019.stdout:0/599: truncate d5/f22 3060680 0 2024-09-12T22:11:28.828 INFO:tasks.workunit.client.0.smithi019.stdout:6/676: readlink d9/l40 0 2024-09-12T22:11:28.829 INFO:tasks.workunit.client.0.smithi019.stdout:0/600: readlink d5/d7/l2d 0 2024-09-12T22:11:28.830 INFO:tasks.workunit.client.0.smithi019.stdout:2/535: write d0/d31/d4/f3f [1608057,103206] 0 2024-09-12T22:11:28.830 INFO:tasks.workunit.client.0.smithi019.stdout:1/623: truncate d1/d2/d18/d35/d84/dc/df/d61/f1b 347944 0 2024-09-12T22:11:28.830 INFO:tasks.workunit.client.0.smithi019.stdout:3/603: creat d18/d1d/fbe x:0 0 0 2024-09-12T22:11:28.831 INFO:tasks.workunit.client.0.smithi019.stdout:4/557: dread d9/d14/f38 [0,4194304] 0 2024-09-12T22:11:28.831 INFO:tasks.workunit.client.0.smithi019.stdout:1/624: fdatasync d1/d37/f65 0 2024-09-12T22:11:28.831 INFO:tasks.workunit.client.0.smithi019.stdout:7/605: truncate da/d24/f2c 247493 0 2024-09-12T22:11:28.831 INFO:tasks.workunit.client.0.smithi019.stdout:6/677: read d9/f4e [2417330,23750] 0 2024-09-12T22:11:28.832 INFO:tasks.workunit.client.0.smithi019.stdout:0/601: chown d5/d7/d2c/f47 47477 1 2024-09-12T22:11:28.832 INFO:tasks.workunit.client.0.smithi019.stdout:4/558: chown d9/c47 167474 1 2024-09-12T22:11:28.832 INFO:tasks.workunit.client.0.smithi019.stdout:9/579: dwrite d12/d1b/f1c [0,4194304] 0 2024-09-12T22:11:28.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/536: creat d0/d3/d11/da9/fad x:0 0 0 2024-09-12T22:11:28.833 INFO:tasks.workunit.client.0.smithi019.stdout:8/590: dwrite d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:28.834 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:28.832+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:28.834 INFO:tasks.workunit.client.0.smithi019.stdout:3/604: write d18/d26/d30/d4e/f6c [1448107,94708] 0 2024-09-12T22:11:28.834 INFO:tasks.workunit.client.0.smithi019.stdout:1/625: readlink d1/d2/d18/d70/lc7 0 2024-09-12T22:11:28.834 INFO:tasks.workunit.client.0.smithi019.stdout:4/559: mkdir d9/d17/db3 0 2024-09-12T22:11:28.835 INFO:tasks.workunit.client.0.smithi019.stdout:9/580: rmdir d12/d1b/d20/d59/d5b 39 2024-09-12T22:11:28.836 INFO:tasks.workunit.client.0.smithi019.stdout:0/602: mknod d5/d7/d2c/d44/cc6 0 2024-09-12T22:11:28.836 INFO:tasks.workunit.client.0.smithi019.stdout:2/537: mkdir d0/d31/d12/d15/dae 0 2024-09-12T22:11:28.836 INFO:tasks.workunit.client.0.smithi019.stdout:6/678: symlink d9/dc/d20/d4b/le0 0 2024-09-12T22:11:28.837 INFO:tasks.workunit.client.0.smithi019.stdout:4/560: truncate d9/db/d2b/f30 3089713 0 2024-09-12T22:11:28.838 INFO:tasks.workunit.client.0.smithi019.stdout:9/581: mknod d12/cc0 0 2024-09-12T22:11:28.838 INFO:tasks.workunit.client.0.smithi019.stdout:6/679: unlink d9/d3d/d4f/d59/f76 0 2024-09-12T22:11:28.838 INFO:tasks.workunit.client.0.smithi019.stdout:2/538: mkdir d0/d3/d11/d2e/d64/daf 0 2024-09-12T22:11:28.838 INFO:tasks.workunit.client.0.smithi019.stdout:1/626: creat d1/fcd x:0 0 0 2024-09-12T22:11:28.839 INFO:tasks.workunit.client.0.smithi019.stdout:2/539: chown d0/d3/d11 82619 1 2024-09-12T22:11:28.839 INFO:tasks.workunit.client.0.smithi019.stdout:0/603: creat d5/d7/db5/fc7 x:0 0 0 2024-09-12T22:11:28.840 INFO:tasks.workunit.client.0.smithi019.stdout:6/680: rmdir d9/d3d/db8 39 2024-09-12T22:11:28.840 INFO:tasks.workunit.client.0.smithi019.stdout:8/591: getdents d5/dc/d8a 0 2024-09-12T22:11:28.840 INFO:tasks.workunit.client.0.smithi019.stdout:3/605: write d18/d26/d30/d4e/f73 [514433,103811] 0 2024-09-12T22:11:28.841 INFO:tasks.workunit.client.0.smithi019.stdout:9/582: stat d12/d1b/d20/d59/d5b/d9e/l6c 0 2024-09-12T22:11:28.841 INFO:tasks.workunit.client.0.smithi019.stdout:2/540: mknod d0/d3/d11/cb0 0 2024-09-12T22:11:28.841 INFO:tasks.workunit.client.0.smithi019.stdout:1/627: write d1/d2/d18/d29/d51/f5c [1912801,121644] 0 2024-09-12T22:11:28.841 INFO:tasks.workunit.client.0.smithi019.stdout:5/633: dread d0/f4 [0,4194304] 0 2024-09-12T22:11:28.842 INFO:tasks.workunit.client.0.smithi019.stdout:0/604: dread - d5/d7/d2c/d44/d6a/d76/fb8 zero size 2024-09-12T22:11:28.842 INFO:tasks.workunit.client.0.smithi019.stdout:3/606: chown d18/d26/l96 4 1 2024-09-12T22:11:28.843 INFO:tasks.workunit.client.0.smithi019.stdout:2/541: readlink d0/d3/d11/d77/d78/l40 0 2024-09-12T22:11:28.843 INFO:tasks.workunit.client.0.smithi019.stdout:1/628: unlink d1/d37/f64 0 2024-09-12T22:11:28.843 INFO:tasks.workunit.client.0.smithi019.stdout:5/634: dread - d0/d1d/d4f/d47/d57/fc0 zero size 2024-09-12T22:11:28.843 INFO:tasks.workunit.client.0.smithi019.stdout:9/583: creat d12/d1b/d20/d59/d5b/d9e/fc1 x:0 0 0 2024-09-12T22:11:28.844 INFO:tasks.workunit.client.0.smithi019.stdout:6/681: dread d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:28.844 INFO:tasks.workunit.client.0.smithi019.stdout:3/607: readlink d18/d1d/dad/lb3 0 2024-09-12T22:11:28.844 INFO:tasks.workunit.client.0.smithi019.stdout:4/561: dwrite d9/db/f99 [0,4194304] 0 2024-09-12T22:11:28.845 INFO:tasks.workunit.client.0.smithi019.stdout:1/629: stat d1/d2/d18/d29/d51/fb0 0 2024-09-12T22:11:28.845 INFO:tasks.workunit.client.0.smithi019.stdout:5/635: write d0/d26/d5f/f8e [2547753,81275] 0 2024-09-12T22:11:28.846 INFO:tasks.workunit.client.0.smithi019.stdout:3/608: write d18/d26/f4b [2539068,37937] 0 2024-09-12T22:11:28.846 INFO:tasks.workunit.client.0.smithi019.stdout:9/584: unlink d12/d1b/c9f 0 2024-09-12T22:11:28.847 INFO:tasks.workunit.client.0.smithi019.stdout:1/630: fdatasync d1/d2/d18/d35/d84/dc/df/f9e 0 2024-09-12T22:11:28.848 INFO:tasks.workunit.client.0.smithi019.stdout:5/636: stat d0/d1d/d3d/c82 0 2024-09-12T22:11:28.849 INFO:tasks.workunit.client.0.smithi019.stdout:9/585: fdatasync d12/d1b/d20/f5c 0 2024-09-12T22:11:28.853 INFO:tasks.workunit.client.0.smithi019.stdout:1/631: creat d1/fce x:0 0 0 2024-09-12T22:11:28.853 INFO:tasks.workunit.client.0.smithi019.stdout:8/592: dread d5/dc/d17/f72 [0,4194304] 0 2024-09-12T22:11:28.854 INFO:tasks.workunit.client.0.smithi019.stdout:9/586: chown d12/d1b/d20/d29/d74/cb5 45481 1 2024-09-12T22:11:28.855 INFO:tasks.workunit.client.0.smithi019.stdout:6/682: dwrite d9/dc/d20/d4b/d64/d7d/da7/fb0 [0,4194304] 0 2024-09-12T22:11:28.857 INFO:tasks.workunit.client.0.smithi019.stdout:2/542: dwrite d0/d3/d11/d77/d78/d2c/d30/d32/f81 [0,4194304] 0 2024-09-12T22:11:28.857 INFO:tasks.workunit.client.0.smithi019.stdout:3/609: dwrite d18/d1d/d35/d9c/fab [0,4194304] 0 2024-09-12T22:11:28.857 INFO:tasks.workunit.client.0.smithi019.stdout:8/593: stat d5/dc/d26/d43/d49/d92/cab 0 2024-09-12T22:11:28.858 INFO:tasks.workunit.client.0.smithi019.stdout:9/587: rename d12/f55 to d12/d1b/d20/d29/fc2 0 2024-09-12T22:11:28.860 INFO:tasks.workunit.client.0.smithi019.stdout:4/562: dwrite d9/d14/d31/d3f/f91 [0,4194304] 0 2024-09-12T22:11:28.861 INFO:tasks.workunit.client.0.smithi019.stdout:8/594: truncate d5/dc/d26/d4b/fb8 730613 0 2024-09-12T22:11:28.861 INFO:tasks.workunit.client.0.smithi019.stdout:4/563: fsync d9/ff 0 2024-09-12T22:11:28.862 INFO:tasks.workunit.client.0.smithi019.stdout:9/588: dread - d12/d1b/d20/d29/d74/d77/f84 zero size 2024-09-12T22:11:28.862 INFO:tasks.workunit.client.0.smithi019.stdout:1/632: mknod d1/d2/d18/d35/d84/dc/df/d53/ccf 0 2024-09-12T22:11:28.865 INFO:tasks.workunit.client.0.smithi019.stdout:9/589: dread - d12/d1b/d20/d29/d74/d77/f84 zero size 2024-09-12T22:11:28.866 INFO:tasks.workunit.client.0.smithi019.stdout:6/683: dwrite d9/dc/d20/d4b/d6c/f91 [0,4194304] 0 2024-09-12T22:11:28.868 INFO:tasks.workunit.client.0.smithi019.stdout:6/684: fsync d9/f57 0 2024-09-12T22:11:28.871 INFO:tasks.workunit.client.0.smithi019.stdout:2/543: dwrite d0/d3/df/f2a [0,4194304] 0 2024-09-12T22:11:28.871 INFO:tasks.workunit.client.0.smithi019.stdout:0/605: dread d5/d7/de/fa7 [0,4194304] 0 2024-09-12T22:11:28.871 INFO:tasks.workunit.client.0.smithi019.stdout:9/590: symlink d12/d1b/d20/d29/d56/lc3 0 2024-09-12T22:11:28.871 INFO:tasks.workunit.client.0.smithi019.stdout:8/595: dwrite d5/d16/f28 [0,4194304] 0 2024-09-12T22:11:28.872 INFO:tasks.workunit.client.0.smithi019.stdout:6/685: readlink d9/dc/d20/l16 0 2024-09-12T22:11:28.872 INFO:tasks.workunit.client.0.smithi019.stdout:1/633: read d1/f14 [308852,102453] 0 2024-09-12T22:11:28.872 INFO:tasks.workunit.client.0.smithi019.stdout:8/596: creat d5/d53/d66/fc1 x:0 0 0 2024-09-12T22:11:28.872 INFO:tasks.workunit.client.0.smithi019.stdout:4/564: dwrite d9/d58/f68 [4194304,4194304] 0 2024-09-12T22:11:28.873 INFO:tasks.workunit.client.0.smithi019.stdout:7/606: sync 2024-09-12T22:11:28.876 INFO:tasks.workunit.client.0.smithi019.stdout:9/591: symlink d12/d1b/d20/d29/d74/d77/d86/dbd/lc4 0 2024-09-12T22:11:28.876 INFO:tasks.workunit.client.0.smithi019.stdout:6/686: creat d9/d3d/d4f/d8d/fe1 x:0 0 0 2024-09-12T22:11:28.876 INFO:tasks.workunit.client.0.smithi019.stdout:9/592: chown d12/l13 65167438 1 2024-09-12T22:11:28.877 INFO:tasks.workunit.client.0.smithi019.stdout:2/544: link d0/d3/d11/d2e/d64/f6d d0/d3/d11/d2e/d64/fb1 0 2024-09-12T22:11:28.877 INFO:tasks.workunit.client.0.smithi019.stdout:4/565: write d9/d58/f77 [978551,29247] 0 2024-09-12T22:11:28.877 INFO:tasks.workunit.client.0.smithi019.stdout:4/566: readlink d9/d17/l92 0 2024-09-12T22:11:28.878 INFO:tasks.workunit.client.0.smithi019.stdout:0/606: dread d5/d7/d2c/f75 [0,4194304] 0 2024-09-12T22:11:28.878 INFO:tasks.workunit.client.0.smithi019.stdout:1/634: link d1/l3 d1/d2/d18/d29/d27/ld0 0 2024-09-12T22:11:28.878 INFO:tasks.workunit.client.0.smithi019.stdout:2/545: creat d0/d31/d12/d15/fb2 x:0 0 0 2024-09-12T22:11:28.878 INFO:tasks.workunit.client.0.smithi019.stdout:6/687: rename d9/d3d/f3c to d9/dc/d20/d30/db7/fe2 0 2024-09-12T22:11:28.879 INFO:tasks.workunit.client.0.smithi019.stdout:9/593: creat d12/d1b/d20/d29/d92/fc5 x:0 0 0 2024-09-12T22:11:28.879 INFO:tasks.workunit.client.0.smithi019.stdout:7/607: link da/d24/d28/d1c/d32/f5c da/d24/fcf 0 2024-09-12T22:11:28.880 INFO:tasks.workunit.client.0.smithi019.stdout:6/688: fsync d9/dc/d20/d4b/d64/d7d/da7/fbf 0 2024-09-12T22:11:28.881 INFO:tasks.workunit.client.0.smithi019.stdout:4/567: getdents d9/d14/d31 0 2024-09-12T22:11:28.881 INFO:tasks.workunit.client.0.smithi019.stdout:7/608: write da/d19/d25/d39/fa0 [935858,66526] 0 2024-09-12T22:11:28.881 INFO:tasks.workunit.client.0.smithi019.stdout:8/597: dwrite d5/dc/d26/f30 [0,4194304] 0 2024-09-12T22:11:28.882 INFO:tasks.workunit.client.0.smithi019.stdout:7/609: readlink da/d24/l81 0 2024-09-12T22:11:28.882 INFO:tasks.workunit.client.0.smithi019.stdout:8/598: fdatasync d5/f42 0 2024-09-12T22:11:28.882 INFO:tasks.workunit.client.0.smithi019.stdout:6/689: write d9/dc/d20/d4b/d6c/f70 [25024,75887] 0 2024-09-12T22:11:28.884 INFO:tasks.workunit.client.0.smithi019.stdout:9/594: write d12/d1b/d20/d59/d5b/d9e/f39 [1871792,10429] 0 2024-09-12T22:11:28.884 INFO:tasks.workunit.client.0.smithi019.stdout:7/610: mknod da/d30/d53/db1/cd0 0 2024-09-12T22:11:28.885 INFO:tasks.workunit.client.0.smithi019.stdout:8/599: write d5/d16/d19/f45 [9868,102206] 0 2024-09-12T22:11:28.886 INFO:tasks.workunit.client.0.smithi019.stdout:1/635: truncate d1/d2/d18/d35/d84/dc/f32 515763 0 2024-09-12T22:11:28.886 INFO:tasks.workunit.client.0.smithi019.stdout:6/690: getdents d9 0 2024-09-12T22:11:28.887 INFO:tasks.workunit.client.0.smithi019.stdout:9/595: chown d12/d1b/d20/d29/cae 42719 1 2024-09-12T22:11:28.887 INFO:tasks.workunit.client.0.smithi019.stdout:8/600: creat d5/d16/fc2 x:0 0 0 2024-09-12T22:11:28.888 INFO:tasks.workunit.client.0.smithi019.stdout:7/611: mknod da/d24/d28/d1c/d32/d5e/dc3/cd1 0 2024-09-12T22:11:28.889 INFO:tasks.workunit.client.0.smithi019.stdout:4/568: dwrite d9/d17/f1d [0,4194304] 0 2024-09-12T22:11:28.889 INFO:tasks.workunit.client.0.smithi019.stdout:5/637: dread d0/d26/d42/fb2 [0,4194304] 0 2024-09-12T22:11:28.889 INFO:tasks.workunit.client.0.smithi019.stdout:1/636: symlink d1/d2/d18/d35/d84/ld1 0 2024-09-12T22:11:28.890 INFO:tasks.workunit.client.0.smithi019.stdout:0/607: dwrite d5/d7/f12 [0,4194304] 0 2024-09-12T22:11:28.893 INFO:tasks.workunit.client.0.smithi019.stdout:8/601: rename d5/d53/d66/d69 to d5/d53/d66/d69/dc3 22 2024-09-12T22:11:28.893 INFO:tasks.workunit.client.0.smithi019.stdout:6/691: readlink d9/dc/d20/d4b/d64/d78/da1/lb1 0 2024-09-12T22:11:28.893 INFO:tasks.workunit.client.0.smithi019.stdout:9/596: fdatasync d12/d1b/d40/d52/f65 0 2024-09-12T22:11:28.894 INFO:tasks.workunit.client.0.smithi019.stdout:5/638: truncate d0/d1d/d6d/dca/fbb 963143 0 2024-09-12T22:11:28.894 INFO:tasks.workunit.client.0.smithi019.stdout:6/692: creat d9/dc/d20/d30/d5b/fe3 x:0 0 0 2024-09-12T22:11:28.894 INFO:tasks.workunit.client.0.smithi019.stdout:9/597: rename d12/c41 to d12/d1b/d20/dbc/cc6 0 2024-09-12T22:11:28.895 INFO:tasks.workunit.client.0.smithi019.stdout:7/612: link da/d8f/la7 da/d24/d9d/ld2 0 2024-09-12T22:11:28.895 INFO:tasks.workunit.client.0.smithi019.stdout:5/639: chown d0/cc2 23588020 1 2024-09-12T22:11:28.895 INFO:tasks.workunit.client.0.smithi019.stdout:9/598: rmdir d12/d1b/d20/d59/d5b/d9a 39 2024-09-12T22:11:28.895 INFO:tasks.workunit.client.0.smithi019.stdout:7/613: chown da/d30/lbd 1 1 2024-09-12T22:11:28.896 INFO:tasks.workunit.client.0.smithi019.stdout:9/599: rename d12/d1b/d20/d29 to d12/d1b/d20/d64/d83/db4/dc7 0 2024-09-12T22:11:28.896 INFO:tasks.workunit.client.0.smithi019.stdout:5/640: fdatasync d0/d1d/d6d/f94 0 2024-09-12T22:11:28.897 INFO:tasks.workunit.client.0.smithi019.stdout:7/614: rename da/d24/d28/d1c/d32/daf/cbe to da/d30/d53/db1/cd3 0 2024-09-12T22:11:28.897 INFO:tasks.workunit.client.0.smithi019.stdout:5/641: symlink d0/dbf/ld8 0 2024-09-12T22:11:28.898 INFO:tasks.workunit.client.0.smithi019.stdout:6/693: truncate d9/dc/d20/d4b/f2d 7894758 0 2024-09-12T22:11:28.899 INFO:tasks.workunit.client.0.smithi019.stdout:5/642: mknod d0/d1d/cd9 0 2024-09-12T22:11:28.899 INFO:tasks.workunit.client.0.smithi019.stdout:9/600: creat d12/d1b/d20/d64/d83/db4/dc7/d92/dac/fc8 x:0 0 0 2024-09-12T22:11:28.899 INFO:tasks.workunit.client.0.smithi019.stdout:2/546: dread d0/d3/df/d6b/f86 [0,4194304] 0 2024-09-12T22:11:28.899 INFO:tasks.workunit.client.0.smithi019.stdout:4/569: dread d9/d4c/d9c/f9e [0,4194304] 0 2024-09-12T22:11:28.900 INFO:tasks.workunit.client.0.smithi019.stdout:6/694: mkdir d9/d3d/d4f/d59/d79/de4 0 2024-09-12T22:11:28.900 INFO:tasks.workunit.client.0.smithi019.stdout:9/601: symlink d12/lc9 0 2024-09-12T22:11:28.902 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:28.903 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:28.903 INFO:tasks.workunit.client.0.smithi019.stdout:6/695: readlink d9/dc/d20/d71/la4 0 2024-09-12T22:11:28.903 INFO:tasks.workunit.client.0.smithi019.stdout:8/602: dwrite d5/dc/d17/f72 [0,4194304] 0 2024-09-12T22:11:28.903 INFO:tasks.workunit.client.0.smithi019.stdout:5/643: rmdir d0/d1d/d4f/d96 39 2024-09-12T22:11:28.904 INFO:tasks.workunit.client.0.smithi019.stdout:9/602: unlink d12/d1b/d20/d59/d5b/d9e/l6c 0 2024-09-12T22:11:28.905 INFO:tasks.workunit.client.0.smithi019.stdout:6/696: stat d9/dc/d20/c47 0 2024-09-12T22:11:28.907 INFO:tasks.workunit.client.0.smithi019.stdout:5/644: rename d0/d24/d97/dcf to d0/d24/d97/dda 0 2024-09-12T22:11:28.907 INFO:tasks.workunit.client.0.smithi019.stdout:3/610: dread f9 [4194304,4194304] 0 2024-09-12T22:11:28.908 INFO:tasks.workunit.client.0.smithi019.stdout:8/603: link d5/dc/ff d5/d16/d19/d29/fc4 0 2024-09-12T22:11:28.909 INFO:tasks.workunit.client.0.smithi019.stdout:7/615: dwrite da/d24/d28/d1c/d32/f5c [0,4194304] 0 2024-09-12T22:11:28.909 INFO:tasks.workunit.client.0.smithi019.stdout:6/697: creat d9/dc/d20/d30/d5b/fe5 x:0 0 0 2024-09-12T22:11:28.909 INFO:tasks.workunit.client.0.smithi019.stdout:4/570: dwrite d9/d14/d57/f7c [0,4194304] 0 2024-09-12T22:11:28.909 INFO:tasks.workunit.client.0.smithi019.stdout:3/611: chown d18/d26/d30/f67 26629 1 2024-09-12T22:11:28.909 INFO:tasks.workunit.client.0.smithi019.stdout:9/603: mknod d12/d1b/d20/d64/d83/db4/dc7/d74/d77/d86/cca 0 2024-09-12T22:11:28.911 INFO:tasks.workunit.client.0.smithi019.stdout:8/604: symlink d5/dc/d17/lc5 0 2024-09-12T22:11:28.911 INFO:tasks.workunit.client.0.smithi019.stdout:5/645: mkdir d0/d1d/d4f/d47/d57/dba/ddb 0 2024-09-12T22:11:28.911 INFO:tasks.workunit.client.0.smithi019.stdout:3/612: creat d18/d26/da5/fbf x:0 0 0 2024-09-12T22:11:28.911 INFO:tasks.workunit.client.0.smithi019.stdout:4/571: mknod d9/db/d2b/cb4 0 2024-09-12T22:11:28.911 INFO:tasks.workunit.client.0.smithi019.stdout:6/698: creat d9/dc/dd9/fe6 x:0 0 0 2024-09-12T22:11:28.911 INFO:tasks.workunit.client.0.smithi019.stdout:1/637: dread d1/d2/d18/d35/d84/dc/df/d53/d55/d56/f94 [4194304,4194304] 0 2024-09-12T22:11:28.915 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:28.916 INFO:tasks.workunit.client.0.smithi019.stdout:5/646: creat d0/d24/d97/fdc x:0 0 0 2024-09-12T22:11:28.916 INFO:tasks.workunit.client.0.smithi019.stdout:3/613: getdents d18/d26/d30/d4e 0 2024-09-12T22:11:28.917 INFO:tasks.workunit.client.0.smithi019.stdout:3/614: rmdir d18/d26/d30 39 2024-09-12T22:11:28.918 INFO:tasks.workunit.client.0.smithi019.stdout:9/604: write d12/d1b/d20/d64/d83/db4/dc7/d88/f89 [1622064,94825] 0 2024-09-12T22:11:28.918 INFO:tasks.workunit.client.0.smithi019.stdout:7/616: dwrite da/d8f/f84 [0,4194304] 0 2024-09-12T22:11:28.918 INFO:tasks.workunit.client.0.smithi019.stdout:1/638: creat d1/d2/d18/d35/d84/dc/df/d2c/fd2 x:0 0 0 2024-09-12T22:11:28.921 INFO:tasks.workunit.client.0.smithi019.stdout:6/699: dwrite d9/dc/d20/d4b/d6c/f70 [0,4194304] 0 2024-09-12T22:11:28.923 INFO:tasks.workunit.client.0.smithi019.stdout:1/639: unlink d1/d2/d18/d35/d84/dc/f19 0 2024-09-12T22:11:28.923 INFO:tasks.workunit.client.0.smithi019.stdout:5/647: dwrite d0/d26/d3a/fb5 [0,4194304] 0 2024-09-12T22:11:28.923 INFO:tasks.workunit.client.0.smithi019.stdout:9/605: mknod d12/d1b/ccb 0 2024-09-12T22:11:28.924 INFO:tasks.workunit.client.0.smithi019.stdout:7/617: rmdir da/d30/dc5 0 2024-09-12T22:11:28.924 INFO:tasks.workunit.client.0.smithi019.stdout:6/700: read d9/dc/d20/f2e [178898,102260] 0 2024-09-12T22:11:28.924 INFO:tasks.workunit.client.0.smithi019.stdout:4/572: dwrite d9/d14/d33/f4b [0,4194304] 0 2024-09-12T22:11:28.928 INFO:tasks.workunit.client.0.smithi019.stdout:1/640: unlink d1/d2/f7 0 2024-09-12T22:11:28.928 INFO:tasks.workunit.client.0.smithi019.stdout:5/648: write d0/d24/d7a/f8f [1553628,67696] 0 2024-09-12T22:11:28.930 INFO:tasks.workunit.client.0.smithi019.stdout:9/606: creat d12/d1b/d20/d64/d83/db4/dc7/d74/d77/fcc x:0 0 0 2024-09-12T22:11:28.932 INFO:tasks.workunit.client.0.smithi019.stdout:4/573: creat d9/d73/d8f/d93/fb5 x:0 0 0 2024-09-12T22:11:28.932 INFO:tasks.workunit.client.0.smithi019.stdout:9/607: chown d12/d1b/d20/d64/d83/db4/dc7/d56/f81 2 1 2024-09-12T22:11:28.932 INFO:tasks.workunit.client.0.smithi019.stdout:5/649: creat d0/d1d/d4f/d47/fdd x:0 0 0 2024-09-12T22:11:28.932 INFO:tasks.workunit.client.0.smithi019.stdout:1/641: symlink d1/d2/d18/d35/d84/d98/dbc/ld3 0 2024-09-12T22:11:28.934 INFO:tasks.workunit.client.0.smithi019.stdout:3/615: dwrite d18/d26/d30/d4e/f59 [0,4194304] 0 2024-09-12T22:11:28.934 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:28.933+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:28.934 INFO:tasks.workunit.client.0.smithi019.stdout:4/574: creat d9/d14/d31/fb6 x:0 0 0 2024-09-12T22:11:28.935 INFO:tasks.workunit.client.0.smithi019.stdout:9/608: creat d12/d48/fcd x:0 0 0 2024-09-12T22:11:28.935 INFO:tasks.workunit.client.0.smithi019.stdout:5/650: creat d0/d26/fde x:0 0 0 2024-09-12T22:11:28.935 INFO:tasks.workunit.client.0.smithi019.stdout:3/616: creat d18/d1d/d8b/fc0 x:0 0 0 2024-09-12T22:11:28.935 INFO:tasks.workunit.client.0.smithi019.stdout:5/651: symlink d0/d26/ldf 0 2024-09-12T22:11:28.939 INFO:tasks.workunit.client.0.smithi019.stdout:4/575: truncate d9/d14/d33/f4b 840855 0 2024-09-12T22:11:28.941 INFO:tasks.workunit.client.0.smithi019.stdout:3/617: dwrite d18/d26/d30/d4a/f62 [0,4194304] 0 2024-09-12T22:11:28.943 INFO:tasks.workunit.client.0.smithi019.stdout:1/642: dwrite d1/d2/d18/d29/d51/f85 [0,4194304] 0 2024-09-12T22:11:28.943 INFO:tasks.workunit.client.0.smithi019.stdout:8/605: dread d5/d16/d19/f50 [0,4194304] 0 2024-09-12T22:11:28.944 INFO:tasks.workunit.client.0.smithi019.stdout:3/618: symlink d18/d1d/d35/lc1 0 2024-09-12T22:11:28.945 INFO:tasks.workunit.client.0.smithi019.stdout:2/547: dread d0/d31/d4/f22 [4194304,4194304] 0 2024-09-12T22:11:28.946 INFO:tasks.workunit.client.0.smithi019.stdout:0/608: dread d5/d7/f4a [0,4194304] 0 2024-09-12T22:11:28.947 INFO:tasks.workunit.client.0.smithi019.stdout:1/643: getdents d1/d2/d18/d29/d27 0 2024-09-12T22:11:28.948 INFO:tasks.workunit.client.0.smithi019.stdout:3/619: read d18/d58/f7b [3054534,105983] 0 2024-09-12T22:11:28.949 INFO:tasks.workunit.client.0.smithi019.stdout:4/576: dwrite d9/d14/d31/fb6 [0,4194304] 0 2024-09-12T22:11:28.951 INFO:tasks.workunit.client.0.smithi019.stdout:1/644: mknod d1/d2/d18/d35/d84/dc/df/d53/d55/d56/cd4 0 2024-09-12T22:11:28.952 INFO:tasks.workunit.client.0.smithi019.stdout:4/577: rename d9/d14/d33/f6b to d9/d14/fb7 0 2024-09-12T22:11:28.953 INFO:tasks.workunit.client.0.smithi019.stdout:5/652: dread d0/d24/d7a/f9a [0,4194304] 0 2024-09-12T22:11:28.953 INFO:tasks.workunit.client.0.smithi019.stdout:3/620: rename d18/d1d/d35/d9c/fa7 to d18/d1d/dad/fc2 0 2024-09-12T22:11:28.953 INFO:tasks.workunit.client.0.smithi019.stdout:1/645: mknod d1/d2/d18/d35/cd5 0 2024-09-12T22:11:28.953 INFO:tasks.workunit.client.0.smithi019.stdout:5/653: creat d0/d24/d58/fe0 x:0 0 0 2024-09-12T22:11:28.954 INFO:tasks.workunit.client.0.smithi019.stdout:2/548: dwrite d0/d31/d12/d15/fb2 [0,4194304] 0 2024-09-12T22:11:28.955 INFO:tasks.workunit.client.0.smithi019.stdout:1/646: creat d1/fd6 x:0 0 0 2024-09-12T22:11:28.955 INFO:tasks.workunit.client.0.smithi019.stdout:2/549: readlink d0/l3d 0 2024-09-12T22:11:28.956 INFO:tasks.workunit.client.0.smithi019.stdout:5/654: mknod d0/d1d/d4f/d96/ce1 0 2024-09-12T22:11:28.956 INFO:tasks.workunit.client.0.smithi019.stdout:7/618: sync 2024-09-12T22:11:28.956 INFO:tasks.workunit.client.0.smithi019.stdout:3/621: write d18/d26/d30/d4a/f68 [174189,102893] 0 2024-09-12T22:11:28.957 INFO:tasks.workunit.client.0.smithi019.stdout:2/550: fdatasync d0/d3/d11/d2e/d64/f6d 0 2024-09-12T22:11:28.958 INFO:tasks.workunit.client.0.smithi019.stdout:7/619: symlink da/d30/da5/ld4 0 2024-09-12T22:11:28.958 INFO:tasks.workunit.client.0.smithi019.stdout:3/622: chown d18/d26/d30/c78 9442 1 2024-09-12T22:11:28.958 INFO:tasks.workunit.client.0.smithi019.stdout:1/647: symlink d1/d2/d18/d35/d84/ld7 0 2024-09-12T22:11:28.958 INFO:tasks.workunit.client.0.smithi019.stdout:2/551: symlink d0/d3/df/lb3 0 2024-09-12T22:11:28.959 INFO:tasks.workunit.client.0.smithi019.stdout:3/623: creat d18/d58/fc3 x:0 0 0 2024-09-12T22:11:28.959 INFO:tasks.workunit.client.0.smithi019.stdout:8/606: dread d5/dc/d26/d5c/f93 [0,4194304] 0 2024-09-12T22:11:28.959 INFO:tasks.workunit.client.0.smithi019.stdout:4/578: dwrite d9/d14/d57/d5e/f7f [4194304,4194304] 0 2024-09-12T22:11:28.959 INFO:tasks.workunit.client.0.smithi019.stdout:5/655: truncate d0/d4e/d50/fcc 665485 0 2024-09-12T22:11:28.960 INFO:tasks.workunit.client.0.smithi019.stdout:1/648: mknod d1/d2/cd8 0 2024-09-12T22:11:28.961 INFO:tasks.workunit.client.0.smithi019.stdout:2/552: stat d0/d3/d11/d2e/d64 0 2024-09-12T22:11:28.961 INFO:tasks.workunit.client.0.smithi019.stdout:3/624: symlink d18/d1d/dad/lc4 0 2024-09-12T22:11:28.961 INFO:tasks.workunit.client.0.smithi019.stdout:5/656: symlink d0/d1d/le2 0 2024-09-12T22:11:28.962 INFO:tasks.workunit.client.0.smithi019.stdout:8/607: symlink d5/dc/d8d/d96/lc6 0 2024-09-12T22:11:28.963 INFO:tasks.workunit.client.0.smithi019.stdout:2/553: dread - d0/d31/d12/f83 zero size 2024-09-12T22:11:28.963 INFO:tasks.workunit.client.0.smithi019.stdout:3/625: chown d18/d26/d30/d4e/d80 29849 1 2024-09-12T22:11:28.963 INFO:tasks.workunit.client.0.smithi019.stdout:1/649: creat d1/d2/d18/d29/d27/fd9 x:0 0 0 2024-09-12T22:11:28.963 INFO:tasks.workunit.client.0.smithi019.stdout:4/579: getdents d9/d73/d8f 0 2024-09-12T22:11:28.964 INFO:tasks.workunit.client.0.smithi019.stdout:5/657: rmdir d0/d1d/d4f/d47/d57/d98 39 2024-09-12T22:11:28.964 INFO:tasks.workunit.client.0.smithi019.stdout:4/580: fdatasync d9/d14/fa2 0 2024-09-12T22:11:28.965 INFO:tasks.workunit.client.0.smithi019.stdout:2/554: creat d0/d31/d12/d3b/d5c/fb4 x:0 0 0 2024-09-12T22:11:28.965 INFO:tasks.workunit.client.0.smithi019.stdout:0/609: sync 2024-09-12T22:11:28.965 INFO:tasks.workunit.client.0.smithi019.stdout:8/608: mknod d5/d53/d66/d69/cc7 0 2024-09-12T22:11:28.965 INFO:tasks.workunit.client.0.smithi019.stdout:3/626: fdatasync d18/f56 0 2024-09-12T22:11:28.965 INFO:tasks.workunit.client.0.smithi019.stdout:7/620: dwrite da/d19/d79/fb3 [0,4194304] 0 2024-09-12T22:11:28.966 INFO:tasks.workunit.client.0.smithi019.stdout:4/581: chown d9/d58/fb0 310 1 2024-09-12T22:11:28.966 INFO:tasks.workunit.client.0.smithi019.stdout:2/555: chown d0/d3/d11/d2e/c53 5982186 1 2024-09-12T22:11:28.966 INFO:tasks.workunit.client.0.smithi019.stdout:4/582: chown d9/d14/d57/d5e 3464 1 2024-09-12T22:11:28.967 INFO:tasks.workunit.client.0.smithi019.stdout:7/621: chown da/d19/d25/d39/d51/f75 7726352 1 2024-09-12T22:11:28.968 INFO:tasks.workunit.client.0.smithi019.stdout:3/627: rename d18/d1d/d35/d9c to d18/d1d/d8b/dc5 0 2024-09-12T22:11:28.968 INFO:tasks.workunit.client.0.smithi019.stdout:8/609: fsync d5/d16/f63 0 2024-09-12T22:11:28.969 INFO:tasks.workunit.client.0.smithi019.stdout:1/650: link d1/d2/d18/d35/d84/dc/df/d61/f34 d1/d2/d18/d35/fda 0 2024-09-12T22:11:28.970 INFO:tasks.workunit.client.0.smithi019.stdout:7/622: write da/d19/f88 [5069596,129485] 0 2024-09-12T22:11:28.970 INFO:tasks.workunit.client.0.smithi019.stdout:4/583: rename d9/d14/d57/d9b/cb2 to d9/cb8 0 2024-09-12T22:11:28.970 INFO:tasks.workunit.client.0.smithi019.stdout:5/658: read d0/d1d/f33 [48133,87188] 0 2024-09-12T22:11:28.970 INFO:tasks.workunit.client.0.smithi019.stdout:3/628: write d18/f56 [81839,49068] 0 2024-09-12T22:11:28.972 INFO:tasks.workunit.client.0.smithi019.stdout:3/629: chown d18/lba 196 1 2024-09-12T22:11:28.972 INFO:tasks.workunit.client.0.smithi019.stdout:6/701: dread d9/dc/f15 [0,4194304] 0 2024-09-12T22:11:28.972 INFO:tasks.workunit.client.0.smithi019.stdout:4/584: fsync d9/d14/fa5 0 2024-09-12T22:11:28.973 INFO:tasks.workunit.client.0.smithi019.stdout:0/610: truncate d5/d7/d10/d26/d2a/f65 3495910 0 2024-09-12T22:11:28.975 INFO:tasks.workunit.client.0.smithi019.stdout:7/623: rename da/d24/d28/l1e to da/d19/d79/ld5 0 2024-09-12T22:11:28.975 INFO:tasks.workunit.client.0.smithi019.stdout:2/556: dwrite d0/d31/d4/f3f [4194304,4194304] 0 2024-09-12T22:11:28.975 INFO:tasks.workunit.client.0.smithi019.stdout:9/609: dread d12/d1b/d20/f36 [0,4194304] 0 2024-09-12T22:11:28.975 INFO:tasks.workunit.client.0.smithi019.stdout:5/659: creat d0/d26/d5f/fe3 x:0 0 0 2024-09-12T22:11:28.977 INFO:tasks.workunit.client.0.smithi019.stdout:6/702: symlink d9/dc/d20/d4b/d6c/d8c/le7 0 2024-09-12T22:11:28.977 INFO:tasks.workunit.client.0.smithi019.stdout:0/611: readlink d5/d7/d2c/d44/d6a/d46/l89 0 2024-09-12T22:11:28.977 INFO:tasks.workunit.client.0.smithi019.stdout:2/557: stat d0/d3/df/f37 0 2024-09-12T22:11:28.978 INFO:tasks.workunit.client.0.smithi019.stdout:2/558: sync 2024-09-12T22:11:28.979 INFO:tasks.workunit.client.0.smithi019.stdout:4/585: link d9/d14/fa2 d9/d14/d57/fb9 0 2024-09-12T22:11:28.979 INFO:tasks.workunit.client.0.smithi019.stdout:6/703: unlink d9/dc/d20/c35 0 2024-09-12T22:11:28.980 INFO:tasks.workunit.client.0.smithi019.stdout:8/610: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:28.980 INFO:tasks.workunit.client.0.smithi019.stdout:2/559: dread - d0/d3/df/d7b/fa1 zero size 2024-09-12T22:11:28.981 INFO:tasks.workunit.client.0.smithi019.stdout:9/610: creat d12/d1b/d20/fce x:0 0 0 2024-09-12T22:11:28.981 INFO:tasks.workunit.client.0.smithi019.stdout:3/630: truncate d18/d26/d30/f3c 7037007 0 2024-09-12T22:11:28.981 INFO:tasks.workunit.client.0.smithi019.stdout:1/651: dwrite d1/d2/d18/d35/d84/dc/f50 [0,4194304] 0 2024-09-12T22:11:28.981 INFO:tasks.workunit.client.0.smithi019.stdout:5/660: rename d0/d26/fde to d0/d1d/d3d/fe4 0 2024-09-12T22:11:28.982 INFO:tasks.workunit.client.0.smithi019.stdout:7/624: truncate da/d24/d28/d1c/f23 190057 0 2024-09-12T22:11:28.982 INFO:tasks.workunit.client.0.smithi019.stdout:0/612: getdents d5/d7/d2c/d44/db7 0 2024-09-12T22:11:28.983 INFO:tasks.workunit.client.0.smithi019.stdout:3/631: fdatasync d18/d26/d30/f67 0 2024-09-12T22:11:28.983 INFO:tasks.workunit.client.0.smithi019.stdout:8/611: fdatasync d5/dc/d26/d43/d49/d92/fa6 0 2024-09-12T22:11:28.983 INFO:tasks.workunit.client.0.smithi019.stdout:2/560: creat d0/d3/df/d6b/fb5 x:0 0 0 2024-09-12T22:11:28.983 INFO:tasks.workunit.client.0.smithi019.stdout:9/611: rename d12/d1b/d40/d85/la9 to d12/d48/lcf 0 2024-09-12T22:11:28.984 INFO:tasks.workunit.client.0.smithi019.stdout:7/625: creat da/d8f/fd6 x:0 0 0 2024-09-12T22:11:28.984 INFO:tasks.workunit.client.0.smithi019.stdout:1/652: write d1/fce [279924,114987] 0 2024-09-12T22:11:28.985 INFO:tasks.workunit.client.0.smithi019.stdout:4/586: getdents d9/d58 0 2024-09-12T22:11:28.985 INFO:tasks.workunit.client.0.smithi019.stdout:6/704: read d9/dc/d20/d4b/d6c/d8c/fd8 [109496,66649] 0 2024-09-12T22:11:28.985 INFO:tasks.workunit.client.0.smithi019.stdout:0/613: write d5/d7/f5f [1112657,108749] 0 2024-09-12T22:11:28.985 INFO:tasks.workunit.client.0.smithi019.stdout:8/612: chown d5/d16/d19/d29/cad 1 1 2024-09-12T22:11:28.985 INFO:tasks.workunit.client.0.smithi019.stdout:3/632: unlink d18/d26/d30/d4e/f60 0 2024-09-12T22:11:28.986 INFO:tasks.workunit.client.0.smithi019.stdout:5/661: getdents d0/d1d/d4f/d47 0 2024-09-12T22:11:28.986 INFO:tasks.workunit.client.0.smithi019.stdout:7/626: read - da/d8f/fb4 zero size 2024-09-12T22:11:28.986 INFO:tasks.workunit.client.0.smithi019.stdout:1/653: mkdir d1/ddb 0 2024-09-12T22:11:28.987 INFO:tasks.workunit.client.0.smithi019.stdout:2/561: symlink d0/d3/d11/d77/d78/d2c/d30/d32/lb6 0 2024-09-12T22:11:28.988 INFO:tasks.workunit.client.0.smithi019.stdout:6/705: symlink d9/dc/d20/d4b/d64/d7d/le8 0 2024-09-12T22:11:28.988 INFO:tasks.workunit.client.0.smithi019.stdout:3/633: creat d18/d26/d30/d4e/d9a/dae/fc6 x:0 0 0 2024-09-12T22:11:28.989 INFO:tasks.workunit.client.0.smithi019.stdout:7/627: rename da/d30/d53 to da/d19/d25/d39/d51/dd7 0 2024-09-12T22:11:28.990 INFO:tasks.workunit.client.0.smithi019.stdout:5/662: truncate d0/d24/fb1 2905050 0 2024-09-12T22:11:28.991 INFO:tasks.workunit.client.0.smithi019.stdout:0/614: rename d5/d7/d2c/d44/d6a/f59 to d5/d7/d2c/d44/d6a/fc8 0 2024-09-12T22:11:28.992 INFO:tasks.workunit.client.0.smithi019.stdout:7/628: fsync da/d19/d79/f90 0 2024-09-12T22:11:28.992 INFO:tasks.workunit.client.0.smithi019.stdout:1/654: write d1/d2/d18/d35/d84/dc/df/d61/f44 [5579416,72056] 0 2024-09-12T22:11:28.992 INFO:tasks.workunit.client.0.smithi019.stdout:3/634: dread - d18/d26/da5/fbf zero size 2024-09-12T22:11:28.992 INFO:tasks.workunit.client.0.smithi019.stdout:2/562: truncate d0/d3/df/d7b/d44/f93 1689654 0 2024-09-12T22:11:28.993 INFO:tasks.workunit.client.0.smithi019.stdout:7/629: fdatasync da/f7c 0 2024-09-12T22:11:28.995 INFO:tasks.workunit.client.0.smithi019.stdout:3/635: readlink d18/d26/d30/d4a/l95 0 2024-09-12T22:11:28.997 INFO:tasks.workunit.client.0.smithi019.stdout:4/587: dwrite d9/d14/d31/f5c [0,4194304] 0 2024-09-12T22:11:28.997 INFO:tasks.workunit.client.0.smithi019.stdout:6/706: truncate d9/dc/d20/d71/fd0 436078 0 2024-09-12T22:11:28.998 INFO:tasks.workunit.client.0.smithi019.stdout:9/612: dwrite d12/d1b/d20/d64/d83/db4/dc7/d56/f79 [0,4194304] 0 2024-09-12T22:11:28.998 INFO:tasks.workunit.client.0.smithi019.stdout:2/563: mkdir d0/d3/df/d7b/d44/db7 0 2024-09-12T22:11:28.999 INFO:tasks.workunit.client.0.smithi019.stdout:4/588: mknod d9/d14/d57/d5e/cba 0 2024-09-12T22:11:29.000 INFO:tasks.workunit.client.0.smithi019.stdout:9/613: write d12/f45 [2989746,79641] 0 2024-09-12T22:11:29.000 INFO:tasks.workunit.client.0.smithi019.stdout:8/613: dwrite d5/dc/d26/d43/d49/d92/fa6 [0,4194304] 0 2024-09-12T22:11:29.000 INFO:tasks.workunit.client.0.smithi019.stdout:2/564: fdatasync d0/d31/d4/f3f 0 2024-09-12T22:11:29.000 INFO:tasks.workunit.client.0.smithi019.stdout:3/636: write d18/d26/d30/d4a/f62 [3855338,115067] 0 2024-09-12T22:11:29.001 INFO:tasks.workunit.client.0.smithi019.stdout:5/663: dwrite d0/f19 [0,4194304] 0 2024-09-12T22:11:29.002 INFO:tasks.workunit.client.0.smithi019.stdout:3/637: read - d18/d1d/d8b/fc0 zero size 2024-09-12T22:11:29.003 INFO:tasks.workunit.client.0.smithi019.stdout:0/615: dread d5/d7/de/f7f [0,4194304] 0 2024-09-12T22:11:29.003 INFO:tasks.workunit.client.0.smithi019.stdout:5/664: mknod d0/d24/d97/ce5 0 2024-09-12T22:11:29.004 INFO:tasks.workunit.client.0.smithi019.stdout:4/589: truncate d9/f3b 44301 0 2024-09-12T22:11:29.004 INFO:tasks.workunit.client.0.smithi019.stdout:0/616: read d5/d7/f5f [1150400,16309] 0 2024-09-12T22:11:29.005 INFO:tasks.workunit.client.0.smithi019.stdout:3/638: creat d18/d26/d30/d4e/fc7 x:0 0 0 2024-09-12T22:11:29.005 INFO:tasks.workunit.client.0.smithi019.stdout:9/614: mknod d12/d1b/d20/d64/d83/db4/dc7/d74/d77/d86/dbd/cd0 0 2024-09-12T22:11:29.005 INFO:tasks.workunit.client.0.smithi019.stdout:4/590: creat d9/d73/d8f/fbb x:0 0 0 2024-09-12T22:11:29.005 INFO:tasks.workunit.client.0.smithi019.stdout:2/565: rename d0/d3/d11/d77/d78/d2c/d56/d60/c98 to d0/d3/d11/d77/d78/d2c/d4c/cb8 0 2024-09-12T22:11:29.006 INFO:tasks.workunit.client.0.smithi019.stdout:0/617: mknod d5/d7/de/d9a/cc9 0 2024-09-12T22:11:29.006 INFO:tasks.workunit.client.0.smithi019.stdout:5/665: getdents d0/d1d/d4f/d47 0 2024-09-12T22:11:29.006 INFO:tasks.workunit.client.0.smithi019.stdout:3/639: fsync d18/d26/d30/d71/d86/f90 0 2024-09-12T22:11:29.006 INFO:tasks.workunit.client.0.smithi019.stdout:4/591: rmdir d9/d4c/d9c 39 2024-09-12T22:11:29.007 INFO:tasks.workunit.client.0.smithi019.stdout:2/566: rmdir d0/d3/d11/d2e/d34 39 2024-09-12T22:11:29.007 INFO:tasks.workunit.client.0.smithi019.stdout:5/666: mknod d0/d26/d6f/ce6 0 2024-09-12T22:11:29.007 INFO:tasks.workunit.client.0.smithi019.stdout:4/592: creat d9/d73/d8f/d93/dad/fbc x:0 0 0 2024-09-12T22:11:29.008 INFO:tasks.workunit.client.0.smithi019.stdout:3/640: write d18/d26/da5/fbf [182647,109073] 0 2024-09-12T22:11:29.009 INFO:tasks.workunit.client.0.smithi019.stdout:6/707: dread d9/dc/d20/f32 [0,4194304] 0 2024-09-12T22:11:29.010 INFO:tasks.workunit.client.0.smithi019.stdout:1/655: truncate d1/d2/d18/d35/d84/dc/df/f74 618336 0 2024-09-12T22:11:29.010 INFO:tasks.workunit.client.0.smithi019.stdout:5/667: creat d0/d26/d5f/fe7 x:0 0 0 2024-09-12T22:11:29.010 INFO:tasks.workunit.client.0.smithi019.stdout:4/593: mknod d9/db/d2b/d6a/cbd 0 2024-09-12T22:11:29.010 INFO:tasks.workunit.client.0.smithi019.stdout:3/641: read - d18/d58/fc3 zero size 2024-09-12T22:11:29.010 INFO:tasks.workunit.client.0.smithi019.stdout:6/708: chown d9/d3d/d4f/d8d 284 1 2024-09-12T22:11:29.012 INFO:tasks.workunit.client.0.smithi019.stdout:3/642: creat d18/fc8 x:0 0 0 2024-09-12T22:11:29.012 INFO:tasks.workunit.client.0.smithi019.stdout:6/709: creat d9/dc/d20/d4b/d64/d7e/fe9 x:0 0 0 2024-09-12T22:11:29.013 INFO:tasks.workunit.client.0.smithi019.stdout:9/615: dwrite d12/d1b/d40/f70 [0,4194304] 0 2024-09-12T22:11:29.013 INFO:tasks.workunit.client.0.smithi019.stdout:3/643: creat d18/d26/d30/d91/fc9 x:0 0 0 2024-09-12T22:11:29.014 INFO:tasks.workunit.client.0.smithi019.stdout:3/644: chown d18/d26/l79 27 1 2024-09-12T22:11:29.015 INFO:tasks.workunit.client.0.smithi019.stdout:6/710: mknod d9/dc/d20/d4b/d6c/d8c/cea 0 2024-09-12T22:11:29.015 INFO:tasks.workunit.client.0.smithi019.stdout:9/616: mkdir d12/d1b/d20/d64/d83/dd1 0 2024-09-12T22:11:29.015 INFO:tasks.workunit.client.0.smithi019.stdout:3/645: rmdir d18/d26/d30/d64 39 2024-09-12T22:11:29.016 INFO:tasks.workunit.client.0.smithi019.stdout:4/594: dread d9/d14/d33/d4e/f53 [0,4194304] 0 2024-09-12T22:11:29.016 INFO:tasks.workunit.client.0.smithi019.stdout:5/668: dwrite d0/d1d/d3d/f55 [0,4194304] 0 2024-09-12T22:11:29.016 INFO:tasks.workunit.client.0.smithi019.stdout:1/656: getdents d1/d2/d18/d35/d84/dc/df 0 2024-09-12T22:11:29.017 INFO:tasks.workunit.client.0.smithi019.stdout:6/711: chown d9/d3d/d6f/f67 60458193 1 2024-09-12T22:11:29.018 INFO:tasks.workunit.client.0.smithi019.stdout:6/712: write d9/d3d/d4f/d8d/fdb [161354,72384] 0 2024-09-12T22:11:29.019 INFO:tasks.workunit.client.0.smithi019.stdout:0/618: truncate d5/d7/d2c/d44/d6a/d46/f5c 4165187 0 2024-09-12T22:11:29.020 INFO:tasks.workunit.client.0.smithi019.stdout:6/713: write d9/d3d/d6f/fbd [898582,23592] 0 2024-09-12T22:11:29.020 INFO:tasks.workunit.client.0.smithi019.stdout:4/595: rename d9/d14/d57/d69 to d9/d14/d57/d95/dbe 0 2024-09-12T22:11:29.020 INFO:tasks.workunit.client.0.smithi019.stdout:0/619: creat d5/d88/fca x:0 0 0 2024-09-12T22:11:29.021 INFO:tasks.workunit.client.0.smithi019.stdout:4/596: creat d9/d4c/fbf x:0 0 0 2024-09-12T22:11:29.022 INFO:tasks.workunit.client.0.smithi019.stdout:6/714: write d9/d3d/d4f/f53 [4630634,118267] 0 2024-09-12T22:11:29.022 INFO:tasks.workunit.client.0.smithi019.stdout:0/620: mkdir d5/d7/d2c/d81/dcb 0 2024-09-12T22:11:29.022 INFO:tasks.workunit.client.0.smithi019.stdout:4/597: chown d9/d87/fae 534 1 2024-09-12T22:11:29.022 INFO:tasks.workunit.client.0.smithi019.stdout:5/669: dwrite d0/d1d/d3d/f3e [0,4194304] 0 2024-09-12T22:11:29.023 INFO:tasks.workunit.client.0.smithi019.stdout:0/621: mknod d5/ccc 0 2024-09-12T22:11:29.023 INFO:tasks.workunit.client.0.smithi019.stdout:5/670: sync 2024-09-12T22:11:29.024 INFO:tasks.workunit.client.0.smithi019.stdout:4/598: write d9/d4c/d9c/f9e [1290999,19413] 0 2024-09-12T22:11:29.025 INFO:tasks.workunit.client.0.smithi019.stdout:5/671: unlink d0/d1d/d4f/d47/d57/d98/c9f 0 2024-09-12T22:11:29.026 INFO:tasks.workunit.client.0.smithi019.stdout:9/617: truncate fe 5641687 0 2024-09-12T22:11:29.027 INFO:tasks.workunit.client.0.smithi019.stdout:5/672: rmdir d0/d26/d42 39 2024-09-12T22:11:29.027 INFO:tasks.workunit.client.0.smithi019.stdout:8/614: dread d5/d16/d19/f3c [0,4194304] 0 2024-09-12T22:11:29.028 INFO:tasks.workunit.client.0.smithi019.stdout:7/630: dread da/f5b [0,4194304] 0 2024-09-12T22:11:29.028 INFO:tasks.workunit.client.0.smithi019.stdout:9/618: chown d12/d1b/f3a 3 1 2024-09-12T22:11:29.029 INFO:tasks.workunit.client.0.smithi019.stdout:0/622: dread d5/d7/d2c/fa9 [0,4194304] 0 2024-09-12T22:11:29.030 INFO:tasks.workunit.client.0.smithi019.stdout:8/615: mkdir d5/dc/d26/dc8 0 2024-09-12T22:11:29.030 INFO:tasks.workunit.client.0.smithi019.stdout:7/631: creat da/d30/da5/fd8 x:0 0 0 2024-09-12T22:11:29.031 INFO:tasks.workunit.client.0.smithi019.stdout:5/673: dread d0/d24/d7a/f9a [0,4194304] 0 2024-09-12T22:11:29.031 INFO:tasks.workunit.client.0.smithi019.stdout:6/715: dwrite d9/dc/d20/d4b/d6c/f91 [0,4194304] 0 2024-09-12T22:11:29.032 INFO:tasks.workunit.client.0.smithi019.stdout:9/619: mknod d12/d1b/d20/d59/d5b/d9a/cd2 0 2024-09-12T22:11:29.032 INFO:tasks.workunit.client.0.smithi019.stdout:0/623: unlink d5/d7/d2c/d44/d6a/fc8 0 2024-09-12T22:11:29.032 INFO:tasks.workunit.client.0.smithi019.stdout:5/674: chown d0/d1d/d4f 145386181 1 2024-09-12T22:11:29.034 INFO:tasks.workunit.client.0.smithi019.stdout:9/620: read - d12/d1b/d20/d59/d5b/d9e/fc1 zero size 2024-09-12T22:11:29.034 INFO:tasks.workunit.client.0.smithi019.stdout:0/624: write d5/d7/db5/fc7 [192184,84978] 0 2024-09-12T22:11:29.034 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:29.033+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:29.035 INFO:tasks.workunit.client.0.smithi019.stdout:7/632: rename da/d24/d9d to da/d24/d28/d1c/d32/d5e/dc3/dd9 0 2024-09-12T22:11:29.035 INFO:tasks.workunit.client.0.smithi019.stdout:5/675: creat d0/d1d/d4f/fe8 x:0 0 0 2024-09-12T22:11:29.036 INFO:tasks.workunit.client.0.smithi019.stdout:8/616: unlink d5/dc/d26/f30 0 2024-09-12T22:11:29.036 INFO:tasks.workunit.client.0.smithi019.stdout:9/621: mknod d12/d1b/d20/d64/d83/db4/dc7/cd3 0 2024-09-12T22:11:29.036 INFO:tasks.workunit.client.0.smithi019.stdout:7/633: chown da/d19/d25/d39/d51/l93 102177013 1 2024-09-12T22:11:29.037 INFO:tasks.workunit.client.0.smithi019.stdout:5/676: creat d0/d1d/d3d/fe9 x:0 0 0 2024-09-12T22:11:29.037 INFO:tasks.workunit.client.0.smithi019.stdout:0/625: creat d5/d7/d10/d26/fcd x:0 0 0 2024-09-12T22:11:29.037 INFO:tasks.workunit.client.0.smithi019.stdout:5/677: fdatasync d0/d1d/d4f/d47/fb4 0 2024-09-12T22:11:29.038 INFO:tasks.workunit.client.0.smithi019.stdout:9/622: mknod d12/d1b/d20/d64/d83/cd4 0 2024-09-12T22:11:29.039 INFO:tasks.workunit.client.0.smithi019.stdout:8/617: link d5/dc/c2c d5/cc9 0 2024-09-12T22:11:29.039 INFO:tasks.workunit.client.0.smithi019.stdout:6/716: truncate d9/dc/d20/d30/db7/fe2 5838667 0 2024-09-12T22:11:29.039 INFO:tasks.workunit.client.0.smithi019.stdout:7/634: mkdir da/d24/d28/d1c/dda 0 2024-09-12T22:11:29.039 INFO:tasks.workunit.client.0.smithi019.stdout:4/599: dread d9/d14/d31/d3f/f48 [0,4194304] 0 2024-09-12T22:11:29.040 INFO:tasks.workunit.client.0.smithi019.stdout:5/678: creat d0/d24/d58/fea x:0 0 0 2024-09-12T22:11:29.040 INFO:tasks.workunit.client.0.smithi019.stdout:2/567: dread d0/d3/d11/d2e/d64/f6d [0,4194304] 0 2024-09-12T22:11:29.040 INFO:tasks.workunit.client.0.smithi019.stdout:4/600: sync 2024-09-12T22:11:29.041 INFO:tasks.workunit.client.0.smithi019.stdout:4/601: chown d9/d4c/f88 127 1 2024-09-12T22:11:29.041 INFO:tasks.workunit.client.0.smithi019.stdout:3/646: dread d18/d58/f7b [0,4194304] 0 2024-09-12T22:11:29.041 INFO:tasks.workunit.client.0.smithi019.stdout:9/623: symlink d12/d1b/d20/d64/d83/db4/dc7/d56/d60/ld5 0 2024-09-12T22:11:29.042 INFO:tasks.workunit.client.0.smithi019.stdout:6/717: mknod d9/dc/d20/d4b/d6c/d8c/ceb 0 2024-09-12T22:11:29.042 INFO:tasks.workunit.client.0.smithi019.stdout:8/618: unlink d5/d16/d19/f45 0 2024-09-12T22:11:29.042 INFO:tasks.workunit.client.0.smithi019.stdout:0/626: link d5/d7/d2c/d81/f9c d5/d7/d2c/d44/d6a/d46/db2/fce 0 2024-09-12T22:11:29.043 INFO:tasks.workunit.client.0.smithi019.stdout:2/568: write d0/d3/d11/d77/d78/d2c/d56/d60/f74 [442139,128602] 0 2024-09-12T22:11:29.043 INFO:tasks.workunit.client.0.smithi019.stdout:4/602: mkdir d9/d73/d8f/d93/dad/dc0 0 2024-09-12T22:11:29.044 INFO:tasks.workunit.client.0.smithi019.stdout:1/657: dread d1/d2/d18/d29/d27/f6a [0,4194304] 0 2024-09-12T22:11:29.045 INFO:tasks.workunit.client.0.smithi019.stdout:2/569: stat d0/d3/df/c4d 0 2024-09-12T22:11:29.045 INFO:tasks.workunit.client.0.smithi019.stdout:5/679: dread d0/d1d/d4f/d47/f4a [0,4194304] 0 2024-09-12T22:11:29.045 INFO:tasks.workunit.client.0.smithi019.stdout:6/718: read d9/d3d/d6f/fbd [690507,72897] 0 2024-09-12T22:11:29.046 INFO:tasks.workunit.client.0.smithi019.stdout:4/603: mkdir d9/d14/d57/d5e/dc1 0 2024-09-12T22:11:29.047 INFO:tasks.workunit.client.0.smithi019.stdout:2/570: symlink d0/d3/d11/d77/d78/lb9 0 2024-09-12T22:11:29.047 INFO:tasks.workunit.client.0.smithi019.stdout:5/680: read - d0/d24/d97/fdc zero size 2024-09-12T22:11:29.047 INFO:tasks.workunit.client.0.smithi019.stdout:1/658: write d1/d2/d18/d29/f9b [621210,105155] 0 2024-09-12T22:11:29.048 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:29.048 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:29.049 INFO:tasks.workunit.client.0.smithi019.stdout:3/647: dread d18/d1d/f2a [0,4194304] 0 2024-09-12T22:11:29.049 INFO:tasks.workunit.client.0.smithi019.stdout:7/635: dwrite da/d30/da5/fd8 [0,4194304] 0 2024-09-12T22:11:29.049 INFO:tasks.workunit.client.0.smithi019.stdout:6/719: stat d9/dc/d20/d4b/d6c/d8c/fd8 0 2024-09-12T22:11:29.049 INFO:tasks.workunit.client.0.smithi019.stdout:6/720: stat d9/d3d/f6e 0 2024-09-12T22:11:29.050 INFO:tasks.workunit.client.0.smithi019.stdout:4/604: truncate d9/db/d2b/d6a/f90 4220036 0 2024-09-12T22:11:29.050 INFO:tasks.workunit.client.0.smithi019.stdout:3/648: fdatasync d18/d26/d30/f67 0 2024-09-12T22:11:29.051 INFO:tasks.workunit.client.0.smithi019.stdout:8/619: truncate d5/d16/d19/f3c 971258 0 2024-09-12T22:11:29.051 INFO:tasks.workunit.client.0.smithi019.stdout:1/659: symlink d1/d2/ldc 0 2024-09-12T22:11:29.051 INFO:tasks.workunit.client.0.smithi019.stdout:5/681: symlink d0/d26/d5f/dc3/leb 0 2024-09-12T22:11:29.051 INFO:tasks.workunit.client.0.smithi019.stdout:7/636: creat da/d24/d28/d1c/d32/daf/fdb x:0 0 0 2024-09-12T22:11:29.051 INFO:tasks.workunit.client.0.smithi019.stdout:9/624: truncate d12/d1b/d20/d59/d5b/d9e/f76 960406 0 2024-09-12T22:11:29.051 INFO:tasks.workunit.client.0.smithi019.stdout:2/571: mkdir d0/d3/d11/d77/d82/d94/dba 0 2024-09-12T22:11:29.051 INFO:tasks.workunit.client.0.smithi019.stdout:9/625: sync 2024-09-12T22:11:29.052 INFO:tasks.workunit.client.0.smithi019.stdout:6/721: creat d9/dc/d20/d4b/fec x:0 0 0 2024-09-12T22:11:29.053 INFO:tasks.workunit.client.0.smithi019.stdout:1/660: stat d1/d2/d18/d35/d84/dc/df/d2c/f63 0 2024-09-12T22:11:29.053 INFO:tasks.workunit.client.0.smithi019.stdout:9/626: mknod d12/d1b/d20/d59/d5b/d9a/cd6 0 2024-09-12T22:11:29.053 INFO:tasks.workunit.client.0.smithi019.stdout:5/682: rename d0/d1d/d4f/d96/fae to d0/d24/d97/fec 0 2024-09-12T22:11:29.054 INFO:tasks.workunit.client.0.smithi019.stdout:7/637: rmdir da/d19/d25/d39/d51/dd7/db1 39 2024-09-12T22:11:29.054 INFO:tasks.workunit.client.0.smithi019.stdout:8/620: getdents d5/dc/d8d 0 2024-09-12T22:11:29.055 INFO:tasks.workunit.client.0.smithi019.stdout:5/683: fdatasync d0/d1d/d4f/f16 0 2024-09-12T22:11:29.055 INFO:tasks.workunit.client.0.smithi019.stdout:3/649: write d18/d1d/f3f [3695,89549] 0 2024-09-12T22:11:29.055 INFO:tasks.workunit.client.0.smithi019.stdout:9/627: rename d12/d1b/d20/d64/d83/db4 to d12/dd7 0 2024-09-12T22:11:29.056 INFO:tasks.workunit.client.0.smithi019.stdout:2/572: getdents d0/d3/d11/d77/d82 0 2024-09-12T22:11:29.058 INFO:tasks.workunit.client.0.smithi019.stdout:3/650: readlink d18/d26/d30/d4e/d80/la2 0 2024-09-12T22:11:29.058 INFO:tasks.workunit.client.0.smithi019.stdout:1/661: mkdir d1/d2/d18/d35/d84/dc/df/d2c/d5d/ddd 0 2024-09-12T22:11:29.058 INFO:tasks.workunit.client.0.smithi019.stdout:5/684: link d0/f29 d0/d24/d7a/fed 0 2024-09-12T22:11:29.059 INFO:tasks.workunit.client.0.smithi019.stdout:5/685: sync 2024-09-12T22:11:29.059 INFO:tasks.workunit.client.0.smithi019.stdout:6/722: dwrite d9/dc/f13 [0,4194304] 0 2024-09-12T22:11:29.059 INFO:tasks.workunit.client.0.smithi019.stdout:0/627: dread d5/f22 [0,4194304] 0 2024-09-12T22:11:29.060 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:29.060 INFO:tasks.workunit.client.0.smithi019.stdout:1/662: dread - d1/d83/fbd zero size 2024-09-12T22:11:29.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:29.063 INFO:tasks.workunit.client.0.smithi019.stdout:0/628: mkdir d5/d7/d2c/dc1/dcf 0 2024-09-12T22:11:29.063 INFO:tasks.workunit.client.0.smithi019.stdout:7/638: truncate da/d19/d25/d39/fa0 434191 0 2024-09-12T22:11:29.063 INFO:tasks.workunit.client.0.smithi019.stdout:3/651: truncate f13 3499893 0 2024-09-12T22:11:29.065 INFO:tasks.workunit.client.0.smithi019.stdout:5/686: symlink d0/d1d/d4f/d47/d57/dba/ddb/lee 0 2024-09-12T22:11:29.065 INFO:tasks.workunit.client.0.smithi019.stdout:7/639: fdatasync da/d19/f50 0 2024-09-12T22:11:29.065 INFO:tasks.workunit.client.0.smithi019.stdout:8/621: dwrite d5/dc/d26/d4b/f91 [0,4194304] 0 2024-09-12T22:11:29.065 INFO:tasks.workunit.client.0.smithi019.stdout:1/663: chown d1/d2/d18/d35/d84/dc/df/d2c/l9c 1820629 1 2024-09-12T22:11:29.067 INFO:tasks.workunit.client.0.smithi019.stdout:7/640: chown da/d24/fb7 3257 1 2024-09-12T22:11:29.067 INFO:tasks.workunit.client.0.smithi019.stdout:5/687: write d0/d24/d58/fd1 [116293,27071] 0 2024-09-12T22:11:29.067 INFO:tasks.workunit.client.0.smithi019.stdout:3/652: symlink d18/d26/d30/d71/lca 0 2024-09-12T22:11:29.068 INFO:tasks.workunit.client.0.smithi019.stdout:0/629: write d5/d7/d2c/d44/d6a/d46/fb0 [1298792,1863] 0 2024-09-12T22:11:29.069 INFO:tasks.workunit.client.0.smithi019.stdout:2/573: dwrite d0/d31/d12/d3b/f76 [0,4194304] 0 2024-09-12T22:11:29.073 INFO:tasks.workunit.client.0.smithi019.stdout:5/688: creat d0/d1d/fef x:0 0 0 2024-09-12T22:11:29.073 INFO:tasks.workunit.client.0.smithi019.stdout:8/622: rename d5/dc/d26/d43/c48 to d5/d16/d19/d29/cca 0 2024-09-12T22:11:29.073 INFO:tasks.workunit.client.0.smithi019.stdout:0/630: creat d5/d7/d2c/d81/dcb/fd0 x:0 0 0 2024-09-12T22:11:29.074 INFO:tasks.workunit.client.0.smithi019.stdout:3/653: getdents d18/d26/d30/d4e/d9a/dae 0 2024-09-12T22:11:29.074 INFO:tasks.workunit.client.0.smithi019.stdout:3/654: readlink d18/d1d/d35/lc1 0 2024-09-12T22:11:29.074 INFO:tasks.workunit.client.0.smithi019.stdout:4/605: dread d9/d14/d57/d95/d96/faa [4194304,4194304] 0 2024-09-12T22:11:29.075 INFO:tasks.workunit.client.0.smithi019.stdout:8/623: read d5/dc/f5f [130558,123112] 0 2024-09-12T22:11:29.075 INFO:tasks.workunit.client.0.smithi019.stdout:1/664: link d1/d2/d18/d35/d84/dc/df/d53/d55/cc5 d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/cde 0 2024-09-12T22:11:29.077 INFO:tasks.workunit.client.0.smithi019.stdout:2/574: dread d0/d3/d11/d2e/d64/fb1 [0,4194304] 0 2024-09-12T22:11:29.077 INFO:tasks.workunit.client.0.smithi019.stdout:3/655: mknod d18/d1d/ccb 0 2024-09-12T22:11:29.077 INFO:tasks.workunit.client.0.smithi019.stdout:8/624: mkdir d5/dc/d8d/dcb 0 2024-09-12T22:11:29.077 INFO:tasks.workunit.client.0.smithi019.stdout:4/606: creat d9/db/d2b/fc2 x:0 0 0 2024-09-12T22:11:29.080 INFO:tasks.workunit.client.0.smithi019.stdout:9/628: dread d12/dd7/dc7/d56/d60/f7a [0,4194304] 0 2024-09-12T22:11:29.080 INFO:tasks.workunit.client.0.smithi019.stdout:3/656: write d18/d26/fac [685192,37174] 0 2024-09-12T22:11:29.081 INFO:tasks.workunit.client.0.smithi019.stdout:5/689: dwrite d0/d24/d97/fce [0,4194304] 0 2024-09-12T22:11:29.084 INFO:tasks.workunit.client.0.smithi019.stdout:2/575: unlink d0/d31/d12/d3b/d5c/d71/f73 0 2024-09-12T22:11:29.084 INFO:tasks.workunit.client.0.smithi019.stdout:9/629: write d12/d1b/d20/fce [498450,71200] 0 2024-09-12T22:11:29.085 INFO:tasks.workunit.client.0.smithi019.stdout:6/723: dread d9/dc/d20/d4b/d6c/d8c/fd8 [0,4194304] 0 2024-09-12T22:11:29.086 INFO:tasks.workunit.client.0.smithi019.stdout:9/630: stat d12/dd7/dc7/d74/d77/f84 0 2024-09-12T22:11:29.086 INFO:tasks.workunit.client.0.smithi019.stdout:3/657: symlink d18/d26/d30/d4e/lcc 0 2024-09-12T22:11:29.086 INFO:tasks.workunit.client.0.smithi019.stdout:2/576: unlink d0/d3/df/d6b/la8 0 2024-09-12T22:11:29.087 INFO:tasks.workunit.client.0.smithi019.stdout:7/641: dread da/d8f/f7f [0,4194304] 0 2024-09-12T22:11:29.087 INFO:tasks.workunit.client.0.smithi019.stdout:1/665: truncate d1/d2/d18/d35/d84/dc/df/d53/d66/f8c 3533366 0 2024-09-12T22:11:29.087 INFO:tasks.workunit.client.0.smithi019.stdout:6/724: read d9/d3d/d6f/fbd [531320,32406] 0 2024-09-12T22:11:29.087 INFO:tasks.workunit.client.0.smithi019.stdout:3/658: chown d18/d58/f8e 130474840 1 2024-09-12T22:11:29.087 INFO:tasks.workunit.client.0.smithi019.stdout:5/690: truncate d0/d1d/d4f/d47/d57/fc0 701614 0 2024-09-12T22:11:29.088 INFO:tasks.workunit.client.0.smithi019.stdout:2/577: creat d0/d3/d11/d77/d82/fbb x:0 0 0 2024-09-12T22:11:29.089 INFO:tasks.workunit.client.0.smithi019.stdout:9/631: creat d12/dd7/dc7/d92/d9d/da5/fd8 x:0 0 0 2024-09-12T22:11:29.090 INFO:tasks.workunit.client.0.smithi019.stdout:1/666: dread - d1/d2/d18/d35/d84/d98/fc2 zero size 2024-09-12T22:11:29.090 INFO:tasks.workunit.client.0.smithi019.stdout:6/725: chown d9/dc/d20/d4b/d6c/f91 480 1 2024-09-12T22:11:29.091 INFO:tasks.workunit.client.0.smithi019.stdout:8/625: dwrite d5/d16/d19/f3c [0,4194304] 0 2024-09-12T22:11:29.091 INFO:tasks.workunit.client.0.smithi019.stdout:3/659: truncate d18/d26/d30/d4e/d9a/dae/fb7 961591 0 2024-09-12T22:11:29.091 INFO:tasks.workunit.client.0.smithi019.stdout:1/667: stat d1/d2/d18/d29/d27/fd9 0 2024-09-12T22:11:29.092 INFO:tasks.workunit.client.0.smithi019.stdout:3/660: chown d18/d26/da5/dbd 2868 1 2024-09-12T22:11:29.093 INFO:tasks.workunit.client.0.smithi019.stdout:2/578: getdents d0/d3/df/d7b 0 2024-09-12T22:11:29.093 INFO:tasks.workunit.client.0.smithi019.stdout:6/726: fsync d9/dc/d20/d4b/d64/d7e/fe9 0 2024-09-12T22:11:29.093 INFO:tasks.workunit.client.0.smithi019.stdout:0/631: dread d5/f16 [4194304,4194304] 0 2024-09-12T22:11:29.095 INFO:tasks.workunit.client.0.smithi019.stdout:6/727: read d9/dc/d20/d4b/d6c/f91 [251921,7215] 0 2024-09-12T22:11:29.096 INFO:tasks.workunit.client.0.smithi019.stdout:7/642: creat da/d19/d25/d39/d51/dd7/db1/fdc x:0 0 0 2024-09-12T22:11:29.096 INFO:tasks.workunit.client.0.smithi019.stdout:2/579: mknod d0/d3/d11/d77/d78/d91/cbc 0 2024-09-12T22:11:29.097 INFO:tasks.workunit.client.0.smithi019.stdout:4/607: dread d9/db/d2b/f37 [0,4194304] 0 2024-09-12T22:11:29.097 INFO:tasks.workunit.client.0.smithi019.stdout:3/661: mknod d18/d1d/ccd 0 2024-09-12T22:11:29.098 INFO:tasks.workunit.client.0.smithi019.stdout:0/632: link d5/d7/l2d d5/d88/ld1 0 2024-09-12T22:11:29.098 INFO:tasks.workunit.client.0.smithi019.stdout:6/728: creat d9/dc/d20/d30/fed x:0 0 0 2024-09-12T22:11:29.098 INFO:tasks.workunit.client.0.smithi019.stdout:2/580: stat d0/d3/f66 0 2024-09-12T22:11:29.098 INFO:tasks.workunit.client.0.smithi019.stdout:3/662: mkdir d18/d26/dce 0 2024-09-12T22:11:29.099 INFO:tasks.workunit.client.0.smithi019.stdout:8/626: dwrite d5/dc/d26/d4b/f79 [0,4194304] 0 2024-09-12T22:11:29.100 INFO:tasks.workunit.client.0.smithi019.stdout:4/608: getdents d9/d73/d8f/d93/dad/dc0 0 2024-09-12T22:11:29.101 INFO:tasks.workunit.client.0.smithi019.stdout:0/633: rename d5/d7/d2c/d44/d6a/f4f to d5/d7/d2c/dc1/fd2 0 2024-09-12T22:11:29.101 INFO:tasks.workunit.client.0.smithi019.stdout:2/581: link d0/d3/d11/d77/d78/f7c d0/d3/d11/fbd 0 2024-09-12T22:11:29.101 INFO:tasks.workunit.client.0.smithi019.stdout:7/643: truncate da/d24/d28/d1c/d32/d99/fc0 8039063 0 2024-09-12T22:11:29.102 INFO:tasks.workunit.client.0.smithi019.stdout:4/609: mknod d9/d73/d8f/d93/dad/cc3 0 2024-09-12T22:11:29.103 INFO:tasks.workunit.client.0.smithi019.stdout:6/729: rename d9/dc/d20/d4b/f75 to d9/dc/dd9/fee 0 2024-09-12T22:11:29.103 INFO:tasks.workunit.client.0.smithi019.stdout:2/582: chown d0/d31/d12/d15/fa0 0 1 2024-09-12T22:11:29.106 INFO:tasks.workunit.client.0.smithi019.stdout:8/627: link d5/d53/d66/d69/lb4 d5/dc/d8d/d96/lcc 0 2024-09-12T22:11:29.106 INFO:tasks.workunit.client.0.smithi019.stdout:6/730: symlink d9/dc/d20/d4b/d6c/d8c/lef 0 2024-09-12T22:11:29.107 INFO:tasks.workunit.client.0.smithi019.stdout:7/644: mknod da/d24/d28/d1c/d32/d99/d9f/cdd 0 2024-09-12T22:11:29.107 INFO:tasks.workunit.client.0.smithi019.stdout:0/634: mknod d5/d7/d2c/d44/d6a/d76/cd3 0 2024-09-12T22:11:29.109 INFO:tasks.workunit.client.0.smithi019.stdout:3/663: dread d18/d26/da5/fbf [0,4194304] 0 2024-09-12T22:11:29.109 INFO:tasks.workunit.client.0.smithi019.stdout:4/610: dwrite d9/d58/f77 [0,4194304] 0 2024-09-12T22:11:29.111 INFO:tasks.workunit.client.0.smithi019.stdout:8/628: creat d5/dc/d26/fcd x:0 0 0 2024-09-12T22:11:29.111 INFO:tasks.workunit.client.0.smithi019.stdout:2/583: truncate d0/d3/d11/d2e/d64/f79 4489297 0 2024-09-12T22:11:29.111 INFO:tasks.workunit.client.0.smithi019.stdout:7/645: creat da/d24/d28/d1c/d32/d94/fde x:0 0 0 2024-09-12T22:11:29.112 INFO:tasks.workunit.client.0.smithi019.stdout:3/664: fsync f16 0 2024-09-12T22:11:29.113 INFO:tasks.workunit.client.0.smithi019.stdout:2/584: write d0/d31/d12/d15/fb2 [3737329,54559] 0 2024-09-12T22:11:29.113 INFO:tasks.workunit.client.0.smithi019.stdout:0/635: rename d5/d7/d10/d26/d2a/faa to d5/d7/dac/fd4 0 2024-09-12T22:11:29.113 INFO:tasks.workunit.client.0.smithi019.stdout:8/629: rmdir d5/d53 39 2024-09-12T22:11:29.114 INFO:tasks.workunit.client.0.smithi019.stdout:6/731: dwrite d9/d3d/f90 [0,4194304] 0 2024-09-12T22:11:29.114 INFO:tasks.workunit.client.0.smithi019.stdout:4/611: chown d9/db/c19 1334191491 1 2024-09-12T22:11:29.114 INFO:tasks.workunit.client.0.smithi019.stdout:2/585: fdatasync d0/d3/d11/d77/d82/fbb 0 2024-09-12T22:11:29.115 INFO:tasks.workunit.client.0.smithi019.stdout:4/612: truncate d9/d6c/f7e 377292 0 2024-09-12T22:11:29.115 INFO:tasks.workunit.client.0.smithi019.stdout:3/665: creat d18/d26/fcf x:0 0 0 2024-09-12T22:11:29.115 INFO:tasks.workunit.client.0.smithi019.stdout:7/646: dread da/d19/d25/d39/f6b [0,4194304] 0 2024-09-12T22:11:29.116 INFO:tasks.workunit.client.0.smithi019.stdout:8/630: mkdir d5/dc/d17/dce 0 2024-09-12T22:11:29.116 INFO:tasks.workunit.client.0.smithi019.stdout:3/666: readlink d18/d1d/d8b/lb1 0 2024-09-12T22:11:29.116 INFO:tasks.workunit.client.0.smithi019.stdout:4/613: readlink d9/db/d2b/d6a/l79 0 2024-09-12T22:11:29.116 INFO:tasks.workunit.client.0.smithi019.stdout:2/586: mkdir d0/d3/df/d7b/dbe 0 2024-09-12T22:11:29.117 INFO:tasks.workunit.client.0.smithi019.stdout:3/667: mknod d18/d26/d30/d64/cd0 0 2024-09-12T22:11:29.117 INFO:tasks.workunit.client.0.smithi019.stdout:1/668: dread d1/d2/d18/d29/f9b [0,4194304] 0 2024-09-12T22:11:29.118 INFO:tasks.workunit.client.0.smithi019.stdout:4/614: mkdir d9/d14/d57/d95/d96/dc4 0 2024-09-12T22:11:29.118 INFO:tasks.workunit.client.0.smithi019.stdout:6/732: write d9/dc/d20/f2e [802119,33679] 0 2024-09-12T22:11:29.119 INFO:tasks.workunit.client.0.smithi019.stdout:8/631: creat d5/dc/d17/dce/fcf x:0 0 0 2024-09-12T22:11:29.119 INFO:tasks.workunit.client.0.smithi019.stdout:3/668: fsync d18/d1d/fbe 0 2024-09-12T22:11:29.120 INFO:tasks.workunit.client.0.smithi019.stdout:4/615: mkdir d9/d73/d8f/d93/dad/dc0/dc5 0 2024-09-12T22:11:29.120 INFO:tasks.workunit.client.0.smithi019.stdout:8/632: mknod d5/dc/d26/d43/d7d/cd0 0 2024-09-12T22:11:29.122 INFO:tasks.workunit.client.0.smithi019.stdout:6/733: link d9/dc/f15 d9/d3d/d4f/d59/ff0 0 2024-09-12T22:11:29.122 INFO:tasks.workunit.client.0.smithi019.stdout:3/669: creat d18/d26/d30/d71/fd1 x:0 0 0 2024-09-12T22:11:29.122 INFO:tasks.workunit.client.0.smithi019.stdout:7/647: dwrite da/d24/d28/d1c/db9/fcb [0,4194304] 0 2024-09-12T22:11:29.122 INFO:tasks.workunit.client.0.smithi019.stdout:4/616: unlink d9/d73/d8f/d93/fb5 0 2024-09-12T22:11:29.123 INFO:tasks.workunit.client.0.smithi019.stdout:4/617: chown d9/d14/d31/d3f/l4a 1 1 2024-09-12T22:11:29.124 INFO:tasks.workunit.client.0.smithi019.stdout:6/734: mknod d9/d6b/cf1 0 2024-09-12T22:11:29.124 INFO:tasks.workunit.client.0.smithi019.stdout:3/670: mknod d18/d26/da5/cd2 0 2024-09-12T22:11:29.124 INFO:tasks.workunit.client.0.smithi019.stdout:1/669: link d1/d2/d18/d35/d84/dc/df/d2c/d5d/l5f d1/d2/d18/d35/d84/d98/dbc/ldf 0 2024-09-12T22:11:29.126 INFO:tasks.workunit.client.0.smithi019.stdout:8/633: link d5/d16/c22 d5/d16/d19/d29/cd1 0 2024-09-12T22:11:29.126 INFO:tasks.workunit.client.0.smithi019.stdout:6/735: link d9/dc/dd9/fee d9/dc/d20/d30/db7/ff2 0 2024-09-12T22:11:29.126 INFO:tasks.workunit.client.0.smithi019.stdout:7/648: truncate da/d24/fb7 561865 0 2024-09-12T22:11:29.127 INFO:tasks.workunit.client.0.smithi019.stdout:6/736: symlink d9/lf3 0 2024-09-12T22:11:29.129 INFO:tasks.workunit.client.0.smithi019.stdout:7/649: link da/d24/d28/c1b da/d30/da5/cdf 0 2024-09-12T22:11:29.129 INFO:tasks.workunit.client.0.smithi019.stdout:1/670: dwrite d1/d2/d18/d59/f75 [0,4194304] 0 2024-09-12T22:11:29.132 INFO:tasks.workunit.client.0.smithi019.stdout:1/671: stat d1/c60 0 2024-09-12T22:11:29.132 INFO:tasks.workunit.client.0.smithi019.stdout:8/634: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:29.132 INFO:tasks.workunit.client.0.smithi019.stdout:6/737: chown d9/dc 80450 1 2024-09-12T22:11:29.132 INFO:tasks.workunit.client.0.smithi019.stdout:7/650: chown da/d24/f2c 0 1 2024-09-12T22:11:29.132 INFO:tasks.workunit.client.0.smithi019.stdout:6/738: dread d9/dc/d20/f32 [0,4194304] 0 2024-09-12T22:11:29.134 INFO:tasks.workunit.client.0.smithi019.stdout:1/672: symlink d1/d2/d18/d35/le0 0 2024-09-12T22:11:29.135 INFO:tasks.workunit.client.0.smithi019.stdout:7/651: getdents da/d24 0 2024-09-12T22:11:29.135 INFO:tasks.workunit.client.0.smithi019.stdout:6/739: creat d9/dc/d20/d4b/d6c/ff4 x:0 0 0 2024-09-12T22:11:29.137 INFO:tasks.workunit.client.0.smithi019.stdout:1/673: link d1/d2/d18/d35/d84/ld1 d1/d2/d18/d70/le1 0 2024-09-12T22:11:29.137 INFO:tasks.workunit.client.0.smithi019.stdout:7/652: rename da/d24/d28/d1c/d32/d5e/dc3/dd9/caa to da/d24/d28/d1c/d32/ce0 0 2024-09-12T22:11:29.139 INFO:tasks.workunit.client.0.smithi019.stdout:8/635: dwrite d5/dc/d8a/d8e/f9e [0,4194304] 0 2024-09-12T22:11:29.140 INFO:tasks.workunit.client.0.smithi019.stdout:7/653: write da/d19/d79/f90 [510125,26680] 0 2024-09-12T22:11:29.141 INFO:tasks.workunit.client.0.smithi019.stdout:8/636: mknod d5/dc/d26/d43/d49/cd2 0 2024-09-12T22:11:29.142 INFO:tasks.workunit.client.0.smithi019.stdout:7/654: unlink da/d24/d28/d1c/d32/dc2/ccc 0 2024-09-12T22:11:29.143 INFO:tasks.workunit.client.0.smithi019.stdout:4/618: dread f5 [0,4194304] 0 2024-09-12T22:11:29.144 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:29.143+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:29.144 INFO:tasks.workunit.client.0.smithi019.stdout:6/740: dwrite d9/dc/d20/d4b/d64/d7e/fc1 [0,4194304] 0 2024-09-12T22:11:29.144 INFO:tasks.workunit.client.0.smithi019.stdout:4/619: write f4 [3377274,86784] 0 2024-09-12T22:11:29.145 INFO:tasks.workunit.client.0.smithi019.stdout:4/620: stat d9/d87 0 2024-09-12T22:11:29.146 INFO:tasks.workunit.client.0.smithi019.stdout:4/621: rename d9/d14/d31 to d9/d14/d57/d95/dbe/dc6 0 2024-09-12T22:11:29.147 INFO:tasks.workunit.client.0.smithi019.stdout:4/622: mkdir d9/db/d2b/dc7 0 2024-09-12T22:11:29.149 INFO:tasks.workunit.client.0.smithi019.stdout:6/741: truncate d9/dc/d20/d4b/d6c/d8c/fd8 135773 0 2024-09-12T22:11:29.151 INFO:tasks.workunit.client.0.smithi019.stdout:4/623: write d9/d14/d57/d95/dbe/dc6/f8b [271148,96997] 0 2024-09-12T22:11:29.151 INFO:tasks.workunit.client.0.smithi019.stdout:6/742: mknod d9/dc/d20/cf5 0 2024-09-12T22:11:29.152 INFO:tasks.workunit.client.0.smithi019.stdout:1/674: dwrite d1/d2/d18/d35/d84/dc/df/f74 [0,4194304] 0 2024-09-12T22:11:29.153 INFO:tasks.workunit.client.0.smithi019.stdout:7/655: dwrite da/d24/d28/d1c/f23 [0,4194304] 0 2024-09-12T22:11:29.153 INFO:tasks.workunit.client.0.smithi019.stdout:6/743: symlink d9/d3d/d4f/d59/lf6 0 2024-09-12T22:11:29.154 INFO:tasks.workunit.client.0.smithi019.stdout:7/656: dread - da/d19/d25/d39/fa3 zero size 2024-09-12T22:11:29.156 INFO:tasks.workunit.client.0.smithi019.stdout:6/744: write d9/dc/d20/f50 [1115415,59733] 0 2024-09-12T22:11:29.159 INFO:tasks.workunit.client.0.smithi019.stdout:6/745: dread d9/dc/f15 [4194304,4194304] 0 2024-09-12T22:11:29.160 INFO:tasks.workunit.client.0.smithi019.stdout:1/675: dwrite d1/d2/d18/d35/d84/dc/df/d61/f1b [0,4194304] 0 2024-09-12T22:11:29.161 INFO:tasks.workunit.client.0.smithi019.stdout:6/746: chown d9/dc/d20/d30/db7/fe2 4 1 2024-09-12T22:11:29.163 INFO:tasks.workunit.client.0.smithi019.stdout:8/637: dread d5/dc/ff [0,4194304] 0 2024-09-12T22:11:29.163 INFO:tasks.workunit.client.0.smithi019.stdout:8/638: symlink d5/d53/d66/ld3 0 2024-09-12T22:11:29.164 INFO:tasks.workunit.client.0.smithi019.stdout:6/747: rename d9/dc/d20/d4b/d64 to d9/dc/df7 0 2024-09-12T22:11:29.164 INFO:tasks.workunit.client.0.smithi019.stdout:6/748: chown d9/d3d/db8/fdf 3956 1 2024-09-12T22:11:29.165 INFO:tasks.workunit.client.0.smithi019.stdout:8/639: dread - d5/d53/d66/f99 zero size 2024-09-12T22:11:29.165 INFO:tasks.workunit.client.0.smithi019.stdout:1/676: dread d1/d2/d18/d35/d84/dc/df/d61/fa7 [0,4194304] 0 2024-09-12T22:11:29.166 INFO:tasks.workunit.client.0.smithi019.stdout:5/691: sync 2024-09-12T22:11:29.166 INFO:tasks.workunit.client.0.smithi019.stdout:8/640: mknod d5/d16/d19/d32/cd4 0 2024-09-12T22:11:29.166 INFO:tasks.workunit.client.0.smithi019.stdout:5/692: chown d0/d1d/f44 66178 1 2024-09-12T22:11:29.169 INFO:tasks.workunit.client.0.smithi019.stdout:6/749: dread d9/d3d/d6f/f5c [0,4194304] 0 2024-09-12T22:11:29.169 INFO:tasks.workunit.client.0.smithi019.stdout:1/677: dread d1/d2/d18/d29/f9b [0,4194304] 0 2024-09-12T22:11:29.170 INFO:tasks.workunit.client.0.smithi019.stdout:6/750: write d9/d3d/d4f/d8d/fc4 [902717,116641] 0 2024-09-12T22:11:29.170 INFO:tasks.workunit.client.0.smithi019.stdout:1/678: rename d1/d83/fbd to d1/d2/fe2 0 2024-09-12T22:11:29.171 INFO:tasks.workunit.client.0.smithi019.stdout:1/679: fdatasync d1/d83/fc8 0 2024-09-12T22:11:29.171 INFO:tasks.workunit.client.0.smithi019.stdout:6/751: symlink d9/d3d/db8/lf8 0 2024-09-12T22:11:29.171 INFO:tasks.workunit.client.0.smithi019.stdout:5/693: dwrite d0/d26/d3a/f5c [0,4194304] 0 2024-09-12T22:11:29.172 INFO:tasks.workunit.client.0.smithi019.stdout:9/632: sync 2024-09-12T22:11:29.172 INFO:tasks.workunit.client.0.smithi019.stdout:6/752: unlink d9/d3d/d4f/f53 0 2024-09-12T22:11:29.173 INFO:tasks.workunit.client.0.smithi019.stdout:1/680: write d1/d2/d18/d35/d84/d98/dbc/fc1 [2001831,2098] 0 2024-09-12T22:11:29.173 INFO:tasks.workunit.client.0.smithi019.stdout:5/694: chown d0/d26/d42/fd0 1 1 2024-09-12T22:11:29.174 INFO:tasks.workunit.client.0.smithi019.stdout:6/753: read d9/dc/d20/d4b/d6c/f91 [855699,31806] 0 2024-09-12T22:11:29.174 INFO:tasks.workunit.client.0.smithi019.stdout:1/681: truncate d1/d2/d18/d70/fb6 745808 0 2024-09-12T22:11:29.175 INFO:tasks.workunit.client.0.smithi019.stdout:5/695: getdents d0/dbf 0 2024-09-12T22:11:29.175 INFO:tasks.workunit.client.0.smithi019.stdout:5/696: fdatasync d0/d1d/fef 0 2024-09-12T22:11:29.176 INFO:tasks.workunit.client.0.smithi019.stdout:5/697: write d0/f17 [901589,98331] 0 2024-09-12T22:11:29.177 INFO:tasks.workunit.client.0.smithi019.stdout:1/682: truncate d1/d2/d18/d35/fda 1326908 0 2024-09-12T22:11:29.177 INFO:tasks.workunit.client.0.smithi019.stdout:5/698: rmdir d0/d26 39 2024-09-12T22:11:29.177 INFO:tasks.workunit.client.0.smithi019.stdout:9/633: read d12/d1b/f1c [3726302,16719] 0 2024-09-12T22:11:29.180 INFO:tasks.workunit.client.0.smithi019.stdout:6/754: dwrite d9/dc/d20/d30/d5b/fe3 [0,4194304] 0 2024-09-12T22:11:29.182 INFO:tasks.workunit.client.0.smithi019.stdout:2/587: sync 2024-09-12T22:11:29.182 INFO:tasks.workunit.client.0.smithi019.stdout:4/624: sync 2024-09-12T22:11:29.182 INFO:tasks.workunit.client.0.smithi019.stdout:3/671: sync 2024-09-12T22:11:29.182 INFO:tasks.workunit.client.0.smithi019.stdout:0/636: sync 2024-09-12T22:11:29.182 INFO:tasks.workunit.client.0.smithi019.stdout:5/699: sync 2024-09-12T22:11:29.182 INFO:tasks.workunit.client.0.smithi019.stdout:6/755: fsync d9/dc/d20/d4b/f2d 0 2024-09-12T22:11:29.182 INFO:tasks.workunit.client.0.smithi019.stdout:1/683: dwrite d1/d2/d18/d29/d51/f5c [0,4194304] 0 2024-09-12T22:11:29.183 INFO:tasks.workunit.client.0.smithi019.stdout:3/672: dread - d18/d58/fc3 zero size 2024-09-12T22:11:29.184 INFO:tasks.workunit.client.0.smithi019.stdout:0/637: creat d5/fd5 x:0 0 0 2024-09-12T22:11:29.184 INFO:tasks.workunit.client.0.smithi019.stdout:5/700: mkdir d0/d26/d42/df0 0 2024-09-12T22:11:29.185 INFO:tasks.workunit.client.0.smithi019.stdout:2/588: mknod d0/d3/df/d7b/cbf 0 2024-09-12T22:11:29.185 INFO:tasks.workunit.client.0.smithi019.stdout:4/625: link d9/la d9/d14/d57/d95/lc8 0 2024-09-12T22:11:29.185 INFO:tasks.workunit.client.0.smithi019.stdout:6/756: creat d9/dc/df7/d78/da1/ff9 x:0 0 0 2024-09-12T22:11:29.185 INFO:tasks.workunit.client.0.smithi019.stdout:4/626: dread - d9/d17/fac zero size 2024-09-12T22:11:29.185 INFO:tasks.workunit.client.0.smithi019.stdout:5/701: write d0/d26/d6f/f9d [704022,3901] 0 2024-09-12T22:11:29.186 INFO:tasks.workunit.client.0.smithi019.stdout:0/638: mknod d5/d7/dac/db6/cd6 0 2024-09-12T22:11:29.186 INFO:tasks.workunit.client.0.smithi019.stdout:6/757: chown d9/dc/d20/d4b/d6c/f91 5 1 2024-09-12T22:11:29.186 INFO:tasks.workunit.client.0.smithi019.stdout:0/639: stat d5/d88/fca 0 2024-09-12T22:11:29.187 INFO:tasks.workunit.client.0.smithi019.stdout:4/627: mkdir d9/d4c/d76/dc9 0 2024-09-12T22:11:29.187 INFO:tasks.workunit.client.0.smithi019.stdout:6/758: creat d9/dc/d20/d71/ffa x:0 0 0 2024-09-12T22:11:29.187 INFO:tasks.workunit.client.0.smithi019.stdout:0/640: fsync d5/d7/f5f 0 2024-09-12T22:11:29.187 INFO:tasks.workunit.client.0.smithi019.stdout:1/684: rename d1/d2/d18/d35/d84/la3 to d1/d2/d18/le3 0 2024-09-12T22:11:29.188 INFO:tasks.workunit.client.0.smithi019.stdout:2/589: mkdir d0/d3/d11/d77/d82/dc0 0 2024-09-12T22:11:29.188 INFO:tasks.workunit.client.0.smithi019.stdout:4/628: symlink d9/d73/d8f/d93/daf/lca 0 2024-09-12T22:11:29.188 INFO:tasks.workunit.client.0.smithi019.stdout:0/641: unlink d5/d7/d10/c58 0 2024-09-12T22:11:29.189 INFO:tasks.workunit.client.0.smithi019.stdout:6/759: symlink d9/d3d/db8/lfb 0 2024-09-12T22:11:29.189 INFO:tasks.workunit.client.0.smithi019.stdout:4/629: mknod d9/d14/d33/d4e/ccb 0 2024-09-12T22:11:29.190 INFO:tasks.workunit.client.0.smithi019.stdout:0/642: chown d5/d7/f30 0 1 2024-09-12T22:11:29.190 INFO:tasks.workunit.client.0.smithi019.stdout:1/685: truncate d1/d2/d18/d59/f9f 21166 0 2024-09-12T22:11:29.191 INFO:tasks.workunit.client.0.smithi019.stdout:4/630: symlink d9/d73/d8f/d93/dad/dc0/lcc 0 2024-09-12T22:11:29.191 INFO:tasks.workunit.client.0.smithi019.stdout:6/760: read d9/dc/ff [500651,115257] 0 2024-09-12T22:11:29.192 INFO:tasks.workunit.client.0.smithi019.stdout:5/702: dwrite d0/d26/d3a/fa4 [0,4194304] 0 2024-09-12T22:11:29.192 INFO:tasks.workunit.client.0.smithi019.stdout:4/631: chown d9/d14/d33 1055391079 1 2024-09-12T22:11:29.194 INFO:tasks.workunit.client.0.smithi019.stdout:1/686: mknod d1/d2/d18/d29/d27/ce4 0 2024-09-12T22:11:29.195 INFO:tasks.workunit.client.0.smithi019.stdout:6/761: mkdir d9/d3d/d4f/d59/d79/dfc 0 2024-09-12T22:11:29.195 INFO:tasks.workunit.client.0.smithi019.stdout:5/703: fdatasync d0/f34 0 2024-09-12T22:11:29.196 INFO:tasks.workunit.client.0.smithi019.stdout:2/590: rename d0/d3/df/d7b/d44/db7 to d0/d31/d12/d3b/dc1 0 2024-09-12T22:11:29.196 INFO:tasks.workunit.client.0.smithi019.stdout:5/704: read - d0/d26/d42/faf zero size 2024-09-12T22:11:29.197 INFO:tasks.workunit.client.0.smithi019.stdout:6/762: chown d9/dc/d20/d4b/d6c/f70 662584 1 2024-09-12T22:11:29.198 INFO:tasks.workunit.client.0.smithi019.stdout:0/643: dwrite d5/d7/d2c/d44/d6a/d46/fb0 [0,4194304] 0 2024-09-12T22:11:29.198 INFO:tasks.workunit.client.0.smithi019.stdout:4/632: rename d9/d14/d57/d5e to d9/db/dcd 0 2024-09-12T22:11:29.198 INFO:tasks.workunit.client.0.smithi019.stdout:2/591: fdatasync d0/d31/d12/d3b/f76 0 2024-09-12T22:11:29.199 INFO:tasks.workunit.client.0.smithi019.stdout:7/657: dread da/d19/d25/d39/d51/f75 [0,4194304] 0 2024-09-12T22:11:29.199 INFO:tasks.workunit.client.0.smithi019.stdout:0/644: stat d5/d7/d10/f68 0 2024-09-12T22:11:29.199 INFO:tasks.workunit.client.0.smithi019.stdout:4/633: write d9/d6c/f7e [489447,115027] 0 2024-09-12T22:11:29.199 INFO:tasks.workunit.client.0.smithi019.stdout:6/763: chown d9/dc/d20/l8a 671 1 2024-09-12T22:11:29.201 INFO:tasks.workunit.client.0.smithi019.stdout:5/705: creat d0/d1d/d3d/ff1 x:0 0 0 2024-09-12T22:11:29.201 INFO:tasks.workunit.client.0.smithi019.stdout:7/658: unlink da/d8f/f84 0 2024-09-12T22:11:29.201 INFO:tasks.workunit.client.0.smithi019.stdout:4/634: fdatasync d9/d73/d8f/d93/f9d 0 2024-09-12T22:11:29.202 INFO:tasks.workunit.client.0.smithi019.stdout:6/764: dread - d9/dc/df7/d7e/fe9 zero size 2024-09-12T22:11:29.202 INFO:tasks.workunit.client.0.smithi019.stdout:5/706: chown d0/d24/d7a/f8f 10476659 1 2024-09-12T22:11:29.202 INFO:tasks.workunit.client.0.smithi019.stdout:5/707: fsync d0/ff 0 2024-09-12T22:11:29.203 INFO:tasks.workunit.client.0.smithi019.stdout:2/592: rename d0/d3/d11/d77/d78/d91/cbc to d0/d3/d11/d77/d78/cc2 0 2024-09-12T22:11:29.204 INFO:tasks.workunit.client.0.smithi019.stdout:1/687: dread d1/d2/d18/d35/d84/dc/df/d53/d55/f6b [0,4194304] 0 2024-09-12T22:11:29.204 INFO:tasks.workunit.client.0.smithi019.stdout:4/635: link d9/d73/la0 d9/d73/d8f/lce 0 2024-09-12T22:11:29.204 INFO:tasks.workunit.client.0.smithi019.stdout:6/765: dread - d9/dc/dd9/fe6 zero size 2024-09-12T22:11:29.205 INFO:tasks.workunit.client.0.smithi019.stdout:2/593: fsync d0/d3/d11/d2e/d64/fb1 0 2024-09-12T22:11:29.206 INFO:tasks.workunit.client.0.smithi019.stdout:4/636: creat d9/d87/fcf x:0 0 0 2024-09-12T22:11:29.206 INFO:tasks.workunit.client.0.smithi019.stdout:0/645: dwrite d5/f70 [0,4194304] 0 2024-09-12T22:11:29.206 INFO:tasks.workunit.client.0.smithi019.stdout:5/708: creat d0/d1d/d4f/d47/d57/dba/ff2 x:0 0 0 2024-09-12T22:11:29.207 INFO:tasks.workunit.client.0.smithi019.stdout:1/688: creat d1/d2/d18/d35/d84/d98/dbc/fe5 x:0 0 0 2024-09-12T22:11:29.207 INFO:tasks.workunit.client.0.smithi019.stdout:9/634: sync 2024-09-12T22:11:29.207 INFO:tasks.workunit.client.0.smithi019.stdout:8/641: sync 2024-09-12T22:11:29.207 INFO:tasks.workunit.client.0.smithi019.stdout:3/673: sync 2024-09-12T22:11:29.207 INFO:tasks.workunit.client.0.smithi019.stdout:6/766: chown d9/dc/df7/d78/f8e 195404390 1 2024-09-12T22:11:29.209 INFO:tasks.workunit.client.0.smithi019.stdout:5/709: chown d0/d24/d97/fec 3 1 2024-09-12T22:11:29.209 INFO:tasks.workunit.client.0.smithi019.stdout:4/637: rename d9/f3b to d9/d73/fd0 0 2024-09-12T22:11:29.209 INFO:tasks.workunit.client.0.smithi019.stdout:6/767: stat d9/dc/d20/d4b/f2c 0 2024-09-12T22:11:29.210 INFO:tasks.workunit.client.0.smithi019.stdout:8/642: write d5/d53/d66/fb5 [397590,8926] 0 2024-09-12T22:11:29.211 INFO:tasks.workunit.client.0.smithi019.stdout:0/646: fdatasync d5/d7/d2c/d44/d6a/d46/db2/fce 0 2024-09-12T22:11:29.211 INFO:tasks.workunit.client.0.smithi019.stdout:7/659: dwrite da/d19/d25/d39/d51/dd7/f64 [0,4194304] 0 2024-09-12T22:11:29.214 INFO:tasks.workunit.client.0.smithi019.stdout:9/635: dread d12/d1b/f3a [0,4194304] 0 2024-09-12T22:11:29.214 INFO:tasks.workunit.client.0.smithi019.stdout:4/638: symlink d9/d73/d8f/d93/ld1 0 2024-09-12T22:11:29.215 INFO:tasks.workunit.client.0.smithi019.stdout:0/647: creat d5/fd7 x:0 0 0 2024-09-12T22:11:29.216 INFO:tasks.workunit.client.0.smithi019.stdout:8/643: creat d5/dc/d17/fd5 x:0 0 0 2024-09-12T22:11:29.217 INFO:tasks.workunit.client.0.smithi019.stdout:9/636: write d12/d1b/d40/f70 [4833101,18396] 0 2024-09-12T22:11:29.220 INFO:tasks.workunit.client.0.smithi019.stdout:1/689: dwrite d1/d2/d18/d70/fae [0,4194304] 0 2024-09-12T22:11:29.220 INFO:tasks.workunit.client.0.smithi019.stdout:3/674: truncate d18/d26/d30/d4a/f62 2961347 0 2024-09-12T22:11:29.220 INFO:tasks.workunit.client.0.smithi019.stdout:3/675: sync 2024-09-12T22:11:29.220 INFO:tasks.workunit.client.0.smithi019.stdout:2/594: dwrite d0/d31/d12/d3b/d5c/f62 [0,4194304] 0 2024-09-12T22:11:29.220 INFO:tasks.workunit.client.0.smithi019.stdout:8/644: symlink d5/d53/ld6 0 2024-09-12T22:11:29.221 INFO:tasks.workunit.client.0.smithi019.stdout:0/648: read d5/d7/d2c/d44/d6a/d46/fb0 [3592300,49736] 0 2024-09-12T22:11:29.222 INFO:tasks.workunit.client.0.smithi019.stdout:9/637: fdatasync d12/d1b/f1c 0 2024-09-12T22:11:29.223 INFO:tasks.workunit.client.0.smithi019.stdout:3/676: rmdir d18 39 2024-09-12T22:11:29.223 INFO:tasks.workunit.client.0.smithi019.stdout:8/645: creat d5/dc/d8d/fd7 x:0 0 0 2024-09-12T22:11:29.224 INFO:tasks.workunit.client.0.smithi019.stdout:7/660: getdents da/d24/d28/d1c/d32/d99/d9f 0 2024-09-12T22:11:29.224 INFO:tasks.workunit.client.0.smithi019.stdout:8/646: sync 2024-09-12T22:11:29.224 INFO:tasks.workunit.client.0.smithi019.stdout:1/690: write d1/d37/f4c [3137547,102852] 0 2024-09-12T22:11:29.224 INFO:tasks.workunit.client.0.smithi019.stdout:4/639: read d9/d14/d57/f7c [3738473,80095] 0 2024-09-12T22:11:29.225 INFO:tasks.workunit.client.0.smithi019.stdout:9/638: mknod d12/d1b/d20/db0/cd9 0 2024-09-12T22:11:29.225 INFO:tasks.workunit.client.0.smithi019.stdout:5/710: dwrite d0/d26/d6f/f74 [0,4194304] 0 2024-09-12T22:11:29.225 INFO:tasks.workunit.client.0.smithi019.stdout:0/649: read d5/d7/d2c/dc1/fd2 [203536,65450] 0 2024-09-12T22:11:29.226 INFO:tasks.workunit.client.0.smithi019.stdout:4/640: stat d9/d17/da1 0 2024-09-12T22:11:29.226 INFO:tasks.workunit.client.0.smithi019.stdout:7/661: chown da/d24/l8e 1372 1 2024-09-12T22:11:29.227 INFO:tasks.workunit.client.0.smithi019.stdout:2/595: truncate d0/d3/d11/da9/fad 969873 0 2024-09-12T22:11:29.227 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:29.227 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:29.228 INFO:tasks.workunit.client.0.smithi019.stdout:9/639: chown d12/d1b/d20/d25/f78 1692123437 1 2024-09-12T22:11:29.228 INFO:tasks.workunit.client.0.smithi019.stdout:4/641: rmdir d9/d73/d8f/d93/dad/dc0 39 2024-09-12T22:11:29.228 INFO:tasks.workunit.client.0.smithi019.stdout:2/596: dread - d0/d3/d11/d2e/d34/fa5 zero size 2024-09-12T22:11:29.229 INFO:tasks.workunit.client.0.smithi019.stdout:3/677: getdents d18/d26/d30 0 2024-09-12T22:11:29.230 INFO:tasks.workunit.client.0.smithi019.stdout:4/642: read d9/db/d2b/f37 [2090488,39388] 0 2024-09-12T22:11:29.230 INFO:tasks.workunit.client.0.smithi019.stdout:9/640: link d12/d48/lb6 d12/d1b/d20/d64/lda 0 2024-09-12T22:11:29.231 INFO:tasks.workunit.client.0.smithi019.stdout:1/691: truncate d1/d2/d18/d35/d84/dc/f69 2398993 0 2024-09-12T22:11:29.231 INFO:tasks.workunit.client.0.smithi019.stdout:0/650: unlink d5/d7/d2c/d44/d6a/d76/lc3 0 2024-09-12T22:11:29.231 INFO:tasks.workunit.client.0.smithi019.stdout:5/711: write d0/f4 [1749041,77119] 0 2024-09-12T22:11:29.231 INFO:tasks.workunit.client.0.smithi019.stdout:8/647: dread d5/dc/d26/d4b/fb8 [0,4194304] 0 2024-09-12T22:11:29.232 INFO:tasks.workunit.client.0.smithi019.stdout:4/643: mkdir d9/d73/dd2 0 2024-09-12T22:11:29.232 INFO:tasks.workunit.client.0.smithi019.stdout:9/641: mkdir d12/d1b/d20/dbc/ddb 0 2024-09-12T22:11:29.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/597: link d0/c41 d0/d3/cc3 0 2024-09-12T22:11:29.234 INFO:tasks.workunit.client.0.smithi019.stdout:5/712: mknod d0/d26/d42/cf3 0 2024-09-12T22:11:29.234 INFO:tasks.workunit.client.0.smithi019.stdout:0/651: chown d5/d7/lc4 1147 1 2024-09-12T22:11:29.234 INFO:tasks.workunit.client.0.smithi019.stdout:4/644: chown d9/d58/fb0 1285194 1 2024-09-12T22:11:29.234 INFO:tasks.workunit.client.0.smithi019.stdout:3/678: link d18/d1d/f3f d18/d26/fd3 0 2024-09-12T22:11:29.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/662: dwrite da/d24/fcf [4194304,4194304] 0 2024-09-12T22:11:29.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/648: readlink d5/dc/d26/d5c/l90 0 2024-09-12T22:11:29.235 INFO:tasks.workunit.client.0.smithi019.stdout:4/645: readlink d9/db/l72 0 2024-09-12T22:11:29.236 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:29.234+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:29.236 INFO:tasks.workunit.client.0.smithi019.stdout:3/679: readlink d18/d1d/dad/lb3 0 2024-09-12T22:11:29.236 INFO:tasks.workunit.client.0.smithi019.stdout:9/642: dread - d12/d1b/d40/f58 zero size 2024-09-12T22:11:29.238 INFO:tasks.workunit.client.0.smithi019.stdout:4/646: dread - d9/d73/d8f/d93/dad/fbc zero size 2024-09-12T22:11:29.239 INFO:tasks.workunit.client.0.smithi019.stdout:2/598: symlink d0/d31/d12/d15/lc4 0 2024-09-12T22:11:29.239 INFO:tasks.workunit.client.0.smithi019.stdout:9/643: write d12/d1b/d20/d25/f5d [353685,96214] 0 2024-09-12T22:11:29.240 INFO:tasks.workunit.client.0.smithi019.stdout:5/713: mknod d0/d1d/d4f/d47/d57/dba/cf4 0 2024-09-12T22:11:29.241 INFO:tasks.workunit.client.0.smithi019.stdout:3/680: truncate d18/d26/d30/d4a/f92 96889 0 2024-09-12T22:11:29.241 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:29.242 INFO:tasks.workunit.client.0.smithi019.stdout:7/663: creat da/d24/d28/d1c/d32/d5e/dc3/dd9/fe1 x:0 0 0 2024-09-12T22:11:29.242 INFO:tasks.workunit.client.0.smithi019.stdout:4/647: write f5 [3800678,6499] 0 2024-09-12T22:11:29.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/644: readlink d12/d1b/d20/d64/d83/la2 0 2024-09-12T22:11:29.243 INFO:tasks.workunit.client.0.smithi019.stdout:2/599: chown d0/d3/d11/da9/fad 85519290 1 2024-09-12T22:11:29.243 INFO:tasks.workunit.client.0.smithi019.stdout:5/714: read d0/d24/d58/fc4 [595927,71685] 0 2024-09-12T22:11:29.243 INFO:tasks.workunit.client.0.smithi019.stdout:6/768: dread d9/dc/df7/d78/f8e [0,4194304] 0 2024-09-12T22:11:29.244 INFO:tasks.workunit.client.0.smithi019.stdout:4/648: fdatasync d9/d14/d33/d4e/f53 0 2024-09-12T22:11:29.245 INFO:tasks.workunit.client.0.smithi019.stdout:5/715: readlink d0/d1d/d6d/la8 0 2024-09-12T22:11:29.245 INFO:tasks.workunit.client.0.smithi019.stdout:3/681: chown d18/d26/d30/d71/d86/f90 1526 1 2024-09-12T22:11:29.245 INFO:tasks.workunit.client.0.smithi019.stdout:0/652: dread d5/f4c [0,4194304] 0 2024-09-12T22:11:29.245 INFO:tasks.workunit.client.0.smithi019.stdout:9/645: rmdir d12/d1b/d20/dbc/ddb 0 2024-09-12T22:11:29.246 INFO:tasks.workunit.client.0.smithi019.stdout:6/769: dread - d9/dc/df7/d78/da1/ff9 zero size 2024-09-12T22:11:29.246 INFO:tasks.workunit.client.0.smithi019.stdout:7/664: mkdir da/d24/d28/d1c/d32/d99/dc8/de2 0 2024-09-12T22:11:29.247 INFO:tasks.workunit.client.0.smithi019.stdout:2/600: write d0/d3/df/f37 [3901090,66988] 0 2024-09-12T22:11:29.247 INFO:tasks.workunit.client.0.smithi019.stdout:4/649: rename d9/d73/d8f/d93/daf to d9/db/d2b/dc7/dd3 0 2024-09-12T22:11:29.247 INFO:tasks.workunit.client.0.smithi019.stdout:3/682: mknod d18/d1d/d35/cd4 0 2024-09-12T22:11:29.248 INFO:tasks.workunit.client.0.smithi019.stdout:5/716: symlink d0/d24/d7a/lf5 0 2024-09-12T22:11:29.248 INFO:tasks.workunit.client.0.smithi019.stdout:7/665: fsync da/d24/d28/f8b 0 2024-09-12T22:11:29.249 INFO:tasks.workunit.client.0.smithi019.stdout:2/601: mkdir d0/d3/dc5 0 2024-09-12T22:11:29.249 INFO:tasks.workunit.client.0.smithi019.stdout:7/666: chown da/d19/d25/d39/fa3 1553151 1 2024-09-12T22:11:29.250 INFO:tasks.workunit.client.0.smithi019.stdout:3/683: mkdir d18/d26/d30/d4e/d9a/dd5 0 2024-09-12T22:11:29.251 INFO:tasks.workunit.client.0.smithi019.stdout:1/692: dread d1/d2/d18/d35/d84/dc/f69 [0,4194304] 0 2024-09-12T22:11:29.251 INFO:tasks.workunit.client.0.smithi019.stdout:0/653: rename d5/d7/d2c/l3a to d5/d7/d2c/d44/ld8 0 2024-09-12T22:11:29.252 INFO:tasks.workunit.client.0.smithi019.stdout:5/717: mkdir d0/d1d/d4f/d47/d57/dba/df6 0 2024-09-12T22:11:29.252 INFO:tasks.workunit.client.0.smithi019.stdout:4/650: chown d9/d14/d57/d95/dbe/d6f/l83 1540 1 2024-09-12T22:11:29.253 INFO:tasks.workunit.client.0.smithi019.stdout:1/693: dread - d1/d2/fe2 zero size 2024-09-12T22:11:29.253 INFO:tasks.workunit.client.0.smithi019.stdout:9/646: link d12/dd7/dc7/d56/f80 d12/d1b/d20/d59/d5b/fdc 0 2024-09-12T22:11:29.253 INFO:tasks.workunit.client.0.smithi019.stdout:4/651: creat d9/d58/fd4 x:0 0 0 2024-09-12T22:11:29.254 INFO:tasks.workunit.client.0.smithi019.stdout:5/718: stat d0/f18 0 2024-09-12T22:11:29.254 INFO:tasks.workunit.client.0.smithi019.stdout:0/654: rmdir d5/d7/d2c/dc1/dcf 0 2024-09-12T22:11:29.255 INFO:tasks.workunit.client.0.smithi019.stdout:3/684: truncate d18/d1d/d8b/fa0 1250283 0 2024-09-12T22:11:29.256 INFO:tasks.workunit.client.0.smithi019.stdout:8/649: dread d5/d16/d19/f40 [0,4194304] 0 2024-09-12T22:11:29.257 INFO:tasks.workunit.client.0.smithi019.stdout:5/719: dread - d0/d26/d42/fd0 zero size 2024-09-12T22:11:29.257 INFO:tasks.workunit.client.0.smithi019.stdout:6/770: dwrite d9/dc/d20/f32 [0,4194304] 0 2024-09-12T22:11:29.257 INFO:tasks.workunit.client.0.smithi019.stdout:9/647: readlink d12/dd7/dc7/d56/d60/ld5 0 2024-09-12T22:11:29.258 INFO:tasks.workunit.client.0.smithi019.stdout:0/655: chown d5/d7/d2c/c79 357409506 1 2024-09-12T22:11:29.258 INFO:tasks.workunit.client.0.smithi019.stdout:7/667: dread da/d19/d25/d39/f71 [0,4194304] 0 2024-09-12T22:11:29.258 INFO:tasks.workunit.client.0.smithi019.stdout:5/720: chown d0/d24 195 1 2024-09-12T22:11:29.258 INFO:tasks.workunit.client.0.smithi019.stdout:3/685: write d18/d1d/f3b [572318,121271] 0 2024-09-12T22:11:29.259 INFO:tasks.workunit.client.0.smithi019.stdout:2/602: dwrite d0/d3/df/f61 [0,4194304] 0 2024-09-12T22:11:29.260 INFO:tasks.workunit.client.0.smithi019.stdout:8/650: write d5/d16/d19/f40 [95689,645] 0 2024-09-12T22:11:29.260 INFO:tasks.workunit.client.0.smithi019.stdout:4/652: mkdir d9/d73/d8f/d93/dad/dc0/dc5/dd5 0 2024-09-12T22:11:29.261 INFO:tasks.workunit.client.0.smithi019.stdout:3/686: stat d18/d1d/d8b/fc0 0 2024-09-12T22:11:29.261 INFO:tasks.workunit.client.0.smithi019.stdout:6/771: chown d9/d3d/d4f/d59/c93 37239473 1 2024-09-12T22:11:29.261 INFO:tasks.workunit.client.0.smithi019.stdout:7/668: dread - da/d19/d25/d39/fa3 zero size 2024-09-12T22:11:29.261 INFO:tasks.workunit.client.0.smithi019.stdout:0/656: stat d5/d7/de/d8d/cad 0 2024-09-12T22:11:29.263 INFO:tasks.workunit.client.0.smithi019.stdout:6/772: mknod d9/d3d/d6f/cfd 0 2024-09-12T22:11:29.264 INFO:tasks.workunit.client.0.smithi019.stdout:0/657: symlink d5/d7/d10/d26/d8a/daf/ld9 0 2024-09-12T22:11:29.264 INFO:tasks.workunit.client.0.smithi019.stdout:3/687: creat d18/d26/d30/d91/fd6 x:0 0 0 2024-09-12T22:11:29.265 INFO:tasks.workunit.client.0.smithi019.stdout:2/603: creat d0/d3/d11/d77/d78/d2c/fc6 x:0 0 0 2024-09-12T22:11:29.265 INFO:tasks.workunit.client.0.smithi019.stdout:7/669: read - da/d24/d28/d1c/d32/d5e/dc3/dd9/fe1 zero size 2024-09-12T22:11:29.266 INFO:tasks.workunit.client.0.smithi019.stdout:4/653: link d9/d58/fd4 d9/db/dcd/fd6 0 2024-09-12T22:11:29.266 INFO:tasks.workunit.client.0.smithi019.stdout:0/658: write d5/d87/f8b [104449,18800] 0 2024-09-12T22:11:29.267 INFO:tasks.workunit.client.0.smithi019.stdout:6/773: read d9/d3d/d6f/f5c [1125456,71890] 0 2024-09-12T22:11:29.268 INFO:tasks.workunit.client.0.smithi019.stdout:3/688: creat d18/d1d/d8b/dc5/dbb/fd7 x:0 0 0 2024-09-12T22:11:29.269 INFO:tasks.workunit.client.0.smithi019.stdout:2/604: fsync d0/d3/d11/d77/d78/d2c/fc6 0 2024-09-12T22:11:29.269 INFO:tasks.workunit.client.0.smithi019.stdout:8/651: truncate d5/dc/d26/d43/d49/d92/fa6 3218311 0 2024-09-12T22:11:29.269 INFO:tasks.workunit.client.0.smithi019.stdout:9/648: dwrite d12/d1b/f3a [0,4194304] 0 2024-09-12T22:11:29.270 INFO:tasks.workunit.client.0.smithi019.stdout:0/659: creat d5/d7/de/fda x:0 0 0 2024-09-12T22:11:29.270 INFO:tasks.workunit.client.0.smithi019.stdout:5/721: dwrite d0/d24/d97/fdc [0,4194304] 0 2024-09-12T22:11:29.271 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:29.272 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:29.272 INFO:tasks.workunit.client.0.smithi019.stdout:7/670: creat da/d24/d28/d1c/d32/d94/fe3 x:0 0 0 2024-09-12T22:11:29.273 INFO:tasks.workunit.client.0.smithi019.stdout:4/654: rename d9/d58/fd4 to d9/d14/d57/d9b/fd7 0 2024-09-12T22:11:29.273 INFO:tasks.workunit.client.0.smithi019.stdout:3/689: symlink d18/d1d/ld8 0 2024-09-12T22:11:29.274 INFO:tasks.workunit.client.0.smithi019.stdout:8/652: symlink d5/dc/d26/d43/ld8 0 2024-09-12T22:11:29.274 INFO:tasks.workunit.client.0.smithi019.stdout:6/774: mkdir d9/dc/d20/d4b/d6c/dfe 0 2024-09-12T22:11:29.274 INFO:tasks.workunit.client.0.smithi019.stdout:2/605: rmdir d0/d31/d12/d3b/dc1 0 2024-09-12T22:11:29.276 INFO:tasks.workunit.client.0.smithi019.stdout:8/653: dread - d5/f51 zero size 2024-09-12T22:11:29.276 INFO:tasks.workunit.client.0.smithi019.stdout:3/690: symlink d18/d1d/d8b/ld9 0 2024-09-12T22:11:29.278 INFO:tasks.workunit.client.0.smithi019.stdout:1/694: dread d1/d2/d18/d35/d84/f5a [0,4194304] 0 2024-09-12T22:11:29.279 INFO:tasks.workunit.client.0.smithi019.stdout:2/606: symlink d0/d3/df/d7b/d80/lc7 0 2024-09-12T22:11:29.280 INFO:tasks.workunit.client.0.smithi019.stdout:7/671: dread da/d19/d25/d39/d51/f75 [0,4194304] 0 2024-09-12T22:11:29.280 INFO:tasks.workunit.client.0.smithi019.stdout:8/654: creat d5/dc/d8d/d96/da7/fd9 x:0 0 0 2024-09-12T22:11:29.281 INFO:tasks.workunit.client.0.smithi019.stdout:9/649: dwrite d12/dd7/dc7/fc2 [0,4194304] 0 2024-09-12T22:11:29.284 INFO:tasks.workunit.client.0.smithi019.stdout:4/655: truncate f5 3933230 0 2024-09-12T22:11:29.284 INFO:tasks.workunit.client.0.smithi019.stdout:6/775: read d9/d3d/f2f [2143,52934] 0 2024-09-12T22:11:29.284 INFO:tasks.workunit.client.0.smithi019.stdout:1/695: mknod d1/d2/d18/d35/d84/dc/df/d53/ce6 0 2024-09-12T22:11:29.288 INFO:tasks.workunit.client.0.smithi019.stdout:9/650: chown d12/d1b/d20/db0/cd9 204210320 1 2024-09-12T22:11:29.288 INFO:tasks.workunit.client.0.smithi019.stdout:4/656: write d9/d14/f38 [9697178,47940] 0 2024-09-12T22:11:29.288 INFO:tasks.workunit.client.0.smithi019.stdout:3/691: dwrite d18/d1d/d8b/fc0 [0,4194304] 0 2024-09-12T22:11:29.290 INFO:tasks.workunit.client.0.smithi019.stdout:7/672: link da/d24/fb7 da/d24/d28/fe4 0 2024-09-12T22:11:29.291 INFO:tasks.workunit.client.0.smithi019.stdout:1/696: dread d1/d2/d18/d70/fae [0,4194304] 0 2024-09-12T22:11:29.292 INFO:tasks.workunit.client.0.smithi019.stdout:9/651: creat d12/dd7/dc7/d92/d9d/da5/fdd x:0 0 0 2024-09-12T22:11:29.293 INFO:tasks.workunit.client.0.smithi019.stdout:1/697: symlink d1/d2/da2/le7 0 2024-09-12T22:11:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:7/673: creat da/d19/d25/d39/d51/dd7/db1/db5/db6/db8/fe5 x:0 0 0 2024-09-12T22:11:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:8/655: dread d5/dc/f2e [0,4194304] 0 2024-09-12T22:11:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:1/698: symlink d1/d2/le8 0 2024-09-12T22:11:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:5/722: dread d0/f4 [0,4194304] 0 2024-09-12T22:11:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:3/692: dwrite d18/d26/da5/fbf [0,4194304] 0 2024-09-12T22:11:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:5/723: unlink d0/ff 0 2024-09-12T22:11:29.302 INFO:tasks.workunit.client.0.smithi019.stdout:3/693: fsync d18/d26/d30/d71/fd1 0 2024-09-12T22:11:29.302 INFO:tasks.workunit.client.0.smithi019.stdout:0/660: dread d5/d7/d10/d26/d2a/f2b [0,4194304] 0 2024-09-12T22:11:29.303 INFO:tasks.workunit.client.0.smithi019.stdout:8/656: dread d5/dc/f6d [0,4194304] 0 2024-09-12T22:11:29.304 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:7/674: dwrite da/d24/d28/d1c/d32/d94/fe3 [0,4194304] 0 2024-09-12T22:11:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:3/694: fdatasync d18/d26/d30/d71/fd1 0 2024-09-12T22:11:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:1/699: rename d1/d2/d18/d35/d84/dc/df/d2c/l9c to d1/d2/d18/d29/d27/le9 0 2024-09-12T22:11:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:0/661: creat d5/d7/de/da3/fdb x:0 0 0 2024-09-12T22:11:29.307 INFO:tasks.workunit.client.0.smithi019.stdout:5/724: creat d0/d1d/d4f/ff7 x:0 0 0 2024-09-12T22:11:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:9/652: dwrite d12/d1b/d20/d59/d5b/fdc [0,4194304] 0 2024-09-12T22:11:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:8/657: link d5/l2d d5/dc/d17/dce/lda 0 2024-09-12T22:11:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:2/607: dread d0/d3/df/d7b/f39 [0,4194304] 0 2024-09-12T22:11:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:3/695: write d18/d26/fb0 [2216765,29558] 0 2024-09-12T22:11:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:5/725: mkdir d0/d1d/d3d/df8 0 2024-09-12T22:11:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:8/658: symlink d5/d53/ldb 0 2024-09-12T22:11:29.310 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:29.311 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:9/653: read - d12/d1b/d20/d59/d5b/d9e/fc1 zero size 2024-09-12T22:11:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:3/696: mknod d18/d58/cda 0 2024-09-12T22:11:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:9/654: readlink d12/lc9 0 2024-09-12T22:11:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:8/659: mknod d5/d53/d66/cdc 0 2024-09-12T22:11:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:9/655: write d12/f1a [3021484,41156] 0 2024-09-12T22:11:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:0/662: truncate d5/d7/d10/f42 3053571 0 2024-09-12T22:11:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:3/697: write d18/d58/f8e [237530,87385] 0 2024-09-12T22:11:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:8/660: creat d5/dc/d8d/d96/da7/fdd x:0 0 0 2024-09-12T22:11:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:9/656: chown d12/d48/f7c 64609494 1 2024-09-12T22:11:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:0/663: mkdir d5/d7/d2c/ddc 0 2024-09-12T22:11:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:4/657: dread d9/db/fd [0,4194304] 0 2024-09-12T22:11:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:1/700: dwrite d1/d2/d18/d59/f75 [0,4194304] 0 2024-09-12T22:11:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:3/698: write d18/d26/d30/d4e/d9a/dae/fc6 [572809,27251] 0 2024-09-12T22:11:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:4/658: fsync d9/d73/d8f/d93/dad/fbc 0 2024-09-12T22:11:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:8/661: creat d5/dc/d26/dc8/fde x:0 0 0 2024-09-12T22:11:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:0/664: rename d5/d7/de/d8d/cad to d5/d7/de/da3/cdd 0 2024-09-12T22:11:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:4/659: mknod d9/d4c/cd8 0 2024-09-12T22:11:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:3/699: chown d18/d26/d30/f67 5 1 2024-09-12T22:11:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:1/701: getdents d1/d2/d18/d35/d84/dc/df/d53 0 2024-09-12T22:11:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:3/700: stat d18/d1d/c76 0 2024-09-12T22:11:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:1/702: symlink d1/d2/d18/d35/d84/dc/df/d53/lea 0 2024-09-12T22:11:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:3/701: write d18/d1d/f3b [4254731,59088] 0 2024-09-12T22:11:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:0/665: link d5/d7/d10/d26/f3e d5/d7/db5/fde 0 2024-09-12T22:11:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:6/776: dread d9/dc/d20/d30/db7/fe2 [0,4194304] 0 2024-09-12T22:11:29.321 INFO:tasks.workunit.client.0.smithi019.stdout:9/657: truncate d12/d1b/d40/d52/d62/f8c 4819754 0 2024-09-12T22:11:29.321 INFO:tasks.workunit.client.0.smithi019.stdout:8/662: truncate d5/dc/d17/f67 1681872 0 2024-09-12T22:11:29.322 INFO:tasks.workunit.client.0.smithi019.stdout:4/660: dread d9/d58/f77 [0,4194304] 0 2024-09-12T22:11:29.322 INFO:tasks.workunit.client.0.smithi019.stdout:3/702: rename d18/d26/d30/d64/cd0 to d18/d26/da5/dbd/cdb 0 2024-09-12T22:11:29.324 INFO:tasks.workunit.client.0.smithi019.stdout:8/663: chown d5/l21 53 1 2024-09-12T22:11:29.324 INFO:tasks.workunit.client.0.smithi019.stdout:4/661: mknod d9/d73/d8f/d93/cd9 0 2024-09-12T22:11:29.324 INFO:tasks.workunit.client.0.smithi019.stdout:3/703: mknod d18/d26/d30/d71/cdc 0 2024-09-12T22:11:29.324 INFO:tasks.workunit.client.0.smithi019.stdout:9/658: creat d12/d1b/d20/d59/d5b/fde x:0 0 0 2024-09-12T22:11:29.325 INFO:tasks.workunit.client.0.smithi019.stdout:8/664: unlink d5/d16/fc2 0 2024-09-12T22:11:29.326 INFO:tasks.workunit.client.0.smithi019.stdout:1/703: write d1/d2/d18/d35/d84/dc/df/d53/d66/f8b [889314,22782] 0 2024-09-12T22:11:29.326 INFO:tasks.workunit.client.0.smithi019.stdout:4/662: write f4 [3189469,8303] 0 2024-09-12T22:11:29.328 INFO:tasks.workunit.client.0.smithi019.stdout:4/663: write d9/d17/fac [276401,75428] 0 2024-09-12T22:11:29.328 INFO:tasks.workunit.client.0.smithi019.stdout:8/665: truncate d5/d16/f83 12589877 0 2024-09-12T22:11:29.328 INFO:tasks.workunit.client.0.smithi019.stdout:6/777: dwrite d9/dc/df7/d7e/fc1 [0,4194304] 0 2024-09-12T22:11:29.331 INFO:tasks.workunit.client.0.smithi019.stdout:4/664: read - d9/d73/d8f/d93/f9d zero size 2024-09-12T22:11:29.331 INFO:tasks.workunit.client.0.smithi019.stdout:9/659: write d12/d1b/d20/d59/d5b/d9e/f76 [1583599,84062] 0 2024-09-12T22:11:29.331 INFO:tasks.workunit.client.0.smithi019.stdout:6/778: symlink d9/dc/dd9/lff 0 2024-09-12T22:11:29.332 INFO:tasks.workunit.client.0.smithi019.stdout:3/704: dwrite d18/d26/f36 [0,4194304] 0 2024-09-12T22:11:29.332 INFO:tasks.workunit.client.0.smithi019.stdout:8/666: creat d5/d16/fdf x:0 0 0 2024-09-12T22:11:29.333 INFO:tasks.workunit.client.0.smithi019.stdout:8/667: chown d5/dc/d17/dce 310086 1 2024-09-12T22:11:29.333 INFO:tasks.workunit.client.0.smithi019.stdout:1/704: truncate d1/d2/d18/d35/d84/dc/f32 1361578 0 2024-09-12T22:11:29.333 INFO:tasks.workunit.client.0.smithi019.stdout:9/660: unlink d12/d1b/d20/f5c 0 2024-09-12T22:11:29.334 INFO:tasks.workunit.client.0.smithi019.stdout:1/705: write d1/fa8 [84680,96631] 0 2024-09-12T22:11:29.334 INFO:tasks.workunit.client.0.smithi019.stdout:6/779: symlink d9/dc/d20/d4b/d6c/dfe/l100 0 2024-09-12T22:11:29.335 INFO:tasks.workunit.client.0.smithi019.stdout:9/661: mkdir d12/dd7/dc7/d74/d77/d86/ddf 0 2024-09-12T22:11:29.336 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:29.335+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:29.336 INFO:tasks.workunit.client.0.smithi019.stdout:6/780: dread - d9/f9d zero size 2024-09-12T22:11:29.336 INFO:tasks.workunit.client.0.smithi019.stdout:2/608: dread d0/d31/d4/f22 [4194304,4194304] 0 2024-09-12T22:11:29.337 INFO:tasks.workunit.client.0.smithi019.stdout:6/781: creat d9/d3d/d6f/f101 x:0 0 0 2024-09-12T22:11:29.338 INFO:tasks.workunit.client.0.smithi019.stdout:4/665: dwrite f5 [0,4194304] 0 2024-09-12T22:11:29.338 INFO:tasks.workunit.client.0.smithi019.stdout:1/706: getdents d1/d2/d18/d35/d84/dc/df 0 2024-09-12T22:11:29.338 INFO:tasks.workunit.client.0.smithi019.stdout:2/609: write d0/d3/d11/d77/d78/d2c/fc6 [227103,72220] 0 2024-09-12T22:11:29.339 INFO:tasks.workunit.client.0.smithi019.stdout:4/666: mknod d9/d87/cda 0 2024-09-12T22:11:29.340 INFO:tasks.workunit.client.0.smithi019.stdout:6/782: mkdir d9/d102 0 2024-09-12T22:11:29.341 INFO:tasks.workunit.client.0.smithi019.stdout:4/667: write d9/db/f99 [2189439,14956] 0 2024-09-12T22:11:29.342 INFO:tasks.workunit.client.0.smithi019.stdout:4/668: mkdir d9/d17/ddb 0 2024-09-12T22:11:29.342 INFO:tasks.workunit.client.0.smithi019.stdout:4/669: stat d9/d17/fac 0 2024-09-12T22:11:29.343 INFO:tasks.workunit.client.0.smithi019.stdout:2/610: dwrite d0/d3/d11/f5b [0,4194304] 0 2024-09-12T22:11:29.344 INFO:tasks.workunit.client.0.smithi019.stdout:0/666: dread d5/d7/f12 [0,4194304] 0 2024-09-12T22:11:29.346 INFO:tasks.workunit.client.0.smithi019.stdout:6/783: dwrite d9/dc/df7/d7d/da7/fb0 [0,4194304] 0 2024-09-12T22:11:29.346 INFO:tasks.workunit.client.0.smithi019.stdout:4/670: mknod d9/d73/d8f/d93/dad/dc0/cdc 0 2024-09-12T22:11:29.346 INFO:tasks.workunit.client.0.smithi019.stdout:2/611: symlink d0/d31/d12/lc8 0 2024-09-12T22:11:29.347 INFO:tasks.workunit.client.0.smithi019.stdout:4/671: dread - d9/db/dcd/fd6 zero size 2024-09-12T22:11:29.347 INFO:tasks.workunit.client.0.smithi019.stdout:0/667: symlink d5/d7/d10/d26/d2a/ldf 0 2024-09-12T22:11:29.348 INFO:tasks.workunit.client.0.smithi019.stdout:0/668: write d5/fd7 [462975,10800] 0 2024-09-12T22:11:29.350 INFO:tasks.workunit.client.0.smithi019.stdout:2/612: creat d0/d3/d11/d77/d78/d2c/d56/d60/fc9 x:0 0 0 2024-09-12T22:11:29.350 INFO:tasks.workunit.client.0.smithi019.stdout:2/613: read - d0/d3/df/d6b/fab zero size 2024-09-12T22:11:29.350 INFO:tasks.workunit.client.0.smithi019.stdout:0/669: creat d5/d7/d2c/fe0 x:0 0 0 2024-09-12T22:11:29.350 INFO:tasks.workunit.client.0.smithi019.stdout:2/614: symlink d0/d3/d11/d77/d82/dc0/lca 0 2024-09-12T22:11:29.351 INFO:tasks.workunit.client.0.smithi019.stdout:2/615: dread - d0/d3/df/d52/f96 zero size 2024-09-12T22:11:29.353 INFO:tasks.workunit.client.0.smithi019.stdout:2/616: truncate d0/d3/df/f2a 4759934 0 2024-09-12T22:11:29.354 INFO:tasks.workunit.client.0.smithi019.stdout:4/672: dwrite d9/d14/d57/fb9 [0,4194304] 0 2024-09-12T22:11:29.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/784: dwrite d9/dc/d20/d4b/f2d [4194304,4194304] 0 2024-09-12T22:11:29.358 INFO:tasks.workunit.client.0.smithi019.stdout:6/785: stat d9/f4e 0 2024-09-12T22:11:29.358 INFO:tasks.workunit.client.0.smithi019.stdout:4/673: write d9/d14/fa5 [878108,38352] 0 2024-09-12T22:11:29.360 INFO:tasks.workunit.client.0.smithi019.stdout:0/670: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:29.360 INFO:tasks.workunit.client.0.smithi019.stdout:6/786: creat d9/d6b/f103 x:0 0 0 2024-09-12T22:11:29.361 INFO:tasks.workunit.client.0.smithi019.stdout:0/671: write d5/d7/d10/f5e [476247,21233] 0 2024-09-12T22:11:29.361 INFO:tasks.workunit.client.0.smithi019.stdout:2/617: truncate d0/d31/d12/d15/fb2 3151624 0 2024-09-12T22:11:29.362 INFO:tasks.workunit.client.0.smithi019.stdout:6/787: creat d9/dc/df7/f104 x:0 0 0 2024-09-12T22:11:29.363 INFO:tasks.workunit.client.0.smithi019.stdout:2/618: fdatasync d0/d3/d11/d77/d78/d2c/fc6 0 2024-09-12T22:11:29.363 INFO:tasks.workunit.client.0.smithi019.stdout:0/672: chown d5/d7/d10/d26/c6b 3783492 1 2024-09-12T22:11:29.363 INFO:tasks.workunit.client.0.smithi019.stdout:2/619: readlink d0/d3/d11/d77/d78/l3c 0 2024-09-12T22:11:29.364 INFO:tasks.workunit.client.0.smithi019.stdout:6/788: creat d9/dc/d20/d71/f105 x:0 0 0 2024-09-12T22:11:29.364 INFO:tasks.workunit.client.0.smithi019.stdout:4/674: dwrite d9/d17/fac [0,4194304] 0 2024-09-12T22:11:29.367 INFO:tasks.workunit.client.0.smithi019.stdout:4/675: rename d9/d73/d8f/d93/dad/dc0 to d9/d14/d57/d95/d96/ddd 0 2024-09-12T22:11:29.367 INFO:tasks.workunit.client.0.smithi019.stdout:6/789: creat d9/dc/d20/f106 x:0 0 0 2024-09-12T22:11:29.367 INFO:tasks.workunit.client.0.smithi019.stdout:6/790: write d9/dc/d20/fba [3678413,52045] 0 2024-09-12T22:11:29.369 INFO:tasks.workunit.client.0.smithi019.stdout:4/676: rename d9/d14/d57/d95/dbe/dc6/d3f/c43 to d9/d14/d57/d95/d96/ddd/cde 0 2024-09-12T22:11:29.370 INFO:tasks.workunit.client.0.smithi019.stdout:1/707: dread d1/d2/d18/d29/d27/f6a [0,4194304] 0 2024-09-12T22:11:29.370 INFO:tasks.workunit.client.0.smithi019.stdout:2/620: dwrite d0/d31/d12/d3b/d5c/fb4 [0,4194304] 0 2024-09-12T22:11:29.371 INFO:tasks.workunit.client.0.smithi019.stdout:2/621: fsync d0/d3/d11/d2e/d34/fa5 0 2024-09-12T22:11:29.372 INFO:tasks.workunit.client.0.smithi019.stdout:9/662: dread d12/f1a [0,4194304] 0 2024-09-12T22:11:29.373 INFO:tasks.workunit.client.0.smithi019.stdout:4/677: creat d9/d4c/fdf x:0 0 0 2024-09-12T22:11:29.373 INFO:tasks.workunit.client.0.smithi019.stdout:9/663: chown d12/d48/f61 24912836 1 2024-09-12T22:11:29.374 INFO:tasks.workunit.client.0.smithi019.stdout:1/708: unlink d1/d2/d18/d35/d84/dc/df/d53/cbb 0 2024-09-12T22:11:29.374 INFO:tasks.workunit.client.0.smithi019.stdout:6/791: dwrite d9/dc/d20/d4b/f2c [0,4194304] 0 2024-09-12T22:11:29.377 INFO:tasks.workunit.client.0.smithi019.stdout:2/622: rename d0/d31/d12/d3b/l4e to d0/d3/d11/d77/d78/d2c/d2d/lcb 0 2024-09-12T22:11:29.377 INFO:tasks.workunit.client.0.smithi019.stdout:1/709: write d1/d2/d18/d35/d84/dc/df/d2c/f63 [562900,11532] 0 2024-09-12T22:11:29.377 INFO:tasks.workunit.client.0.smithi019.stdout:6/792: truncate d9/dc/df7/d7e/fce 700709 0 2024-09-12T22:11:29.377 INFO:tasks.workunit.client.0.smithi019.stdout:4/678: rename d9/d17/da1 to d9/db/d2b/de0 0 2024-09-12T22:11:29.377 INFO:tasks.workunit.client.0.smithi019.stdout:6/793: write d9/d3d/d4f/f5e [6666846,50604] 0 2024-09-12T22:11:29.378 INFO:tasks.workunit.client.0.smithi019.stdout:2/623: symlink d0/d3/d11/d77/d78/d2c/d30/d32/lcc 0 2024-09-12T22:11:29.379 INFO:tasks.workunit.client.0.smithi019.stdout:4/679: dread d9/d73/fd0 [0,4194304] 0 2024-09-12T22:11:29.381 INFO:tasks.workunit.client.0.smithi019.stdout:6/794: truncate d9/dc/f13 2015111 0 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13905 4.16 4:6b7b9fa8:::100000036da.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.374102+0000", 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0074034110000000004, 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074248220000000002, 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13905 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.374102+0000", 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.374102+0000", 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.374103+0000", 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7000000000000003e-07 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.378488+0000", 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043852919999999998 2024-09-12T22:11:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.378500+0000", 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2123000000000001e-05 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.378507+0000", 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1119999999999998e-06 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.378591+0000", 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3609000000000005e-05 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.378733+0000", 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014203600000000001 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.378857+0000", 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012422600000000001 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-09-12T22:11:29.387 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:29.387 INFO:tasks.workunit.client.0.smithi019.stdout:9/664: dwrite d12/d1b/d40/d52/d62/f8c [0,4194304] 0 2024-09-12T22:11:29.387 INFO:tasks.workunit.client.0.smithi019.stdout:1/710: dwrite d1/d2/d18/d35/d84/d98/fc2 [0,4194304] 0 2024-09-12T22:11:29.388 INFO:tasks.workunit.client.0.smithi019.stdout:4/680: truncate d9/db/d2b/f37 732856 0 2024-09-12T22:11:29.388 INFO:tasks.workunit.client.0.smithi019.stdout:9/665: rename d12/dd7/dc7/c71 to d12/dd7/ce0 0 2024-09-12T22:11:29.388 INFO:tasks.workunit.client.0.smithi019.stdout:4/681: getdents d9/d4c/d9c 0 2024-09-12T22:11:29.388 INFO:tasks.workunit.client.0.smithi019.stdout:4/682: readlink d9/db/d2b/d6a/l79 0 2024-09-12T22:11:29.392 INFO:tasks.workunit.client.0.smithi019.stdout:7/675: sync 2024-09-12T22:11:29.393 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:29.397 INFO:tasks.workunit.client.0.smithi019.stdout:4/683: dread d9/d4c/d9c/f9e [0,4194304] 0 2024-09-12T22:11:29.397 INFO:tasks.workunit.client.0.smithi019.stdout:9/666: dread d12/d1b/d40/f57 [0,4194304] 0 2024-09-12T22:11:29.397 INFO:tasks.workunit.client.0.smithi019.stdout:6/795: dread d9/dc/d20/d30/f42 [0,4194304] 0 2024-09-12T22:11:29.397 INFO:tasks.workunit.client.0.smithi019.stdout:6/796: stat d9/dc/dd9/lff 0 2024-09-12T22:11:29.399 INFO:tasks.workunit.client.0.smithi019.stdout:9/667: getdents d12/d48 0 2024-09-12T22:11:29.399 INFO:tasks.workunit.client.0.smithi019.stdout:7/676: dwrite da/d24/d28/fe4 [0,4194304] 0 2024-09-12T22:11:29.399 INFO:tasks.workunit.client.0.smithi019.stdout:1/711: dread d1/d2/da2/fa5 [0,4194304] 0 2024-09-12T22:11:29.400 INFO:tasks.workunit.client.0.smithi019.stdout:1/712: fsync d1/d2/d18/d35/d84/dc/df/d2c/f42 0 2024-09-12T22:11:29.401 INFO:tasks.workunit.client.0.smithi019.stdout:7/677: rename da/d30/lbd to da/d24/d28/d1c/d32/d5e/dc3/le6 0 2024-09-12T22:11:29.401 INFO:tasks.workunit.client.0.smithi019.stdout:1/713: rmdir d1/d83 39 2024-09-12T22:11:29.401 INFO:tasks.workunit.client.0.smithi019.stdout:9/668: creat d12/fe1 x:0 0 0 2024-09-12T22:11:29.402 INFO:tasks.workunit.client.0.smithi019.stdout:9/669: readlink d12/d1b/d40/d85/lba 0 2024-09-12T22:11:29.402 INFO:tasks.workunit.client.0.smithi019.stdout:4/684: truncate d9/db/f99 3026926 0 2024-09-12T22:11:29.403 INFO:tasks.workunit.client.0.smithi019.stdout:9/670: link d12/d1b/d20/l4e d12/d1b/d20/d64/d83/dd1/le2 0 2024-09-12T22:11:29.405 INFO:tasks.workunit.client.0.smithi019.stdout:1/714: write d1/d2/d18/d35/d84/dc/df/d53/d66/f8c [1350879,9463] 0 2024-09-12T22:11:29.405 INFO:tasks.workunit.client.0.smithi019.stdout:9/671: rename d12/d1b/d20/dbc to d12/dd7/dc7/d74/de3 0 2024-09-12T22:11:29.405 INFO:tasks.workunit.client.0.smithi019.stdout:4/685: getdents d9/db/dcd 0 2024-09-12T22:11:29.406 INFO:tasks.workunit.client.0.smithi019.stdout:6/797: dread d9/dc/f52 [0,4194304] 0 2024-09-12T22:11:29.406 INFO:tasks.workunit.client.0.smithi019.stdout:7/678: read da/d19/d25/d39/f6b [66675,118231] 0 2024-09-12T22:11:29.407 INFO:tasks.workunit.client.0.smithi019.stdout:2/624: dread d0/f42 [0,4194304] 0 2024-09-12T22:11:29.407 INFO:tasks.workunit.client.0.smithi019.stdout:1/715: write d1/d2/d18/d35/d84/dc/df/d2c/f63 [2135812,5460] 0 2024-09-12T22:11:29.407 INFO:tasks.workunit.client.0.smithi019.stdout:7/679: readlink da/l5f 0 2024-09-12T22:11:29.407 INFO:tasks.workunit.client.0.smithi019.stdout:6/798: rename d9/dc/d20/d71/f105 to d9/d3d/db8/f107 0 2024-09-12T22:11:29.408 INFO:tasks.workunit.client.0.smithi019.stdout:6/799: creat d9/d3d/d4f/d59/d79/f108 x:0 0 0 2024-09-12T22:11:29.409 INFO:tasks.workunit.client.0.smithi019.stdout:7/680: mknod da/d19/d25/d39/d51/dd7/db1/ce7 0 2024-09-12T22:11:29.409 INFO:tasks.workunit.client.0.smithi019.stdout:1/716: rename d1/d2/d18/d35/d84/l15 to d1/d37/leb 0 2024-09-12T22:11:29.412 INFO:tasks.workunit.client.0.smithi019.stdout:9/672: dread d12/d1b/d40/f6f [0,4194304] 0 2024-09-12T22:11:29.413 INFO:tasks.workunit.client.0.smithi019.stdout:9/673: chown d12/d1b/d20/f2a 0 1 2024-09-12T22:11:29.413 INFO:tasks.workunit.client.0.smithi019.stdout:7/681: rename da/d30/d9c/la8 to da/d24/d28/d1c/d32/d99/d9f/le8 0 2024-09-12T22:11:29.413 INFO:tasks.workunit.client.0.smithi019.stdout:7/682: write da/d24/fbb [671143,1371] 0 2024-09-12T22:11:29.413 INFO:tasks.workunit.client.0.smithi019.stdout:1/717: link d1/d2/f24 d1/d2/d18/d35/d84/dc/df/d53/fec 0 2024-09-12T22:11:29.413 INFO:tasks.workunit.client.0.smithi019.stdout:4/686: write d9/db/f99 [3057185,100301] 0 2024-09-12T22:11:29.413 INFO:tasks.workunit.client.0.smithi019.stdout:2/625: dwrite d0/d31/d12/d15/fa0 [0,4194304] 0 2024-09-12T22:11:29.414 INFO:tasks.workunit.client.0.smithi019.stdout:4/687: truncate d9/d87/fae 1356104 0 2024-09-12T22:11:29.416 INFO:tasks.workunit.client.0.smithi019.stdout:9/674: link d12/dd7/dc7/d88/f89 d12/d1b/d40/fe4 0 2024-09-12T22:11:29.416 INFO:tasks.workunit.client.0.smithi019.stdout:6/800: dwrite d9/dc/dd9/fee [0,4194304] 0 2024-09-12T22:11:29.416 INFO:tasks.workunit.client.0.smithi019.stdout:4/688: chown d9/c15 14 1 2024-09-12T22:11:29.416 INFO:tasks.workunit.client.0.smithi019.stdout:2/626: creat d0/fcd x:0 0 0 2024-09-12T22:11:29.418 INFO:tasks.workunit.client.0.smithi019.stdout:9/675: unlink d12/d1b/d20/d59/d5b/d9e/l5a 0 2024-09-12T22:11:29.419 INFO:tasks.workunit.client.0.smithi019.stdout:7/683: write da/d30/da5/fcd [6219511,45268] 0 2024-09-12T22:11:29.419 INFO:tasks.workunit.client.0.smithi019.stdout:1/718: dwrite d1/d2/d18/d29/d27/f23 [0,4194304] 0 2024-09-12T22:11:29.419 INFO:tasks.workunit.client.0.smithi019.stdout:6/801: rename d9/d3d/d4f/d8d/fd2 to d9/dc/df7/d7e/f109 0 2024-09-12T22:11:29.420 INFO:tasks.workunit.client.0.smithi019.stdout:1/719: symlink d1/d2/da2/led 0 2024-09-12T22:11:29.420 INFO:tasks.workunit.client.0.smithi019.stdout:4/689: stat d9/d14/d57/d95/dbe/dc6/d3f/l70 0 2024-09-12T22:11:29.420 INFO:tasks.workunit.client.0.smithi019.stdout:2/627: rename d0/d3/d11/d2e/d34 to d0/d3/d11/d2e/d64/dce 0 2024-09-12T22:11:29.421 INFO:tasks.workunit.client.0.smithi019.stdout:9/676: truncate d12/d1b/d40/fe4 651860 0 2024-09-12T22:11:29.421 INFO:tasks.workunit.client.0.smithi019.stdout:6/802: mknod d9/dc/d20/d4b/d6c/c10a 0 2024-09-12T22:11:29.421 INFO:tasks.workunit.client.0.smithi019.stdout:1/720: dread - d1/d2/d18/d29/d27/fd9 zero size 2024-09-12T22:11:29.422 INFO:tasks.workunit.client.0.smithi019.stdout:6/803: creat d9/dc/df7/d78/da1/f10b x:0 0 0 2024-09-12T22:11:29.423 INFO:tasks.workunit.client.0.smithi019.stdout:9/677: creat d12/d1b/d20/d64/d83/dd1/fe5 x:0 0 0 2024-09-12T22:11:29.424 INFO:tasks.workunit.client.0.smithi019.stdout:1/721: rename d1/d2/d18/d29/d27/f23 to d1/d2/d18/d35/d84/fee 0 2024-09-12T22:11:29.425 INFO:tasks.workunit.client.0.smithi019.stdout:9/678: chown d12/d1b/d20/d59/d5b/d9e/fc1 121241 1 2024-09-12T22:11:29.426 INFO:tasks.workunit.client.0.smithi019.stdout:1/722: creat d1/d2/d18/d29/fef x:0 0 0 2024-09-12T22:11:29.427 INFO:tasks.workunit.client.0.smithi019.stdout:4/690: dwrite d9/d4c/f88 [0,4194304] 0 2024-09-12T22:11:29.427 INFO:tasks.workunit.client.0.smithi019.stdout:2/628: dwrite d0/d3/d11/f10 [0,4194304] 0 2024-09-12T22:11:29.429 INFO:tasks.workunit.client.0.smithi019.stdout:6/804: dwrite d9/dc/df7/d7d/da7/fb0 [0,4194304] 0 2024-09-12T22:11:29.430 INFO:tasks.workunit.client.0.smithi019.stdout:2/629: symlink d0/d3/d11/d77/d78/d2c/d56/d60/lcf 0 2024-09-12T22:11:29.430 INFO:tasks.workunit.client.0.smithi019.stdout:1/723: creat d1/ddb/ff0 x:0 0 0 2024-09-12T22:11:29.434 INFO:tasks.workunit.client.0.smithi019.stdout:7/684: dwrite da/d19/d25/d39/fa0 [0,4194304] 0 2024-09-12T22:11:29.435 INFO:tasks.workunit.client.0.smithi019.stdout:2/630: dread d0/d31/d12/d15/fa0 [0,4194304] 0 2024-09-12T22:11:29.435 INFO:tasks.workunit.client.0.smithi019.stdout:1/724: write d1/d2/d18/d35/d84/dc/df/d53/d55/faa [1161718,111403] 0 2024-09-12T22:11:29.437 INFO:tasks.workunit.client.0.smithi019.stdout:7/685: write da/d24/d28/d1c/d32/daf/fdb [993989,29436] 0 2024-09-12T22:11:29.437 INFO:tasks.workunit.client.0.smithi019.stdout:1/725: write d1/d2/d18/d35/d84/dc/f28 [2683451,32116] 0 2024-09-12T22:11:29.437 INFO:tasks.workunit.client.0.smithi019.stdout:2/631: write d0/d3/f66 [45449,83381] 0 2024-09-12T22:11:29.437 INFO:tasks.workunit.client.0.smithi019.stdout:9/679: read d12/dd7/dc7/d56/d60/f67 [3659879,20515] 0 2024-09-12T22:11:29.438 INFO:tasks.workunit.client.0.smithi019.stdout:6/805: truncate d9/dc/dd9/fee 1129323 0 2024-09-12T22:11:29.438 INFO:tasks.workunit.client.0.smithi019.stdout:9/680: dread - ff zero size 2024-09-12T22:11:29.438 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:29.436+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:29.439 INFO:tasks.workunit.client.0.smithi019.stdout:2/632: truncate d0/d31/d12/f83 217548 0 2024-09-12T22:11:29.439 INFO:tasks.workunit.client.0.smithi019.stdout:1/726: rename d1/d2/cd8 to d1/d2/d18/d35/cf1 0 2024-09-12T22:11:29.440 INFO:tasks.workunit.client.0.smithi019.stdout:6/806: truncate d9/d3d/d4f/d8d/fc4 1047808 0 2024-09-12T22:11:29.440 INFO:tasks.workunit.client.0.smithi019.stdout:9/681: write d12/d1b/d40/d52/fb8 [1196491,23527] 0 2024-09-12T22:11:29.440 INFO:tasks.workunit.client.0.smithi019.stdout:2/633: chown d0/d3/df/c4d 98435294 1 2024-09-12T22:11:29.441 INFO:tasks.workunit.client.0.smithi019.stdout:9/682: chown f4 6 1 2024-09-12T22:11:29.441 INFO:tasks.workunit.client.0.smithi019.stdout:6/807: write d9/d3d/d4f/d59/fda [396508,57820] 0 2024-09-12T22:11:29.441 INFO:tasks.workunit.client.0.smithi019.stdout:2/634: stat d0/d3/df/d7b/d80/d9a/daa 0 2024-09-12T22:11:29.441 INFO:tasks.workunit.client.0.smithi019.stdout:9/683: chown d12/d1b/d20/d59/d5b/fdc 123 1 2024-09-12T22:11:29.441 INFO:tasks.workunit.client.0.smithi019.stdout:7/686: dwrite da/f47 [0,4194304] 0 2024-09-12T22:11:29.442 INFO:tasks.workunit.client.0.smithi019.stdout:1/727: fsync d1/d2/d18/d35/d84/dc/fa6 0 2024-09-12T22:11:29.442 INFO:tasks.workunit.client.0.smithi019.stdout:2/635: fsync d0/d31/d4/f22 0 2024-09-12T22:11:29.442 INFO:tasks.workunit.client.0.smithi019.stdout:9/684: mkdir d12/d1b/d40/d52/d62/de6 0 2024-09-12T22:11:29.443 INFO:tasks.workunit.client.0.smithi019.stdout:2/636: creat d0/d3/df/d52/fd0 x:0 0 0 2024-09-12T22:11:29.447 INFO:tasks.workunit.client.0.smithi019.stdout:7/687: dwrite da/d19/d25/d39/f6b [0,4194304] 0 2024-09-12T22:11:29.447 INFO:tasks.workunit.client.0.smithi019.stdout:2/637: link d0/d3/d11/d77/d78/l3c d0/d3/d11/d77/d78/d2c/d4c/ld1 0 2024-09-12T22:11:29.447 INFO:tasks.workunit.client.0.smithi019.stdout:9/685: dwrite d12/dd7/dc7/d74/d77/fcc [0,4194304] 0 2024-09-12T22:11:29.448 INFO:tasks.workunit.client.0.smithi019.stdout:8/668: sync 2024-09-12T22:11:29.448 INFO:tasks.workunit.client.0.smithi019.stdout:5/726: sync 2024-09-12T22:11:29.448 INFO:tasks.workunit.client.0.smithi019.stdout:0/673: sync 2024-09-12T22:11:29.448 INFO:tasks.workunit.client.0.smithi019.stdout:3/705: sync 2024-09-12T22:11:29.450 INFO:tasks.workunit.client.0.smithi019.stdout:9/686: mkdir d12/d1b/d40/d52/d62/de7 0 2024-09-12T22:11:29.450 INFO:tasks.workunit.client.0.smithi019.stdout:0/674: fdatasync d5/d7/de/fda 0 2024-09-12T22:11:29.450 INFO:tasks.workunit.client.0.smithi019.stdout:3/706: creat d18/d26/d30/d4e/fdd x:0 0 0 2024-09-12T22:11:29.452 INFO:tasks.workunit.client.0.smithi019.stdout:7/688: creat da/d24/d28/d1c/fe9 x:0 0 0 2024-09-12T22:11:29.452 INFO:tasks.workunit.client.0.smithi019.stdout:1/728: dread d1/fce [0,4194304] 0 2024-09-12T22:11:29.452 INFO:tasks.workunit.client.0.smithi019.stdout:5/727: creat d0/ff9 x:0 0 0 2024-09-12T22:11:29.454 INFO:tasks.workunit.client.0.smithi019.stdout:0/675: creat d5/d7/d2c/d44/d6a/d52/fe1 x:0 0 0 2024-09-12T22:11:29.455 INFO:tasks.workunit.client.0.smithi019.stdout:7/689: symlink da/d24/d28/lea 0 2024-09-12T22:11:29.455 INFO:tasks.workunit.client.0.smithi019.stdout:9/687: getdents d12/dd7/dc7/d74/d77/d86 0 2024-09-12T22:11:29.456 INFO:tasks.workunit.client.0.smithi019.stdout:2/638: dwrite d0/d3/d11/d77/d78/d2c/d56/d60/fc9 [0,4194304] 0 2024-09-12T22:11:29.456 INFO:tasks.workunit.client.0.smithi019.stdout:5/728: rename d0/d26/d42/cf3 to d0/d4e/cfa 0 2024-09-12T22:11:29.457 INFO:tasks.workunit.client.0.smithi019.stdout:0/676: stat d5/d7/de/d9a/fa5 0 2024-09-12T22:11:29.457 INFO:tasks.workunit.client.0.smithi019.stdout:9/688: rmdir d12/d1b/d40 39 2024-09-12T22:11:29.458 INFO:tasks.workunit.client.0.smithi019.stdout:5/729: fdatasync d0/d26/d3a/fa0 0 2024-09-12T22:11:29.459 INFO:tasks.workunit.client.0.smithi019.stdout:8/669: dwrite d5/f42 [4194304,4194304] 0 2024-09-12T22:11:29.459 INFO:tasks.workunit.client.0.smithi019.stdout:9/689: rmdir d12/dd7/dc7/d74 39 2024-09-12T22:11:29.459 INFO:tasks.workunit.client.0.smithi019.stdout:0/677: rename d5/d7/de/da3 to d5/de2 0 2024-09-12T22:11:29.460 INFO:tasks.workunit.client.0.smithi019.stdout:5/730: stat d0/d1d/d3d/f3e 0 2024-09-12T22:11:29.460 INFO:tasks.workunit.client.0.smithi019.stdout:2/639: truncate d0/d3/d11/d77/d78/d2c/fc6 827304 0 2024-09-12T22:11:29.461 INFO:tasks.workunit.client.0.smithi019.stdout:1/729: rename d1/d2/d18/d35/d84/dc/df/l10 to d1/d2/d18/d35/d84/dc/df/d2c/d5d/ddd/lf2 0 2024-09-12T22:11:29.461 INFO:tasks.workunit.client.0.smithi019.stdout:9/690: write d12/f45 [257641,108668] 0 2024-09-12T22:11:29.461 INFO:tasks.workunit.client.0.smithi019.stdout:4/691: dread d9/d14/d33/d4e/f85 [0,4194304] 0 2024-09-12T22:11:29.463 INFO:tasks.workunit.client.0.smithi019.stdout:7/690: dwrite da/d24/fcf [0,4194304] 0 2024-09-12T22:11:29.463 INFO:tasks.workunit.client.0.smithi019.stdout:8/670: read d5/d16/d19/f50 [1300014,17059] 0 2024-09-12T22:11:29.463 INFO:tasks.workunit.client.0.smithi019.stdout:0/678: dread - d5/d7/d2c/d81/fa2 zero size 2024-09-12T22:11:29.463 INFO:tasks.workunit.client.0.smithi019.stdout:9/691: write d12/d1b/f32 [2878149,121054] 0 2024-09-12T22:11:29.464 INFO:tasks.workunit.client.0.smithi019.stdout:1/730: chown d1/d2/d18/d29/d51/f85 7783527 1 2024-09-12T22:11:29.464 INFO:tasks.workunit.client.0.smithi019.stdout:4/692: rename d9/d17/f2c to d9/d73/d8f/d93/fe1 0 2024-09-12T22:11:29.464 INFO:tasks.workunit.client.0.smithi019.stdout:3/707: dread d18/d58/f8e [0,4194304] 0 2024-09-12T22:11:29.465 INFO:tasks.workunit.client.0.smithi019.stdout:2/640: rename d0/d3/df/d7b/f39 to d0/d3/df/d52/fd2 0 2024-09-12T22:11:29.465 INFO:tasks.workunit.client.0.smithi019.stdout:8/671: chown d5/d16/d19/f5b 1370314 1 2024-09-12T22:11:29.466 INFO:tasks.workunit.client.0.smithi019.stdout:9/692: mkdir d12/d1b/d40/d85/de8 0 2024-09-12T22:11:29.466 INFO:tasks.workunit.client.0.smithi019.stdout:0/679: creat d5/d7/d2c/d44/d6a/d46/fe3 x:0 0 0 2024-09-12T22:11:29.467 INFO:tasks.workunit.client.0.smithi019.stdout:4/693: rename d9/d17/db3 to d9/d73/de2 0 2024-09-12T22:11:29.468 INFO:tasks.workunit.client.0.smithi019.stdout:0/680: mkdir d5/d7/d2c/d81/de4 0 2024-09-12T22:11:29.469 INFO:tasks.workunit.client.0.smithi019.stdout:2/641: mknod d0/d3/d11/d2e/cd3 0 2024-09-12T22:11:29.469 INFO:tasks.workunit.client.0.smithi019.stdout:8/672: creat d5/dc/d26/d43/d7d/fe0 x:0 0 0 2024-09-12T22:11:29.471 INFO:tasks.workunit.client.0.smithi019.stdout:5/731: dwrite d0/d1d/d3d/f90 [0,4194304] 0 2024-09-12T22:11:29.471 INFO:tasks.workunit.client.0.smithi019.stdout:4/694: mknod d9/d14/d33/d4e/d66/ce3 0 2024-09-12T22:11:29.471 INFO:tasks.workunit.client.0.smithi019.stdout:7/691: dwrite da/d19/fa4 [0,4194304] 0 2024-09-12T22:11:29.471 INFO:tasks.workunit.client.0.smithi019.stdout:3/708: truncate d18/d1d/d8b/fa0 72126 0 2024-09-12T22:11:29.473 INFO:tasks.workunit.client.0.smithi019.stdout:4/695: mknod d9/d87/ce4 0 2024-09-12T22:11:29.473 INFO:tasks.workunit.client.0.smithi019.stdout:8/673: write d5/dc/d8d/fb0 [130702,14805] 0 2024-09-12T22:11:29.473 INFO:tasks.workunit.client.0.smithi019.stdout:0/681: symlink d5/d7/d2c/d81/de4/le5 0 2024-09-12T22:11:29.473 INFO:tasks.workunit.client.0.smithi019.stdout:2/642: chown d0/d3/df/d7b/d80/c99 1 1 2024-09-12T22:11:29.473 INFO:tasks.workunit.client.0.smithi019.stdout:9/693: link d12/dd7/dc7/d92/d9d/da5/fd8 d12/dd7/dc7/d74/d77/fe9 0 2024-09-12T22:11:29.473 INFO:tasks.workunit.client.0.smithi019.stdout:5/732: sync 2024-09-12T22:11:29.473 INFO:tasks.workunit.client.0.smithi019.stdout:8/674: sync 2024-09-12T22:11:29.474 INFO:tasks.workunit.client.0.smithi019.stdout:0/682: chown d5/d7/d10/c78 822517412 1 2024-09-12T22:11:29.474 INFO:tasks.workunit.client.0.smithi019.stdout:4/696: write d9/d17/f84 [1001850,22179] 0 2024-09-12T22:11:29.475 INFO:tasks.workunit.client.0.smithi019.stdout:5/733: chown d0/d24/d97/ce5 1 1 2024-09-12T22:11:29.476 INFO:tasks.workunit.client.0.smithi019.stdout:8/675: creat d5/dc/d8d/dcb/fe1 x:0 0 0 2024-09-12T22:11:29.476 INFO:tasks.workunit.client.0.smithi019.stdout:5/734: chown d0 2065280487 1 2024-09-12T22:11:29.477 INFO:tasks.workunit.client.0.smithi019.stdout:6/808: dread d9/dc/d20/f14 [4194304,4194304] 0 2024-09-12T22:11:29.477 INFO:tasks.workunit.client.0.smithi019.stdout:7/692: truncate da/d19/f50 602044 0 2024-09-12T22:11:29.478 INFO:tasks.workunit.client.0.smithi019.stdout:9/694: creat d12/d1b/d20/fea x:0 0 0 2024-09-12T22:11:29.479 INFO:tasks.workunit.client.0.smithi019.stdout:6/809: fsync d9/d3d/d6f/f86 0 2024-09-12T22:11:29.479 INFO:tasks.workunit.client.0.smithi019.stdout:3/709: dwrite d18/fc8 [0,4194304] 0 2024-09-12T22:11:29.479 INFO:tasks.workunit.client.0.smithi019.stdout:0/683: write d5/d7/d10/d26/d2a/f5d [704432,55499] 0 2024-09-12T22:11:29.479 INFO:tasks.workunit.client.0.smithi019.stdout:7/693: mkdir da/d19/d25/deb 0 2024-09-12T22:11:29.480 INFO:tasks.workunit.client.0.smithi019.stdout:7/694: sync 2024-09-12T22:11:29.482 INFO:tasks.workunit.client.0.smithi019.stdout:6/810: creat d9/dc/df7/d7d/da7/f10c x:0 0 0 2024-09-12T22:11:29.482 INFO:tasks.workunit.client.0.smithi019.stdout:0/684: mkdir d5/d7/d10/d26/d2a/d94/de6 0 2024-09-12T22:11:29.482 INFO:tasks.workunit.client.0.smithi019.stdout:7/695: dread - da/f76 zero size 2024-09-12T22:11:29.482 INFO:tasks.workunit.client.0.smithi019.stdout:4/697: getdents d9/d14/d57/d9b 0 2024-09-12T22:11:29.483 INFO:tasks.workunit.client.0.smithi019.stdout:9/695: read d12/d1b/d20/d59/d5b/d9a/fa7 [76545,48609] 0 2024-09-12T22:11:29.484 INFO:tasks.workunit.client.0.smithi019.stdout:5/735: dwrite d0/d26/d5f/f9e [0,4194304] 0 2024-09-12T22:11:29.484 INFO:tasks.workunit.client.0.smithi019.stdout:3/710: truncate d18/d1d/d8b/dc5/dbb/fd7 280587 0 2024-09-12T22:11:29.484 INFO:tasks.workunit.client.0.smithi019.stdout:0/685: rmdir d5/d7/d2c/d81/dcb 39 2024-09-12T22:11:29.486 INFO:tasks.workunit.client.0.smithi019.stdout:6/811: write d9/d3d/d4f/d8d/fe1 [696638,69824] 0 2024-09-12T22:11:29.486 INFO:tasks.workunit.client.0.smithi019.stdout:4/698: write d9/d14/d57/d95/dbe/dc6/f5c [579809,65732] 0 2024-09-12T22:11:29.486 INFO:tasks.workunit.client.0.smithi019.stdout:7/696: creat da/d30/da5/fec x:0 0 0 2024-09-12T22:11:29.486 INFO:tasks.workunit.client.0.smithi019.stdout:0/686: chown d5/c19 7122906 1 2024-09-12T22:11:29.487 INFO:tasks.workunit.client.0.smithi019.stdout:8/676: dwrite d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:29.487 INFO:tasks.workunit.client.0.smithi019.stdout:5/736: truncate d0/d26/d5f/f8e 4639823 0 2024-09-12T22:11:29.487 INFO:tasks.workunit.client.0.smithi019.stdout:9/696: link d12/d1b/d40/d52/d62/f8c d12/dd7/dc7/d92/d9d/feb 0 2024-09-12T22:11:29.488 INFO:tasks.workunit.client.0.smithi019.stdout:1/731: dread d1/d2/d18/d35/d84/dc/df/d53/d55/f8f [0,4194304] 0 2024-09-12T22:11:29.488 INFO:tasks.workunit.client.0.smithi019.stdout:6/812: chown d9/dc/d20/d4b/d6c/ff4 6 1 2024-09-12T22:11:29.489 INFO:tasks.workunit.client.0.smithi019.stdout:9/697: write ff [71239,9904] 0 2024-09-12T22:11:29.489 INFO:tasks.workunit.client.0.smithi019.stdout:3/711: truncate d18/d26/d30/d4a/f62 2628476 0 2024-09-12T22:11:29.490 INFO:tasks.workunit.client.0.smithi019.stdout:5/737: rename d0/l41 to d0/d1d/d4f/d47/d57/dba/ddb/lfb 0 2024-09-12T22:11:29.491 INFO:tasks.workunit.client.0.smithi019.stdout:3/712: dread - d18/d26/d30/d71/fd1 zero size 2024-09-12T22:11:29.491 INFO:tasks.workunit.client.0.smithi019.stdout:1/732: mknod d1/d2/d18/d35/d84/dc/df/d53/dc0/cf3 0 2024-09-12T22:11:29.491 INFO:tasks.workunit.client.0.smithi019.stdout:4/699: dread d9/d14/fa2 [0,4194304] 0 2024-09-12T22:11:29.492 INFO:tasks.workunit.client.0.smithi019.stdout:1/733: write d1/fa8 [12387,2925] 0 2024-09-12T22:11:29.493 INFO:tasks.workunit.client.0.smithi019.stdout:3/713: mkdir d18/d26/dde 0 2024-09-12T22:11:29.493 INFO:tasks.workunit.client.0.smithi019.stdout:5/738: symlink d0/d1d/d4f/d47/d57/dba/ddb/lfc 0 2024-09-12T22:11:29.493 INFO:tasks.workunit.client.0.smithi019.stdout:1/734: fsync d1/d2/d18/f1c 0 2024-09-12T22:11:29.494 INFO:tasks.workunit.client.0.smithi019.stdout:4/700: chown d9/d14/d33/d4e/c52 6201101 1 2024-09-12T22:11:29.494 INFO:tasks.workunit.client.0.smithi019.stdout:3/714: mknod d18/d26/d30/d4e/cdf 0 2024-09-12T22:11:29.494 INFO:tasks.workunit.client.0.smithi019.stdout:4/701: chown d9/d17 14 1 2024-09-12T22:11:29.495 INFO:tasks.workunit.client.0.smithi019.stdout:9/698: dwrite d12/d1b/d20/f2a [0,4194304] 0 2024-09-12T22:11:29.496 INFO:tasks.workunit.client.0.smithi019.stdout:3/715: unlink d18/d26/fac 0 2024-09-12T22:11:29.497 INFO:tasks.workunit.client.0.smithi019.stdout:4/702: rename d9/d73/dd2 to d9/de5 0 2024-09-12T22:11:29.497 INFO:tasks.workunit.client.0.smithi019.stdout:9/699: write d12/d1b/d20/d25/f5d [660175,3770] 0 2024-09-12T22:11:29.498 INFO:tasks.workunit.client.0.smithi019.stdout:0/687: read d5/d87/f8b [6075,48481] 0 2024-09-12T22:11:29.498 INFO:tasks.workunit.client.0.smithi019.stdout:3/716: chown d18/d26/c45 218895 1 2024-09-12T22:11:29.498 INFO:tasks.workunit.client.0.smithi019.stdout:5/739: dread d0/d1d/d3d/f90 [0,4194304] 0 2024-09-12T22:11:29.498 INFO:tasks.workunit.client.0.smithi019.stdout:4/703: write d9/d17/f84 [1843841,123252] 0 2024-09-12T22:11:29.498 INFO:tasks.workunit.client.0.smithi019.stdout:9/700: chown d12/d1b/d20/f36 188641 1 2024-09-12T22:11:29.498 INFO:tasks.workunit.client.0.smithi019.stdout:3/717: chown d18/l77 16362 1 2024-09-12T22:11:29.499 INFO:tasks.workunit.client.0.smithi019.stdout:2/643: dread d0/d3/d11/d2e/d64/dce/d51/f89 [0,4194304] 0 2024-09-12T22:11:29.499 INFO:tasks.workunit.client.0.smithi019.stdout:0/688: mkdir d5/d7/d2c/ddc/de7 0 2024-09-12T22:11:29.501 INFO:tasks.workunit.client.0.smithi019.stdout:7/697: truncate da/d24/f74 1744658 0 2024-09-12T22:11:29.501 INFO:tasks.workunit.client.0.smithi019.stdout:5/740: creat d0/d1d/ffd x:0 0 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:6/813: truncate d9/dc/df7/d78/fde 3538577 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:9/701: creat d12/d1b/d20/d64/d83/fec x:0 0 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:7/698: creat da/d30/fed x:0 0 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:4/704: truncate d9/d4c/f78 3635122 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:0/689: fsync d5/d7/d10/d26/d2a/d94/fab 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:2/644: creat d0/d3/d11/d2e/d64/daf/fd4 x:0 0 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:6/814: mkdir d9/dc/df7/d78/d10d 0 2024-09-12T22:11:29.502 INFO:tasks.workunit.client.0.smithi019.stdout:9/702: readlink d12/d1b/d20/da0/laa 0 2024-09-12T22:11:29.503 INFO:tasks.workunit.client.0.smithi019.stdout:7/699: symlink da/d24/d28/d1c/d32/d5e/lee 0 2024-09-12T22:11:29.503 INFO:tasks.workunit.client.0.smithi019.stdout:5/741: rename d0/d24/d58/ld5 to d0/d1d/d4f/d47/lfe 0 2024-09-12T22:11:29.504 INFO:tasks.workunit.client.0.smithi019.stdout:2/645: mknod d0/d3/d11/d77/d78/cd5 0 2024-09-12T22:11:29.506 INFO:tasks.workunit.client.0.smithi019.stdout:9/703: write d12/d1b/f3a [2114806,25888] 0 2024-09-12T22:11:29.506 INFO:tasks.workunit.client.0.smithi019.stdout:9/704: readlink d12/l34 0 2024-09-12T22:11:29.507 INFO:tasks.workunit.client.0.smithi019.stdout:5/742: creat d0/d1d/d4f/d47/d57/dba/df6/fff x:0 0 0 2024-09-12T22:11:29.508 INFO:tasks.workunit.client.0.smithi019.stdout:3/718: dwrite d18/d1d/d8b/fc0 [0,4194304] 0 2024-09-12T22:11:29.509 INFO:tasks.workunit.client.0.smithi019.stdout:5/743: readlink d0/d1d/d6d/la8 0 2024-09-12T22:11:29.510 INFO:tasks.workunit.client.0.smithi019.stdout:9/705: chown d12/dd7/dc7/d74/d77/d86/dbd/cd0 12408712 1 2024-09-12T22:11:29.510 INFO:tasks.workunit.client.0.smithi019.stdout:3/719: stat d18/d26/d30/d4e/d9a/dae/fc6 0 2024-09-12T22:11:29.510 INFO:tasks.workunit.client.0.smithi019.stdout:0/690: dwrite d5/d7/d2c/d44/d6a/d52/f7c [0,4194304] 0 2024-09-12T22:11:29.511 INFO:tasks.workunit.client.0.smithi019.stdout:6/815: dwrite d9/dc/df7/f104 [0,4194304] 0 2024-09-12T22:11:29.513 INFO:tasks.workunit.client.0.smithi019.stdout:9/706: symlink d12/dd7/led 0 2024-09-12T22:11:29.513 INFO:tasks.workunit.client.0.smithi019.stdout:3/720: readlink d18/d26/d30/d4e/lcc 0 2024-09-12T22:11:29.513 INFO:tasks.workunit.client.0.smithi019.stdout:6/816: symlink d9/dc/d20/d71/l10e 0 2024-09-12T22:11:29.513 INFO:tasks.workunit.client.0.smithi019.stdout:0/691: creat d5/d7/fe8 x:0 0 0 2024-09-12T22:11:29.514 INFO:tasks.workunit.client.0.smithi019.stdout:9/707: write f9 [5181673,28571] 0 2024-09-12T22:11:29.514 INFO:tasks.workunit.client.0.smithi019.stdout:6/817: stat d9/dc/d20/f2e 0 2024-09-12T22:11:29.515 INFO:tasks.workunit.client.0.smithi019.stdout:3/721: write d18/f28 [1134736,119369] 0 2024-09-12T22:11:29.515 INFO:tasks.workunit.client.0.smithi019.stdout:4/705: write d9/d14/d57/d95/dbe/dc6/d3f/f48 [985555,116328] 0 2024-09-12T22:11:29.515 INFO:tasks.workunit.client.0.smithi019.stdout:9/708: chown d12/d1b/d20/d59 49387 1 2024-09-12T22:11:29.515 INFO:tasks.workunit.client.0.smithi019.stdout:5/744: dread d0/d26/d5f/f9e [0,4194304] 0 2024-09-12T22:11:29.516 INFO:tasks.workunit.client.0.smithi019.stdout:3/722: fdatasync d18/d26/d30/d91/fc9 0 2024-09-12T22:11:29.517 INFO:tasks.workunit.client.0.smithi019.stdout:6/818: unlink d9/dc/d20/l8a 0 2024-09-12T22:11:29.517 INFO:tasks.workunit.client.0.smithi019.stdout:4/706: creat d9/d14/d57/d95/d96/fe6 x:0 0 0 2024-09-12T22:11:29.518 INFO:tasks.workunit.client.0.smithi019.stdout:5/745: stat d0/d24/fb1 0 2024-09-12T22:11:29.519 INFO:tasks.workunit.client.0.smithi019.stdout:4/707: fdatasync d9/d58/fb0 0 2024-09-12T22:11:29.519 INFO:tasks.workunit.client.0.smithi019.stdout:9/709: link d12/fe1 d12/d1b/d40/d52/d62/de6/fee 0 2024-09-12T22:11:29.519 INFO:tasks.workunit.client.0.smithi019.stdout:6/819: creat d9/dc/df7/d78/da1/f10f x:0 0 0 2024-09-12T22:11:29.519 INFO:tasks.workunit.client.0.smithi019.stdout:4/708: mkdir d9/d17/de7 0 2024-09-12T22:11:29.520 INFO:tasks.workunit.client.0.smithi019.stdout:8/677: dread d5/dc/d26/d5c/f93 [0,4194304] 0 2024-09-12T22:11:29.520 INFO:tasks.workunit.client.0.smithi019.stdout:9/710: rmdir d12/d1b/d20/d59/d5b 39 2024-09-12T22:11:29.521 INFO:tasks.workunit.client.0.smithi019.stdout:9/711: mkdir d12/d1b/d40/d85/de8/def 0 2024-09-12T22:11:29.521 INFO:tasks.workunit.client.0.smithi019.stdout:8/678: write d5/dc/d17/fd5 [935588,114880] 0 2024-09-12T22:11:29.522 INFO:tasks.workunit.client.0.smithi019.stdout:6/820: rename d9/dc/d20/d4b/d6c/d8c/lef to d9/dc/d20/d30/d5b/l110 0 2024-09-12T22:11:29.522 INFO:tasks.workunit.client.0.smithi019.stdout:3/723: truncate d18/d26/d30/d4e/f59 3961909 0 2024-09-12T22:11:29.522 INFO:tasks.workunit.client.0.smithi019.stdout:5/746: truncate d0/d1d/d3d/f53 3618362 0 2024-09-12T22:11:29.523 INFO:tasks.workunit.client.0.smithi019.stdout:8/679: write d5/dc/d8a/fbc [798687,104551] 0 2024-09-12T22:11:29.523 INFO:tasks.workunit.client.0.smithi019.stdout:9/712: rename fa to d12/d48/ff0 0 2024-09-12T22:11:29.525 INFO:tasks.workunit.client.0.smithi019.stdout:3/724: rename d18/d1d/c23 to d18/d1d/d8b/ce0 0 2024-09-12T22:11:29.525 INFO:tasks.workunit.client.0.smithi019.stdout:1/735: dread d1/d2/d18/d29/d51/f85 [0,4194304] 0 2024-09-12T22:11:29.525 INFO:tasks.workunit.client.0.smithi019.stdout:4/709: dread d9/d58/f77 [0,4194304] 0 2024-09-12T22:11:29.525 INFO:tasks.workunit.client.0.smithi019.stdout:9/713: mknod d12/d1b/d40/d85/de8/cf1 0 2024-09-12T22:11:29.526 INFO:tasks.workunit.client.0.smithi019.stdout:3/725: stat d18/d1d/d8b/dc5/dbb 0 2024-09-12T22:11:29.526 INFO:tasks.workunit.client.0.smithi019.stdout:1/736: chown d1/d2/d18/d29/fef 464786 1 2024-09-12T22:11:29.526 INFO:tasks.workunit.client.0.smithi019.stdout:3/726: chown d18/d1d/d8b/db5 610 1 2024-09-12T22:11:29.526 INFO:tasks.workunit.client.0.smithi019.stdout:9/714: fdatasync d12/dd7/dc7/d74/d77/f84 0 2024-09-12T22:11:29.527 INFO:tasks.workunit.client.0.smithi019.stdout:4/710: creat d9/d4c/d76/dc9/fe8 x:0 0 0 2024-09-12T22:11:29.528 INFO:tasks.workunit.client.0.smithi019.stdout:8/680: dread d5/d53/d66/f6f [0,4194304] 0 2024-09-12T22:11:29.529 INFO:tasks.workunit.client.0.smithi019.stdout:5/747: dwrite d0/d1d/f95 [0,4194304] 0 2024-09-12T22:11:29.530 INFO:tasks.workunit.client.0.smithi019.stdout:1/737: truncate d1/d2/d18/d35/d84/dc/f69 2581289 0 2024-09-12T22:11:29.530 INFO:tasks.workunit.client.0.smithi019.stdout:8/681: dread - d5/d16/d19/d29/d7f/fbe zero size 2024-09-12T22:11:29.532 INFO:tasks.workunit.client.0.smithi019.stdout:5/748: unlink d0/d1d/d4f/l27 0 2024-09-12T22:11:29.532 INFO:tasks.workunit.client.0.smithi019.stdout:8/682: chown d5/dc/d8a/cbb 6 1 2024-09-12T22:11:29.532 INFO:tasks.workunit.client.0.smithi019.stdout:7/700: sync 2024-09-12T22:11:29.532 INFO:tasks.workunit.client.0.smithi019.stdout:6/821: sync 2024-09-12T22:11:29.533 INFO:tasks.workunit.client.0.smithi019.stdout:4/711: write d9/db/d2b/f37 [1200979,27888] 0 2024-09-12T22:11:29.533 INFO:tasks.workunit.client.0.smithi019.stdout:7/701: fdatasync da/d8f/fd6 0 2024-09-12T22:11:29.534 INFO:tasks.workunit.client.0.smithi019.stdout:6/822: mkdir d9/dc/df7/d7d/da7/d111 0 2024-09-12T22:11:29.534 INFO:tasks.workunit.client.0.smithi019.stdout:9/715: dwrite d12/d1b/d40/f70 [0,4194304] 0 2024-09-12T22:11:29.536 INFO:tasks.workunit.client.0.smithi019.stdout:8/683: read d5/dc/f5f [5816,18829] 0 2024-09-12T22:11:29.536 INFO:tasks.workunit.client.0.smithi019.stdout:3/727: dread d18/f56 [0,4194304] 0 2024-09-12T22:11:29.537 INFO:tasks.workunit.client.0.smithi019.stdout:8/684: rename d5 to d5/dc/d8a/de2 22 2024-09-12T22:11:29.537 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:29.536+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:29.538 INFO:tasks.workunit.client.0.smithi019.stdout:4/712: getdents d9/d4c 0 2024-09-12T22:11:29.539 INFO:tasks.workunit.client.0.smithi019.stdout:9/716: read d12/d1b/d40/d52/fb8 [1116401,49768] 0 2024-09-12T22:11:29.540 INFO:tasks.workunit.client.0.smithi019.stdout:6/823: symlink d9/dc/d20/l112 0 2024-09-12T22:11:29.540 INFO:tasks.workunit.client.0.smithi019.stdout:4/713: rmdir d9/d73/d8f/d93/dad 39 2024-09-12T22:11:29.541 INFO:tasks.workunit.client.0.smithi019.stdout:5/749: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:11:29.541 INFO:tasks.workunit.client.0.smithi019.stdout:7/702: dread da/d19/d25/d39/d51/dd7/f66 [0,4194304] 0 2024-09-12T22:11:29.543 INFO:tasks.workunit.client.0.smithi019.stdout:8/685: creat d5/dc/d26/d43/d49/d7a/fe3 x:0 0 0 2024-09-12T22:11:29.543 INFO:tasks.workunit.client.0.smithi019.stdout:6/824: mkdir d9/d3d/d4f/d59/d113 0 2024-09-12T22:11:29.543 INFO:tasks.workunit.client.0.smithi019.stdout:5/750: truncate d0/f9c 407663 0 2024-09-12T22:11:29.544 INFO:tasks.workunit.client.0.smithi019.stdout:9/717: mkdir d12/dd7/dc7/d74/d77/d86/ddf/df2 0 2024-09-12T22:11:29.544 INFO:tasks.workunit.client.0.smithi019.stdout:3/728: truncate d18/d26/d30/d71/d86/f90 876269 0 2024-09-12T22:11:29.545 INFO:tasks.workunit.client.0.smithi019.stdout:7/703: symlink da/d24/d28/d1c/d32/d99/dc8/lef 0 2024-09-12T22:11:29.545 INFO:tasks.workunit.client.0.smithi019.stdout:8/686: dread - d5/dc/d26/d43/d49/d92/fb6 zero size 2024-09-12T22:11:29.546 INFO:tasks.workunit.client.0.smithi019.stdout:6/825: creat d9/dc/df7/f114 x:0 0 0 2024-09-12T22:11:29.546 INFO:tasks.workunit.client.0.smithi019.stdout:3/729: dread - d18/d26/d30/d71/d86/f9e zero size 2024-09-12T22:11:29.546 INFO:tasks.workunit.client.0.smithi019.stdout:7/704: mkdir da/d24/d28/d1c/d32/df0 0 2024-09-12T22:11:29.547 INFO:tasks.workunit.client.0.smithi019.stdout:0/692: dread d5/d7/d2c/d44/d6a/d46/db2/fce [0,4194304] 0 2024-09-12T22:11:29.548 INFO:tasks.workunit.client.0.smithi019.stdout:8/687: mknod d5/dc/d26/d5c/ce4 0 2024-09-12T22:11:29.548 INFO:tasks.workunit.client.0.smithi019.stdout:6/826: mkdir d9/dc/d20/d4b/d6c/d8c/d115 0 2024-09-12T22:11:29.548 INFO:tasks.workunit.client.0.smithi019.stdout:3/730: chown d18/d1d/d8b/dc5/fab 1168311 1 2024-09-12T22:11:29.548 INFO:tasks.workunit.client.0.smithi019.stdout:7/705: truncate da/d19/d25/f9e 1661153 0 2024-09-12T22:11:29.549 INFO:tasks.workunit.client.0.smithi019.stdout:0/693: creat d5/d7/d10/d26/d8a/fe9 x:0 0 0 2024-09-12T22:11:29.549 INFO:tasks.workunit.client.0.smithi019.stdout:8/688: write d5/f42 [2525972,71020] 0 2024-09-12T22:11:29.550 INFO:tasks.workunit.client.0.smithi019.stdout:3/731: symlink d18/d26/d30/d4e/d80/le1 0 2024-09-12T22:11:29.551 INFO:tasks.workunit.client.0.smithi019.stdout:9/718: dread d12/d1b/d20/fce [0,4194304] 0 2024-09-12T22:11:29.551 INFO:tasks.workunit.client.0.smithi019.stdout:4/714: dwrite d9/d14/d57/d95/dbe/dc6/d3f/f48 [0,4194304] 0 2024-09-12T22:11:29.551 INFO:tasks.workunit.client.0.smithi019.stdout:0/694: readlink d5/d7/d2c/d44/ld8 0 2024-09-12T22:11:29.551 INFO:tasks.workunit.client.0.smithi019.stdout:6/827: link d9/dc/d20/d30/f42 d9/f116 0 2024-09-12T22:11:29.551 INFO:tasks.workunit.client.0.smithi019.stdout:7/706: creat da/d24/d28/d1c/d32/d5e/dc3/ff1 x:0 0 0 2024-09-12T22:11:29.552 INFO:tasks.workunit.client.0.smithi019.stdout:8/689: truncate d5/dc/d26/d4b/f91 8649180 0 2024-09-12T22:11:29.552 INFO:tasks.workunit.client.0.smithi019.stdout:4/715: dread - d9/db/d2b/fc2 zero size 2024-09-12T22:11:29.552 INFO:tasks.workunit.client.0.smithi019.stdout:7/707: chown da/d24/d28/d1c/d32/dc2/dca 544 1 2024-09-12T22:11:29.553 INFO:tasks.workunit.client.0.smithi019.stdout:8/690: read d5/dc/d26/f36 [2971084,91232] 0 2024-09-12T22:11:29.554 INFO:tasks.workunit.client.0.smithi019.stdout:7/708: fdatasync da/d19/d25/d39/f49 0 2024-09-12T22:11:29.554 INFO:tasks.workunit.client.0.smithi019.stdout:0/695: mkdir d5/d88/dea 0 2024-09-12T22:11:29.557 INFO:tasks.workunit.client.0.smithi019.stdout:0/696: chown d5/d7/d2c/c79 9 1 2024-09-12T22:11:29.557 INFO:tasks.workunit.client.0.smithi019.stdout:3/732: dwrite d18/d26/d30/d4a/f68 [0,4194304] 0 2024-09-12T22:11:29.557 INFO:tasks.workunit.client.0.smithi019.stdout:2/646: sync 2024-09-12T22:11:29.558 INFO:tasks.workunit.client.0.smithi019.stdout:7/709: write da/d30/da5/fcd [8621013,130885] 0 2024-09-12T22:11:29.559 INFO:tasks.workunit.client.0.smithi019.stdout:1/738: dread d1/d2/d18/d29/f9b [0,4194304] 0 2024-09-12T22:11:29.560 INFO:tasks.workunit.client.0.smithi019.stdout:6/828: dwrite d9/dc/df7/d78/da1/f10f [0,4194304] 0 2024-09-12T22:11:29.560 INFO:tasks.workunit.client.0.smithi019.stdout:3/733: unlink d18/d26/d30/c4c 0 2024-09-12T22:11:29.561 INFO:tasks.workunit.client.0.smithi019.stdout:1/739: chown d1/d37/f65 0 1 2024-09-12T22:11:29.562 INFO:tasks.workunit.client.0.smithi019.stdout:4/716: truncate d9/d14/d57/d95/dbe/dc6/f5c 704740 0 2024-09-12T22:11:29.563 INFO:tasks.workunit.client.0.smithi019.stdout:8/691: rename d5/dc/d26/dc8/fde to d5/d16/d19/d29/fe5 0 2024-09-12T22:11:29.564 INFO:tasks.workunit.client.0.smithi019.stdout:0/697: write d5/d7/d10/f42 [2789000,113347] 0 2024-09-12T22:11:29.565 INFO:tasks.workunit.client.0.smithi019.stdout:1/740: creat d1/d37/ff4 x:0 0 0 2024-09-12T22:11:29.565 INFO:tasks.workunit.client.0.smithi019.stdout:2/647: dread d0/d3/d11/da9/fad [0,4194304] 0 2024-09-12T22:11:29.565 INFO:tasks.workunit.client.0.smithi019.stdout:9/719: dwrite d12/d1b/d40/d52/f65 [0,4194304] 0 2024-09-12T22:11:29.566 INFO:tasks.workunit.client.0.smithi019.stdout:4/717: creat d9/d4c/d76/dc9/fe9 x:0 0 0 2024-09-12T22:11:29.566 INFO:tasks.workunit.client.0.smithi019.stdout:9/720: readlink d12/d1b/l66 0 2024-09-12T22:11:29.568 INFO:tasks.workunit.client.0.smithi019.stdout:3/734: mknod d18/d26/d30/d71/d86/ce2 0 2024-09-12T22:11:29.568 INFO:tasks.workunit.client.0.smithi019.stdout:8/692: write d5/dc/d26/d43/d7d/fe0 [537616,79071] 0 2024-09-12T22:11:29.569 INFO:tasks.workunit.client.0.smithi019.stdout:2/648: chown d0/d31/d4/d7/f45 213 1 2024-09-12T22:11:29.570 INFO:tasks.workunit.client.0.smithi019.stdout:9/721: chown d12/d1b/d20/c4d 39023457 1 2024-09-12T22:11:29.570 INFO:tasks.workunit.client.0.smithi019.stdout:7/710: dwrite da/d24/d28/f98 [0,4194304] 0 2024-09-12T22:11:29.570 INFO:tasks.workunit.client.0.smithi019.stdout:0/698: mkdir d5/d7/d2c/d81/dcb/deb 0 2024-09-12T22:11:29.570 INFO:tasks.workunit.client.0.smithi019.stdout:4/718: creat d9/d14/d57/d95/d96/ddd/fea x:0 0 0 2024-09-12T22:11:29.573 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:29.573 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:29.573 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:8/693: write d5/dc/d26/d43/d49/d7a/fe3 [103320,116437] 0 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:7/711: chown da/d24/d28/d1c/d32/d5e/lee 0 1 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:2/649: mknod d0/d3/d11/d77/d78/d2c/d30/d32/cd6 0 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:9/722: mknod d12/d1b/d20/d64/d83/cf3 0 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:0/699: symlink d5/d7/d2c/d44/lec 0 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:7/712: chown da/d19/f88 120446320 1 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:8/694: fsync d5/dc/d8d/d96/da7/fdd 0 2024-09-12T22:11:29.574 INFO:tasks.workunit.client.0.smithi019.stdout:2/650: chown d0/d31/d12/f17 741 1 2024-09-12T22:11:29.575 INFO:tasks.workunit.client.0.smithi019.stdout:0/700: mknod d5/ced 0 2024-09-12T22:11:29.575 INFO:tasks.workunit.client.0.smithi019.stdout:8/695: creat d5/dc/d8a/d98/fe6 x:0 0 0 2024-09-12T22:11:29.576 INFO:tasks.workunit.client.0.smithi019.stdout:1/741: dwrite d1/d2/da2/fa5 [0,4194304] 0 2024-09-12T22:11:29.576 INFO:tasks.workunit.client.0.smithi019.stdout:2/651: chown d0/d3/df/d7b/d80 404869 1 2024-09-12T22:11:29.577 INFO:tasks.workunit.client.0.smithi019.stdout:6/829: dwrite d9/dc/d20/d30/db7/fe2 [0,4194304] 0 2024-09-12T22:11:29.578 INFO:tasks.workunit.client.0.smithi019.stdout:4/719: truncate d9/db/dcd/f7f 4281145 0 2024-09-12T22:11:29.578 INFO:tasks.workunit.client.0.smithi019.stdout:8/696: chown d5/dc/d17/l39 535 1 2024-09-12T22:11:29.578 INFO:tasks.workunit.client.0.smithi019.stdout:9/723: dread d12/f1a [0,4194304] 0 2024-09-12T22:11:29.579 INFO:tasks.workunit.client.0.smithi019.stdout:2/652: creat d0/fd7 x:0 0 0 2024-09-12T22:11:29.581 INFO:tasks.workunit.client.0.smithi019.stdout:8/697: creat d5/dc/d8d/d96/fe7 x:0 0 0 2024-09-12T22:11:29.581 INFO:tasks.workunit.client.0.smithi019.stdout:4/720: mkdir d9/d14/d57/d95/dbe/dc6/deb 0 2024-09-12T22:11:29.582 INFO:tasks.workunit.client.0.smithi019.stdout:4/721: symlink d9/de5/lec 0 2024-09-12T22:11:29.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:29.584 INFO:tasks.workunit.client.0.smithi019.stdout:1/742: fsync d1/d2/d18/d35/d84/dc/f69 0 2024-09-12T22:11:29.584 INFO:tasks.workunit.client.0.smithi019.stdout:0/701: dwrite d5/d7/d2c/d44/d6a/f98 [0,4194304] 0 2024-09-12T22:11:29.586 INFO:tasks.workunit.client.0.smithi019.stdout:9/724: dread d12/dd7/dc7/f2d [0,4194304] 0 2024-09-12T22:11:29.586 INFO:tasks.workunit.client.0.smithi019.stdout:8/698: getdents d5/dc/d8a/d8e 0 2024-09-12T22:11:29.587 INFO:tasks.workunit.client.0.smithi019.stdout:6/830: dwrite d9/d3d/d4f/f5e [0,4194304] 0 2024-09-12T22:11:29.587 INFO:tasks.workunit.client.0.smithi019.stdout:2/653: dread d0/d3/d11/d77/d78/d2c/d56/d60/fc9 [0,4194304] 0 2024-09-12T22:11:29.588 INFO:tasks.workunit.client.0.smithi019.stdout:1/743: symlink d1/d83/lf5 0 2024-09-12T22:11:29.589 INFO:tasks.workunit.client.0.smithi019.stdout:0/702: creat d5/d7/d10/fee x:0 0 0 2024-09-12T22:11:29.589 INFO:tasks.workunit.client.0.smithi019.stdout:8/699: creat d5/fe8 x:0 0 0 2024-09-12T22:11:29.590 INFO:tasks.workunit.client.0.smithi019.stdout:8/700: dread - d5/d53/d66/f99 zero size 2024-09-12T22:11:29.591 INFO:tasks.workunit.client.0.smithi019.stdout:4/722: dwrite d9/d14/d57/f7c [4194304,4194304] 0 2024-09-12T22:11:29.592 INFO:tasks.workunit.client.0.smithi019.stdout:9/725: chown d12/d1b/d20/d59/d5b/d9a/fa7 166044469 1 2024-09-12T22:11:29.593 INFO:tasks.workunit.client.0.smithi019.stdout:4/723: write d9/d14/f38 [7745648,69625] 0 2024-09-12T22:11:29.594 INFO:tasks.workunit.client.0.smithi019.stdout:6/831: dwrite d9/dc/d20/d71/ffa [0,4194304] 0 2024-09-12T22:11:29.594 INFO:tasks.workunit.client.0.smithi019.stdout:0/703: dwrite d5/d7/db5/fc7 [0,4194304] 0 2024-09-12T22:11:29.595 INFO:tasks.workunit.client.0.smithi019.stdout:4/724: symlink d9/db/dcd/led 0 2024-09-12T22:11:29.595 INFO:tasks.workunit.client.0.smithi019.stdout:6/832: readlink d9/dc/d20/d30/l33 0 2024-09-12T22:11:29.597 INFO:tasks.workunit.client.0.smithi019.stdout:8/701: dread d5/dc/d26/d43/d49/d7a/fe3 [0,4194304] 0 2024-09-12T22:11:29.597 INFO:tasks.workunit.client.0.smithi019.stdout:6/833: mknod d9/dc/d20/d30/d5b/c117 0 2024-09-12T22:11:29.598 INFO:tasks.workunit.client.0.smithi019.stdout:4/725: creat d9/d14/d57/d95/d96/dc4/fee x:0 0 0 2024-09-12T22:11:29.600 INFO:tasks.workunit.client.0.smithi019.stdout:9/726: dwrite d12/d1b/d20/fce [0,4194304] 0 2024-09-12T22:11:29.602 INFO:tasks.workunit.client.0.smithi019.stdout:6/834: unlink d9/dc/f23 0 2024-09-12T22:11:29.603 INFO:tasks.workunit.client.0.smithi019.stdout:0/704: dwrite d5/d7/d2c/d81/dcb/fd0 [0,4194304] 0 2024-09-12T22:11:29.603 INFO:tasks.workunit.client.0.smithi019.stdout:4/726: symlink d9/d73/de2/lef 0 2024-09-12T22:11:29.603 INFO:tasks.workunit.client.0.smithi019.stdout:8/702: rename d5/d16/d19/d29/c68 to d5/d53/d66/ce9 0 2024-09-12T22:11:29.603 INFO:tasks.workunit.client.0.smithi019.stdout:9/727: rename d12/f17 to d12/d1b/d40/d52/ff4 0 2024-09-12T22:11:29.604 INFO:tasks.workunit.client.0.smithi019.stdout:6/835: dread - d9/dc/df7/d78/da1/f10b zero size 2024-09-12T22:11:29.604 INFO:tasks.workunit.client.0.smithi019.stdout:0/705: write d5/d7/d10/d26/d2a/d94/fab [833317,30326] 0 2024-09-12T22:11:29.605 INFO:tasks.workunit.client.0.smithi019.stdout:8/703: mknod d5/dc/d26/d43/d7d/cea 0 2024-09-12T22:11:29.605 INFO:tasks.workunit.client.0.smithi019.stdout:9/728: chown d12/d1b/c33 4 1 2024-09-12T22:11:29.605 INFO:tasks.workunit.client.0.smithi019.stdout:6/836: dread - d9/dc/dd9/fe6 zero size 2024-09-12T22:11:29.605 INFO:tasks.workunit.client.0.smithi019.stdout:0/706: write d5/f6 [3549434,53264] 0 2024-09-12T22:11:29.605 INFO:tasks.workunit.client.0.smithi019.stdout:8/704: symlink d5/dc/d17/dce/leb 0 2024-09-12T22:11:29.606 INFO:tasks.workunit.client.0.smithi019.stdout:8/705: readlink d5/d16/d19/l4f 0 2024-09-12T22:11:29.607 INFO:tasks.workunit.client.0.smithi019.stdout:4/727: rename d9/d73 to d9/d4c/d76/dc9/df0 0 2024-09-12T22:11:29.608 INFO:tasks.workunit.client.0.smithi019.stdout:8/706: write d5/dc/ff [1528338,70035] 0 2024-09-12T22:11:29.609 INFO:tasks.workunit.client.0.smithi019.stdout:0/707: creat d5/d7/d2c/d44/d6a/d76/fef x:0 0 0 2024-09-12T22:11:29.610 INFO:tasks.workunit.client.0.smithi019.stdout:8/707: fdatasync d5/dc/d26/d5c/fa3 0 2024-09-12T22:11:29.610 INFO:tasks.workunit.client.0.smithi019.stdout:4/728: write d9/d14/d57/d95/dbe/dc6/f8b [235517,86201] 0 2024-09-12T22:11:29.611 INFO:tasks.workunit.client.0.smithi019.stdout:0/708: creat d5/d7/d2c/ddc/ff0 x:0 0 0 2024-09-12T22:11:29.612 INFO:tasks.workunit.client.0.smithi019.stdout:9/729: dwrite d12/f45 [4194304,4194304] 0 2024-09-12T22:11:29.612 INFO:tasks.workunit.client.0.smithi019.stdout:4/729: truncate d9/d4c/fbf 139870 0 2024-09-12T22:11:29.612 INFO:tasks.workunit.client.0.smithi019.stdout:8/708: creat d5/dc/d8d/d96/da7/fec x:0 0 0 2024-09-12T22:11:29.613 INFO:tasks.workunit.client.0.smithi019.stdout:8/709: write d5/f23 [561341,27710] 0 2024-09-12T22:11:29.613 INFO:tasks.workunit.client.0.smithi019.stdout:6/837: truncate d9/d3d/d6f/f65 1806552 0 2024-09-12T22:11:29.614 INFO:tasks.workunit.client.0.smithi019.stdout:9/730: fdatasync d12/f1a 0 2024-09-12T22:11:29.614 INFO:tasks.workunit.client.0.smithi019.stdout:0/709: link d5/f6 d5/d7/d2c/ff1 0 2024-09-12T22:11:29.615 INFO:tasks.workunit.client.0.smithi019.stdout:9/731: mkdir d12/dd7/dc7/d56/df5 0 2024-09-12T22:11:29.615 INFO:tasks.workunit.client.0.smithi019.stdout:6/838: link d9/dc/f36 d9/dc/d20/d30/db7/f118 0 2024-09-12T22:11:29.616 INFO:tasks.workunit.client.0.smithi019.stdout:6/839: chown d9/d6b/cf1 26136 1 2024-09-12T22:11:29.616 INFO:tasks.workunit.client.0.smithi019.stdout:8/710: write d5/dc/d26/f36 [2919571,74529] 0 2024-09-12T22:11:29.617 INFO:tasks.workunit.client.0.smithi019.stdout:9/732: link d12/d1b/d40/d52/fb8 d12/dd7/dc7/d74/de3/ff6 0 2024-09-12T22:11:29.618 INFO:tasks.workunit.client.0.smithi019.stdout:8/711: chown d5/dc/d26/d5c/l90 5619 1 2024-09-12T22:11:29.618 INFO:tasks.workunit.client.0.smithi019.stdout:6/840: link d9/dc/d20/f50 d9/dc/dd9/f119 0 2024-09-12T22:11:29.619 INFO:tasks.workunit.client.0.smithi019.stdout:2/654: dread d0/d3/df/d52/fd2 [0,4194304] 0 2024-09-12T22:11:29.619 INFO:tasks.workunit.client.0.smithi019.stdout:8/712: creat d5/dc/d8d/d96/fed x:0 0 0 2024-09-12T22:11:29.619 INFO:tasks.workunit.client.0.smithi019.stdout:2/655: chown d0/d31/d4/f22 151196 1 2024-09-12T22:11:29.623 INFO:tasks.workunit.client.0.smithi019.stdout:3/735: dread f16 [0,4194304] 0 2024-09-12T22:11:29.625 INFO:tasks.workunit.client.0.smithi019.stdout:9/733: dwrite d12/dd7/dc7/d74/d77/fcc [0,4194304] 0 2024-09-12T22:11:29.626 INFO:tasks.workunit.client.0.smithi019.stdout:0/710: dread d5/d7/d10/d26/d2a/d94/fab [0,4194304] 0 2024-09-12T22:11:29.626 INFO:tasks.workunit.client.0.smithi019.stdout:2/656: rename d0/d3/d11/d77/d78/d2c/d56/c88 to d0/d3/df/d7b/d80/d9a/daa/cd8 0 2024-09-12T22:11:29.626 INFO:tasks.workunit.client.0.smithi019.stdout:6/841: dwrite d9/dc/d20/d30/db7/ff2 [0,4194304] 0 2024-09-12T22:11:29.626 INFO:tasks.workunit.client.0.smithi019.stdout:3/736: dread - d18/d26/d30/d91/fc9 zero size 2024-09-12T22:11:29.627 INFO:tasks.workunit.client.0.smithi019.stdout:8/713: dwrite d5/dc/d8d/fd7 [0,4194304] 0 2024-09-12T22:11:29.628 INFO:tasks.workunit.client.0.smithi019.stdout:2/657: dread - d0/d31/d12/d3b/d5c/f90 zero size 2024-09-12T22:11:29.628 INFO:tasks.workunit.client.0.smithi019.stdout:8/714: rename d5/d16/fdf to d5/dc/d8d/d96/fee 0 2024-09-12T22:11:29.629 INFO:tasks.workunit.client.0.smithi019.stdout:6/842: creat d9/dc/d20/d4b/f11a x:0 0 0 2024-09-12T22:11:29.630 INFO:tasks.workunit.client.0.smithi019.stdout:9/734: link d12/d1b/d20/d59/d5b/d9e/c46 d12/d1b/d40/d52/d62/de6/cf7 0 2024-09-12T22:11:29.630 INFO:tasks.workunit.client.0.smithi019.stdout:8/715: rmdir d5/dc/d26/d43/d49/d92 39 2024-09-12T22:11:29.631 INFO:tasks.workunit.client.0.smithi019.stdout:6/843: symlink d9/dc/df7/d7d/da7/d111/l11b 0 2024-09-12T22:11:29.632 INFO:tasks.workunit.client.0.smithi019.stdout:9/735: rename d12/lc9 to d12/dd7/dc7/d74/d77/lf8 0 2024-09-12T22:11:29.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/751: sync 2024-09-12T22:11:29.634 INFO:tasks.workunit.client.0.smithi019.stdout:6/844: mkdir d9/d3d/d4f/d59/d79/de4/d11c 0 2024-09-12T22:11:29.635 INFO:tasks.workunit.client.0.smithi019.stdout:8/716: write d5/dc/d17/f2b [5184515,65655] 0 2024-09-12T22:11:29.637 INFO:tasks.workunit.client.0.smithi019.stdout:3/737: dwrite d18/fc8 [4194304,4194304] 0 2024-09-12T22:11:29.637 INFO:tasks.workunit.client.0.smithi019.stdout:9/736: creat d12/d1b/d40/d85/de8/ff9 x:0 0 0 2024-09-12T22:11:29.640 INFO:tasks.workunit.client.0.smithi019.stdout:0/711: dwrite d5/d7/d2c/d81/f9c [0,4194304] 0 2024-09-12T22:11:29.640 INFO:tasks.workunit.client.0.smithi019.stdout:5/752: chown d0/d1d/d4f/d47/fb4 218453 1 2024-09-12T22:11:29.640 INFO:tasks.workunit.client.0.smithi019.stdout:2/658: dwrite d0/d3/d11/d2e/d64/daf/fd4 [0,4194304] 0 2024-09-12T22:11:29.640 INFO:tasks.workunit.client.0.smithi019.stdout:3/738: fsync d18/d26/d30/f67 0 2024-09-12T22:11:29.641 INFO:tasks.workunit.client.0.smithi019.stdout:8/717: dread d5/d53/d66/f6f [0,4194304] 0 2024-09-12T22:11:29.642 INFO:tasks.workunit.client.0.smithi019.stdout:8/718: chown d5/d16/d19/d32/c94 113370 1 2024-09-12T22:11:29.642 INFO:tasks.workunit.client.0.smithi019.stdout:8/719: write d5/dc/d8d/d96/fed [933929,38149] 0 2024-09-12T22:11:29.642 INFO:tasks.workunit.client.0.smithi019.stdout:5/753: rmdir d0/d26/d5f 39 2024-09-12T22:11:29.643 INFO:tasks.workunit.client.0.smithi019.stdout:9/737: creat d12/dd7/dc7/d74/d77/ffa x:0 0 0 2024-09-12T22:11:29.644 INFO:tasks.workunit.client.0.smithi019.stdout:0/712: creat d5/d7/d2c/ddc/ff2 x:0 0 0 2024-09-12T22:11:29.644 INFO:tasks.workunit.client.0.smithi019.stdout:5/754: dread - d0/d24/d58/fe0 zero size 2024-09-12T22:11:29.644 INFO:tasks.workunit.client.0.smithi019.stdout:9/738: write d12/f15 [840076,91236] 0 2024-09-12T22:11:29.645 INFO:tasks.workunit.client.0.smithi019.stdout:8/720: write d5/dc/d8d/d96/fee [741184,109962] 0 2024-09-12T22:11:29.645 INFO:tasks.workunit.client.0.smithi019.stdout:5/755: mkdir d0/d24/d97/dda/d100 0 2024-09-12T22:11:29.646 INFO:tasks.workunit.client.0.smithi019.stdout:0/713: rename d5/d7/d2c/d44/d6a/d76/fef to d5/d7/d2c/d44/d6a/d46/db2/ff3 0 2024-09-12T22:11:29.646 INFO:tasks.workunit.client.0.smithi019.stdout:3/739: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:29.647 INFO:tasks.workunit.client.0.smithi019.stdout:5/756: unlink d0/d1d/d6d/lad 0 2024-09-12T22:11:29.647 INFO:tasks.workunit.client.0.smithi019.stdout:3/740: fdatasync d18/f28 0 2024-09-12T22:11:29.649 INFO:tasks.workunit.client.0.smithi019.stdout:0/714: creat d5/d7/d2c/d81/dcb/deb/ff4 x:0 0 0 2024-09-12T22:11:29.649 INFO:tasks.workunit.client.0.smithi019.stdout:3/741: creat d18/d26/dce/fe3 x:0 0 0 2024-09-12T22:11:29.649 INFO:tasks.workunit.client.0.smithi019.stdout:5/757: mknod d0/d26/d5f/c101 0 2024-09-12T22:11:29.650 INFO:tasks.workunit.client.0.smithi019.stdout:0/715: mknod d5/d7/d2c/ddc/de7/cf5 0 2024-09-12T22:11:29.650 INFO:tasks.workunit.client.0.smithi019.stdout:5/758: creat d0/d26/f102 x:0 0 0 2024-09-12T22:11:29.650 INFO:tasks.workunit.client.0.smithi019.stdout:0/716: stat d5/d7/d2c/d44/d6a/d46/db2/fce 0 2024-09-12T22:11:29.651 INFO:tasks.workunit.client.0.smithi019.stdout:3/742: rename d18/d1d/dad/fc2 to d18/d1d/d8b/dc5/dbb/fe4 0 2024-09-12T22:11:29.651 INFO:tasks.workunit.client.0.smithi019.stdout:0/717: rmdir d5 39 2024-09-12T22:11:29.651 INFO:tasks.workunit.client.0.smithi019.stdout:5/759: creat d0/d1d/d3d/f103 x:0 0 0 2024-09-12T22:11:29.652 INFO:tasks.workunit.client.0.smithi019.stdout:5/760: symlink d0/d24/d7a/l104 0 2024-09-12T22:11:29.652 INFO:tasks.workunit.client.0.smithi019.stdout:3/743: symlink d18/d26/d30/d4e/le5 0 2024-09-12T22:11:29.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/718: chown d5/d7/de/la0 292758 1 2024-09-12T22:11:29.653 INFO:tasks.workunit.client.0.smithi019.stdout:5/761: rmdir d0/d24/d7a 39 2024-09-12T22:11:29.653 INFO:tasks.workunit.client.0.smithi019.stdout:9/739: dread d12/d1b/d20/d25/fad [0,4194304] 0 2024-09-12T22:11:29.653 INFO:tasks.workunit.client.0.smithi019.stdout:5/762: write d0/f9c [773625,25015] 0 2024-09-12T22:11:29.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/719: rename d5/d87/f8b to d5/d7/ff6 0 2024-09-12T22:11:29.655 INFO:tasks.workunit.client.0.smithi019.stdout:9/740: creat d12/d1b/d20/d25/ffb x:0 0 0 2024-09-12T22:11:29.656 INFO:tasks.workunit.client.0.smithi019.stdout:6/845: dread d9/d3d/d6f/fbd [0,4194304] 0 2024-09-12T22:11:29.657 INFO:tasks.workunit.client.0.smithi019.stdout:0/720: write d5/d7/d2c/d44/d6a/d76/fb8 [727546,102971] 0 2024-09-12T22:11:29.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/741: symlink d12/dd7/dc7/d92/d9d/lfc 0 2024-09-12T22:11:29.658 INFO:tasks.workunit.client.0.smithi019.stdout:1/744: sync 2024-09-12T22:11:29.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/713: sync 2024-09-12T22:11:29.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/730: sync 2024-09-12T22:11:29.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/721: sync 2024-09-12T22:11:29.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/846: mkdir d9/dc/df7/d7d/da7/d11d 0 2024-09-12T22:11:29.659 INFO:tasks.workunit.client.0.smithi019.stdout:4/731: dread - d9/d58/fb0 zero size 2024-09-12T22:11:29.659 INFO:tasks.workunit.client.0.smithi019.stdout:3/744: dwrite d18/d26/d30/d4a/f68 [0,4194304] 0 2024-09-12T22:11:29.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/847: chown d9/d3d/db8/f107 23 1 2024-09-12T22:11:29.662 INFO:tasks.workunit.client.0.smithi019.stdout:2/659: dread d0/d31/d12/d15/f9f [0,4194304] 0 2024-09-12T22:11:29.662 INFO:tasks.workunit.client.0.smithi019.stdout:1/745: truncate d1/d2/fe2 407077 0 2024-09-12T22:11:29.662 INFO:tasks.workunit.client.0.smithi019.stdout:0/721: unlink d5/d7/d10/d26/d2a/d94/la6 0 2024-09-12T22:11:29.662 INFO:tasks.workunit.client.0.smithi019.stdout:7/714: fsync da/d8f/f9a 0 2024-09-12T22:11:29.663 INFO:tasks.workunit.client.0.smithi019.stdout:5/763: dwrite d0/d1d/d3d/f55 [0,4194304] 0 2024-09-12T22:11:29.663 INFO:tasks.workunit.client.0.smithi019.stdout:4/732: rmdir d9/d14/d57/d95/dbe/d6f 39 2024-09-12T22:11:29.664 INFO:tasks.workunit.client.0.smithi019.stdout:7/715: readlink da/d24/d28/l58 0 2024-09-12T22:11:29.665 INFO:tasks.workunit.client.0.smithi019.stdout:1/746: fdatasync d1/d2/d18/d35/d84/dc/df/d61/f1b 0 2024-09-12T22:11:29.665 INFO:tasks.workunit.client.0.smithi019.stdout:6/848: creat d9/dc/d20/d30/db7/f11e x:0 0 0 2024-09-12T22:11:29.665 INFO:tasks.workunit.client.0.smithi019.stdout:3/745: rename d18/d1d/dad/lc4 to d18/d1d/dad/le6 0 2024-09-12T22:11:29.666 INFO:tasks.workunit.client.0.smithi019.stdout:4/733: symlink d9/db/d2b/de0/lf1 0 2024-09-12T22:11:29.667 INFO:tasks.workunit.client.0.smithi019.stdout:0/722: creat d5/d7/d10/d26/d8a/ff7 x:0 0 0 2024-09-12T22:11:29.668 INFO:tasks.workunit.client.0.smithi019.stdout:8/722: dwrite d5/d53/f89 [0,4194304] 0 2024-09-12T22:11:29.669 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:29.667+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:29.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/734: mkdir d9/d4c/d76/df2 0 2024-09-12T22:11:29.670 INFO:tasks.workunit.client.0.smithi019.stdout:9/742: dwrite d12/dd7/dc7/d56/f81 [0,4194304] 0 2024-09-12T22:11:29.670 INFO:tasks.workunit.client.0.smithi019.stdout:1/747: mknod d1/d2/d18/d59/cf6 0 2024-09-12T22:11:29.671 INFO:tasks.workunit.client.0.smithi019.stdout:8/723: chown d5/d16/d19/l4f 2292225 1 2024-09-12T22:11:29.671 INFO:tasks.workunit.client.0.smithi019.stdout:9/743: dread - d12/d1b/d20/d59/d5b/fde zero size 2024-09-12T22:11:29.673 INFO:tasks.workunit.client.0.smithi019.stdout:0/723: creat d5/d7/de/d8d/ff8 x:0 0 0 2024-09-12T22:11:29.673 INFO:tasks.workunit.client.0.smithi019.stdout:3/746: link d18/d1d/c94 d18/d26/da5/dbd/ce7 0 2024-09-12T22:11:29.673 INFO:tasks.workunit.client.0.smithi019.stdout:0/724: chown d5/d7/dac 5 1 2024-09-12T22:11:29.674 INFO:tasks.workunit.client.0.smithi019.stdout:2/660: truncate d0/d31/d12/d3b/d5c/fb4 1850340 0 2024-09-12T22:11:29.675 INFO:tasks.workunit.client.0.smithi019.stdout:7/716: dwrite da/d19/d25/d39/d51/f6c [0,4194304] 0 2024-09-12T22:11:29.675 INFO:tasks.workunit.client.0.smithi019.stdout:0/725: mkdir d5/d7/d10/d26/d8a/daf/df9 0 2024-09-12T22:11:29.675 INFO:tasks.workunit.client.0.smithi019.stdout:9/744: write d12/f15 [1222187,35958] 0 2024-09-12T22:11:29.676 INFO:tasks.workunit.client.0.smithi019.stdout:3/747: truncate d18/d26/d30/d4a/f68 4883827 0 2024-09-12T22:11:29.677 INFO:tasks.workunit.client.0.smithi019.stdout:2/661: read - d0/d3/df/d6b/fb5 zero size 2024-09-12T22:11:29.678 INFO:tasks.workunit.client.0.smithi019.stdout:9/745: unlink d12/dd7/dc7/d92/d9d/da5/fd8 0 2024-09-12T22:11:29.678 INFO:tasks.workunit.client.0.smithi019.stdout:4/735: dwrite d9/d14/d57/d95/d96/dc4/fee [0,4194304] 0 2024-09-12T22:11:29.678 INFO:tasks.workunit.client.0.smithi019.stdout:7/717: creat da/d19/d25/d39/ff2 x:0 0 0 2024-09-12T22:11:29.679 INFO:tasks.workunit.client.0.smithi019.stdout:3/748: creat d18/d1d/d8b/dc5/fe8 x:0 0 0 2024-09-12T22:11:29.679 INFO:tasks.workunit.client.0.smithi019.stdout:6/849: dwrite d9/dc/d20/d30/f42 [0,4194304] 0 2024-09-12T22:11:29.680 INFO:tasks.workunit.client.0.smithi019.stdout:7/718: stat da/d24/d28/d1c/dda 0 2024-09-12T22:11:29.680 INFO:tasks.workunit.client.0.smithi019.stdout:3/749: fsync d18/d58/f83 0 2024-09-12T22:11:29.681 INFO:tasks.workunit.client.0.smithi019.stdout:6/850: rmdir d9/d3d/d6f 39 2024-09-12T22:11:29.681 INFO:tasks.workunit.client.0.smithi019.stdout:9/746: chown d12/d48/lcf 98 1 2024-09-12T22:11:29.681 INFO:tasks.workunit.client.0.smithi019.stdout:0/726: link d5/d7/d2c/d44/d6a/d46/f60 d5/d7/d2c/d44/d6a/ffa 0 2024-09-12T22:11:29.682 INFO:tasks.workunit.client.0.smithi019.stdout:7/719: write da/d24/d28/d1c/d32/daf/fdb [1528725,50395] 0 2024-09-12T22:11:29.683 INFO:tasks.workunit.client.0.smithi019.stdout:6/851: truncate d9/d3d/d4f/d8d/fdb 329980 0 2024-09-12T22:11:29.685 INFO:tasks.workunit.client.0.smithi019.stdout:3/750: dwrite d18/d26/d30/d4e/f73 [0,4194304] 0 2024-09-12T22:11:29.689 INFO:tasks.workunit.client.0.smithi019.stdout:6/852: read d9/dc/df7/d7e/fce [133505,818] 0 2024-09-12T22:11:29.689 INFO:tasks.workunit.client.0.smithi019.stdout:7/720: truncate da/d19/d25/d39/fa0 2906915 0 2024-09-12T22:11:29.691 INFO:tasks.workunit.client.0.smithi019.stdout:6/853: chown d9/d3d/d4f/d59/d79/de4/d11c 598867 1 2024-09-12T22:11:29.691 INFO:tasks.workunit.client.0.smithi019.stdout:5/764: sync 2024-09-12T22:11:29.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/748: sync 2024-09-12T22:11:29.692 INFO:tasks.workunit.client.0.smithi019.stdout:9/747: sync 2024-09-12T22:11:29.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/736: sync 2024-09-12T22:11:29.692 INFO:tasks.workunit.client.0.smithi019.stdout:8/724: dread d5/dc/f6d [0,4194304] 0 2024-09-12T22:11:29.692 INFO:tasks.workunit.client.0.smithi019.stdout:5/765: symlink d0/d26/d5f/l105 0 2024-09-12T22:11:29.693 INFO:tasks.workunit.client.0.smithi019.stdout:4/737: chown d9/db/dcd/l89 126 1 2024-09-12T22:11:29.694 INFO:tasks.workunit.client.0.smithi019.stdout:8/725: fsync d5/d16/d19/d29/f4d 0 2024-09-12T22:11:29.694 INFO:tasks.workunit.client.0.smithi019.stdout:3/751: dwrite f17 [0,4194304] 0 2024-09-12T22:11:29.694 INFO:tasks.workunit.client.0.smithi019.stdout:5/766: write d0/d1d/d4f/f4d [160507,102948] 0 2024-09-12T22:11:29.694 INFO:tasks.workunit.client.0.smithi019.stdout:1/749: symlink d1/d2/d18/d35/d84/dc/lf7 0 2024-09-12T22:11:29.695 INFO:tasks.workunit.client.0.smithi019.stdout:1/750: sync 2024-09-12T22:11:29.696 INFO:tasks.workunit.client.0.smithi019.stdout:2/662: dread d0/d3/d11/d77/d78/d2c/d56/d60/f74 [0,4194304] 0 2024-09-12T22:11:29.696 INFO:tasks.workunit.client.0.smithi019.stdout:5/767: symlink d0/d24/d97/l106 0 2024-09-12T22:11:29.700 INFO:tasks.workunit.client.0.smithi019.stdout:6/854: rename d9/dc/df7/d78/da1/cd4 to d9/dc/df7/c11f 0 2024-09-12T22:11:29.700 INFO:tasks.workunit.client.0.smithi019.stdout:3/752: mknod d18/d26/d30/d71/ce9 0 2024-09-12T22:11:29.701 INFO:tasks.workunit.client.0.smithi019.stdout:4/738: creat d9/d14/ff3 x:0 0 0 2024-09-12T22:11:29.701 INFO:tasks.workunit.client.0.smithi019.stdout:3/753: chown d18/f56 3079230 1 2024-09-12T22:11:29.701 INFO:tasks.workunit.client.0.smithi019.stdout:6/855: dread - d9/dc/df7/d7d/da7/f10c zero size 2024-09-12T22:11:29.701 INFO:tasks.workunit.client.0.smithi019.stdout:1/751: rename d1/d2/d18/d35/d84/dc/df/d53 to d1/d2/d18/d35/d84/df8 0 2024-09-12T22:11:29.701 INFO:tasks.workunit.client.0.smithi019.stdout:2/663: truncate d0/d31/d12/d3b/f76 3979478 0 2024-09-12T22:11:29.701 INFO:tasks.workunit.client.0.smithi019.stdout:3/754: readlink d18/d1d/d8b/lb1 0 2024-09-12T22:11:29.702 INFO:tasks.workunit.client.0.smithi019.stdout:9/748: dwrite d12/d1b/d20/f2b [0,4194304] 0 2024-09-12T22:11:29.703 INFO:tasks.workunit.client.0.smithi019.stdout:8/726: dwrite d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:29.703 INFO:tasks.workunit.client.0.smithi019.stdout:2/664: truncate d0/d3/df/d52/fd0 963738 0 2024-09-12T22:11:29.704 INFO:tasks.workunit.client.0.smithi019.stdout:8/727: write d5/dc/d8d/d96/fed [361079,50615] 0 2024-09-12T22:11:29.705 INFO:tasks.workunit.client.0.smithi019.stdout:2/665: write d0/d3/d11/d77/d78/d2c/d30/d32/f4a [28377,16817] 0 2024-09-12T22:11:29.706 INFO:tasks.workunit.client.0.smithi019.stdout:5/768: rename d0/d24/d97/dda to d0/d26/d6f/d107 0 2024-09-12T22:11:29.706 INFO:tasks.workunit.client.0.smithi019.stdout:6/856: mkdir d9/dc/d20/d4b/d6c/dfe/d120 0 2024-09-12T22:11:29.706 INFO:tasks.workunit.client.0.smithi019.stdout:3/755: creat d18/d1d/d35/fea x:0 0 0 2024-09-12T22:11:29.706 INFO:tasks.workunit.client.0.smithi019.stdout:1/752: truncate d1/f11 2485121 0 2024-09-12T22:11:29.706 INFO:tasks.workunit.client.0.smithi019.stdout:9/749: mkdir d12/d1b/d40/d85/de8/dfd 0 2024-09-12T22:11:29.707 INFO:tasks.workunit.client.0.smithi019.stdout:9/750: fsync d12/d48/f61 0 2024-09-12T22:11:29.708 INFO:tasks.workunit.client.0.smithi019.stdout:1/753: mknod d1/ddb/cf9 0 2024-09-12T22:11:29.708 INFO:tasks.workunit.client.0.smithi019.stdout:2/666: write d0/d3/df/d52/fd2 [1967796,39036] 0 2024-09-12T22:11:29.709 INFO:tasks.workunit.client.0.smithi019.stdout:2/667: chown d0/fd7 2025713796 1 2024-09-12T22:11:29.709 INFO:tasks.workunit.client.0.smithi019.stdout:0/727: dread d5/f70 [0,4194304] 0 2024-09-12T22:11:29.710 INFO:tasks.workunit.client.0.smithi019.stdout:6/857: creat d9/dc/dd9/f121 x:0 0 0 2024-09-12T22:11:29.710 INFO:tasks.workunit.client.0.smithi019.stdout:3/756: write f9 [5456532,77455] 0 2024-09-12T22:11:29.710 INFO:tasks.workunit.client.0.smithi019.stdout:4/739: truncate d9/d14/f38 8648297 0 2024-09-12T22:11:29.711 INFO:tasks.workunit.client.0.smithi019.stdout:7/721: dread da/d24/d28/d1c/f23 [0,4194304] 0 2024-09-12T22:11:29.711 INFO:tasks.workunit.client.0.smithi019.stdout:3/757: dread - d18/d1d/d35/fea zero size 2024-09-12T22:11:29.711 INFO:tasks.workunit.client.0.smithi019.stdout:0/728: read - d5/d7/d2c/d44/d6a/d52/f7b zero size 2024-09-12T22:11:29.712 INFO:tasks.workunit.client.0.smithi019.stdout:2/668: read d0/d3/d11/f8a [688541,51304] 0 2024-09-12T22:11:29.712 INFO:tasks.workunit.client.0.smithi019.stdout:1/754: mknod d1/d2/d18/d35/d84/dc/df/d2c/d5d/ddd/cfa 0 2024-09-12T22:11:29.712 INFO:tasks.workunit.client.0.smithi019.stdout:4/740: write d9/db/d2b/d6a/f81 [1766305,70658] 0 2024-09-12T22:11:29.713 INFO:tasks.workunit.client.0.smithi019.stdout:7/722: unlink da/d19/fa4 0 2024-09-12T22:11:29.713 INFO:tasks.workunit.client.0.smithi019.stdout:6/858: read d9/dc/df7/d7d/da7/fbf [1336705,105111] 0 2024-09-12T22:11:29.713 INFO:tasks.workunit.client.0.smithi019.stdout:0/729: creat d5/d7/dac/db6/ffb x:0 0 0 2024-09-12T22:11:29.713 INFO:tasks.workunit.client.0.smithi019.stdout:9/751: creat d12/d1b/d40/d85/de8/def/ffe x:0 0 0 2024-09-12T22:11:29.714 INFO:tasks.workunit.client.0.smithi019.stdout:1/755: unlink d1/d2/d18/d59/f75 0 2024-09-12T22:11:29.715 INFO:tasks.workunit.client.0.smithi019.stdout:5/769: dread d0/d24/d7a/f8f [0,4194304] 0 2024-09-12T22:11:29.715 INFO:tasks.workunit.client.0.smithi019.stdout:3/758: rename d18/d26/d30/d4e/d9a/dae/fc6 to d18/d26/d30/d4e/d80/feb 0 2024-09-12T22:11:29.715 INFO:tasks.workunit.client.0.smithi019.stdout:6/859: mkdir d9/dc/d122 0 2024-09-12T22:11:29.716 INFO:tasks.workunit.client.0.smithi019.stdout:8/728: dread d5/dc/d8d/d96/fed [0,4194304] 0 2024-09-12T22:11:29.717 INFO:tasks.workunit.client.0.smithi019.stdout:7/723: mknod da/d24/d28/d1c/d32/dc2/dca/cf3 0 2024-09-12T22:11:29.718 INFO:tasks.workunit.client.0.smithi019.stdout:3/759: creat d18/d1d/d8b/dc5/fec x:0 0 0 2024-09-12T22:11:29.718 INFO:tasks.workunit.client.0.smithi019.stdout:6/860: creat d9/dc/dd9/f123 x:0 0 0 2024-09-12T22:11:29.719 INFO:tasks.workunit.client.0.smithi019.stdout:2/669: truncate d0/d3/d11/d2e/d64/f65 3725018 0 2024-09-12T22:11:29.719 INFO:tasks.workunit.client.0.smithi019.stdout:7/724: read da/d19/d25/d39/d51/f6c [3015831,93183] 0 2024-09-12T22:11:29.720 INFO:tasks.workunit.client.0.smithi019.stdout:8/729: read d5/d16/d19/d29/f4d [6838477,19524] 0 2024-09-12T22:11:29.720 INFO:tasks.workunit.client.0.smithi019.stdout:6/861: fdatasync d9/dc/d20/f106 0 2024-09-12T22:11:29.720 INFO:tasks.workunit.client.0.smithi019.stdout:0/730: link d5/d7/d2c/d44/d6a/d46/db2/fce d5/d7/d10/d26/ffc 0 2024-09-12T22:11:29.721 INFO:tasks.workunit.client.0.smithi019.stdout:3/760: write d18/d26/f4b [5410304,81923] 0 2024-09-12T22:11:29.723 INFO:tasks.workunit.client.0.smithi019.stdout:5/770: truncate d0/d1d/d4f/f64 7486760 0 2024-09-12T22:11:29.723 INFO:tasks.workunit.client.0.smithi019.stdout:9/752: dwrite d12/d1b/d20/d25/fb9 [0,4194304] 0 2024-09-12T22:11:29.723 INFO:tasks.workunit.client.0.smithi019.stdout:4/741: dwrite d9/d4c/f78 [0,4194304] 0 2024-09-12T22:11:29.724 INFO:tasks.workunit.client.0.smithi019.stdout:5/771: stat d0/d26/c65 0 2024-09-12T22:11:29.724 INFO:tasks.workunit.client.0.smithi019.stdout:6/862: write d9/d3d/d6f/f101 [455212,50256] 0 2024-09-12T22:11:29.725 INFO:tasks.workunit.client.0.smithi019.stdout:0/731: unlink d5/d7/d2c/l8e 0 2024-09-12T22:11:29.728 INFO:tasks.workunit.client.0.smithi019.stdout:4/742: chown d9/d14/d33/d4e/c52 1796942727 1 2024-09-12T22:11:29.730 INFO:tasks.workunit.client.0.smithi019.stdout:5/772: write d0/d24/fb1 [3759845,68640] 0 2024-09-12T22:11:29.730 INFO:tasks.workunit.client.0.smithi019.stdout:0/732: symlink d5/d7/dac/lfd 0 2024-09-12T22:11:29.730 INFO:tasks.workunit.client.0.smithi019.stdout:5/773: sync 2024-09-12T22:11:29.730 INFO:tasks.workunit.client.0.smithi019.stdout:1/756: dwrite d1/d2/d18/d35/d84/df8/d55/d56/f94 [4194304,4194304] 0 2024-09-12T22:11:29.731 INFO:tasks.workunit.client.0.smithi019.stdout:3/761: truncate d18/d1d/d35/f8d 3035630 0 2024-09-12T22:11:29.732 INFO:tasks.workunit.client.0.smithi019.stdout:6/863: read d9/d3d/f90 [3648155,6321] 0 2024-09-12T22:11:29.732 INFO:tasks.workunit.client.0.smithi019.stdout:0/733: write d5/d7/d10/d26/f9e [184122,100564] 0 2024-09-12T22:11:29.734 INFO:tasks.workunit.client.0.smithi019.stdout:5/774: creat d0/d26/d42/df0/f108 x:0 0 0 2024-09-12T22:11:29.735 INFO:tasks.workunit.client.0.smithi019.stdout:7/725: dwrite da/d19/d25/d39/f71 [0,4194304] 0 2024-09-12T22:11:29.735 INFO:tasks.workunit.client.0.smithi019.stdout:1/757: chown d1/d2/d18/d35/d84/df8/d55/cc5 939352403 1 2024-09-12T22:11:29.735 INFO:tasks.workunit.client.0.smithi019.stdout:0/734: mkdir d5/de2/dfe 0 2024-09-12T22:11:29.736 INFO:tasks.workunit.client.0.smithi019.stdout:9/753: dread d12/dd7/dc7/d56/f81 [0,4194304] 0 2024-09-12T22:11:29.736 INFO:tasks.workunit.client.0.smithi019.stdout:2/670: dwrite d0/d3/d11/d77/d78/d2c/d30/d32/f4a [0,4194304] 0 2024-09-12T22:11:29.737 INFO:tasks.workunit.client.0.smithi019.stdout:6/864: mkdir d9/d3d/d4f/d59/d79/dfc/d124 0 2024-09-12T22:11:29.737 INFO:tasks.workunit.client.0.smithi019.stdout:9/754: fsync d12/d48/f6d 0 2024-09-12T22:11:29.738 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:29.737+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:29.740 INFO:tasks.workunit.client.0.smithi019.stdout:7/726: rmdir da/d24/d28/d1c/d32 39 2024-09-12T22:11:29.741 INFO:tasks.workunit.client.0.smithi019.stdout:6/865: mkdir d9/d3d/d4f/d59/d79/de4/d125 0 2024-09-12T22:11:29.742 INFO:tasks.workunit.client.0.smithi019.stdout:0/735: write d5/d7/d2c/d44/d6a/d46/db2/ff3 [575146,11172] 0 2024-09-12T22:11:29.743 INFO:tasks.workunit.client.0.smithi019.stdout:5/775: dwrite d0/d1d/d6d/f8b [0,4194304] 0 2024-09-12T22:11:29.744 INFO:tasks.workunit.client.0.smithi019.stdout:1/758: dwrite d1/d83/fc8 [0,4194304] 0 2024-09-12T22:11:29.745 INFO:tasks.workunit.client.0.smithi019.stdout:9/755: getdents d12/d1b/d20/d64 0 2024-09-12T22:11:29.745 INFO:tasks.workunit.client.0.smithi019.stdout:2/671: dwrite d0/d31/fa3 [0,4194304] 0 2024-09-12T22:11:29.747 INFO:tasks.workunit.client.0.smithi019.stdout:0/736: chown d5/d7/d10/c40 19 1 2024-09-12T22:11:29.747 INFO:tasks.workunit.client.0.smithi019.stdout:7/727: mkdir da/d24/d28/d1c/d32/d99/dc8/df4 0 2024-09-12T22:11:29.747 INFO:tasks.workunit.client.0.smithi019.stdout:5/776: unlink d0/d1d/d4f/d96/ce1 0 2024-09-12T22:11:29.748 INFO:tasks.workunit.client.0.smithi019.stdout:6/866: rename d9/d6b/cbb to d9/d3d/d4f/d59/d79/de4/d11c/c126 0 2024-09-12T22:11:29.748 INFO:tasks.workunit.client.0.smithi019.stdout:3/762: dwrite d18/d1d/d8b/fa0 [0,4194304] 0 2024-09-12T22:11:29.748 INFO:tasks.workunit.client.0.smithi019.stdout:0/737: chown d5/d7/f12 0 1 2024-09-12T22:11:29.749 INFO:tasks.workunit.client.0.smithi019.stdout:2/672: write d0/d31/d12/f83 [843358,62820] 0 2024-09-12T22:11:29.749 INFO:tasks.workunit.client.0.smithi019.stdout:1/759: symlink d1/d2/d18/d35/d84/d98/dbc/lfb 0 2024-09-12T22:11:29.749 INFO:tasks.workunit.client.0.smithi019.stdout:6/867: fdatasync d9/dc/d20/d30/db7/fe2 0 2024-09-12T22:11:29.749 INFO:tasks.workunit.client.0.smithi019.stdout:3/763: stat d18/d26/d30/d4a/l87 0 2024-09-12T22:11:29.750 INFO:tasks.workunit.client.0.smithi019.stdout:7/728: stat da/d19/d25/cc6 0 2024-09-12T22:11:29.750 INFO:tasks.workunit.client.0.smithi019.stdout:5/777: getdents d0/dbf 0 2024-09-12T22:11:29.750 INFO:tasks.workunit.client.0.smithi019.stdout:9/756: creat d12/dd7/dc7/d74/d77/d86/fff x:0 0 0 2024-09-12T22:11:29.750 INFO:tasks.workunit.client.0.smithi019.stdout:0/738: chown d5/c19 0 1 2024-09-12T22:11:29.751 INFO:tasks.workunit.client.0.smithi019.stdout:5/778: creat d0/d26/d42/df0/f109 x:0 0 0 2024-09-12T22:11:29.751 INFO:tasks.workunit.client.0.smithi019.stdout:6/868: creat d9/dc/df7/d78/f127 x:0 0 0 2024-09-12T22:11:29.752 INFO:tasks.workunit.client.0.smithi019.stdout:5/779: dread - d0/d26/f102 zero size 2024-09-12T22:11:29.752 INFO:tasks.workunit.client.0.smithi019.stdout:1/760: readlink d1/d2/d18/d35/d84/dc/df/d2c/d5d/l5f 0 2024-09-12T22:11:29.753 INFO:tasks.workunit.client.0.smithi019.stdout:6/869: chown d9/dc/d20/d30/db7 1527 1 2024-09-12T22:11:29.753 INFO:tasks.workunit.client.0.smithi019.stdout:9/757: read d12/d1b/d20/d25/fb9 [1366543,46235] 0 2024-09-12T22:11:29.754 INFO:tasks.workunit.client.0.smithi019.stdout:2/673: rename d0/d3/d11/d77/d78/d2c/d2d/lcb to d0/d31/d12/d3b/d5c/d71/ld9 0 2024-09-12T22:11:29.755 INFO:tasks.workunit.client.0.smithi019.stdout:5/780: truncate d0/d1d/d3d/fe4 215799 0 2024-09-12T22:11:29.755 INFO:tasks.workunit.client.0.smithi019.stdout:1/761: write d1/d2/d18/d35/d84/dc/f50 [4549627,11646] 0 2024-09-12T22:11:29.756 INFO:tasks.workunit.client.0.smithi019.stdout:7/729: rename da/d24/d28/d1c/db9 to da/d19/d25/d39/d51/dd7/db1/db5/db6/df5 0 2024-09-12T22:11:29.756 INFO:tasks.workunit.client.0.smithi019.stdout:3/764: dwrite d18/d58/fc3 [0,4194304] 0 2024-09-12T22:11:29.757 INFO:tasks.workunit.client.0.smithi019.stdout:2/674: rename d0/d31/d4/d7/f45 to d0/d3/df/d7b/dbe/fda 0 2024-09-12T22:11:29.758 INFO:tasks.workunit.client.0.smithi019.stdout:3/765: mkdir d18/d1d/d35/ded 0 2024-09-12T22:11:29.758 INFO:tasks.workunit.client.0.smithi019.stdout:9/758: link d12/d1b/d20/l4e d12/dd7/dc7/d74/d77/d86/ddf/df2/l100 0 2024-09-12T22:11:29.758 INFO:tasks.workunit.client.0.smithi019.stdout:9/759: sync 2024-09-12T22:11:29.758 INFO:tasks.workunit.client.0.smithi019.stdout:2/675: creat d0/d3/d11/d77/d78/d2c/d30/fdb x:0 0 0 2024-09-12T22:11:29.759 INFO:tasks.workunit.client.0.smithi019.stdout:0/739: truncate d5/d7/d2c/d44/d6a/d76/f7e 3133605 0 2024-09-12T22:11:29.759 INFO:tasks.workunit.client.0.smithi019.stdout:1/762: rename d1/d2/d18/d35/d84/df8/fec to d1/d2/d18/d35/d84/df8/ffc 0 2024-09-12T22:11:29.760 INFO:tasks.workunit.client.0.smithi019.stdout:5/781: truncate d0/f9c 603529 0 2024-09-12T22:11:29.760 INFO:tasks.workunit.client.0.smithi019.stdout:0/740: rmdir d5/d7/d10 39 2024-09-12T22:11:29.761 INFO:tasks.workunit.client.0.smithi019.stdout:9/760: getdents d12/d1b/d40/d85/de8 0 2024-09-12T22:11:29.762 INFO:tasks.workunit.client.0.smithi019.stdout:2/676: fdatasync d0/d3/d11/d77/d78/d2c/d30/d32/f81 0 2024-09-12T22:11:29.762 INFO:tasks.workunit.client.0.smithi019.stdout:1/763: write d1/d2/d18/d35/d84/dc/fa6 [1252677,35845] 0 2024-09-12T22:11:29.763 INFO:tasks.workunit.client.0.smithi019.stdout:0/741: read d5/d7/d2c/d44/d6a/f98 [573788,88679] 0 2024-09-12T22:11:29.764 INFO:tasks.workunit.client.0.smithi019.stdout:7/730: dwrite da/d24/d28/f98 [4194304,4194304] 0 2024-09-12T22:11:29.766 INFO:tasks.workunit.client.0.smithi019.stdout:0/742: creat d5/d7/de/d9a/fff x:0 0 0 2024-09-12T22:11:29.766 INFO:tasks.workunit.client.0.smithi019.stdout:9/761: getdents d12/dd7/dc7/d92 0 2024-09-12T22:11:29.766 INFO:tasks.workunit.client.0.smithi019.stdout:1/764: dread - d1/d2/d18/d35/d84/dc/df/fb7 zero size 2024-09-12T22:11:29.766 INFO:tasks.workunit.client.0.smithi019.stdout:8/730: dread d5/d16/d19/f5b [0,4194304] 0 2024-09-12T22:11:29.767 INFO:tasks.workunit.client.0.smithi019.stdout:6/870: dwrite d9/dc/df7/d78/fde [0,4194304] 0 2024-09-12T22:11:29.767 INFO:tasks.workunit.client.0.smithi019.stdout:9/762: write d12/f1f [1517640,41014] 0 2024-09-12T22:11:29.768 INFO:tasks.workunit.client.0.smithi019.stdout:0/743: truncate d5/d7/d2c/d44/d6a/d52/fe1 532624 0 2024-09-12T22:11:29.769 INFO:tasks.workunit.client.0.smithi019.stdout:5/782: truncate d0/f19 651479 0 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.047407851999999, 2024-09-12T22:11:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.046806918, 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.035245793, 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 3800068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.83542059, 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024017679, 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931254+0000", 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-07 2024-09-12T22:11:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931256+0000", 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7e-06 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931261+0000", 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2179999999999998e-06 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931266+0000", 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953273+0000", 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022006537999999999 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953326+0000", 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3256e-05 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953415+0000", 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8657000000000002e-05 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954136+0000", 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072149300000000003 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955218+0000", 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010819110000000001 2024-09-12T22:11:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955249+0000", 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0542e-05 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955272+0000", 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3037999999999999e-05 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.835402304, 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.835380454999999, 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.835365664999999, 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.835355796, 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.83534171, 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.9487657399999998, 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.6480942889999999, 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11117 4.33 4:cf859f74:::10000003108.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.279016+0000", 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.4876583590000001, 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023810147, 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11117 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279016+0000", 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279016+0000", 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.279017+0000", 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.223e-06 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286299+0000", 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007281526 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286309+0000", 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.012e-05 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286314+0000", 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1529999999999996e-06 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286366+0000", 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1943000000000001e-05 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.286515+0000", 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014908099999999999 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.302715+0000", 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016199623 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.302759+0000", 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769000000000001e-05 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.302826+0000", 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7708999999999998e-05 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.318566685, 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.8476098949999997, 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:29.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.856 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13872 4.0 4:00afe0ce:::10000003130.00000000:head [write 0~4194304 [3@524579]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.329086+0000", 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.43758815099999998, 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023720040000000001, 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13872 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.329086+0000", 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.329086+0000", 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.329087+0000", 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6199999999999997e-07 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.333442+0000", 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043546540000000003 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.333452+0000", 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0479000000000001e-05 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.333458+0000", 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3079999999999998e-06 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.333493+0000", 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5726999999999999e-05 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.333543+0000", 2024-09-12T22:11:29.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9186e-05 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.333614+0000", 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1752e-05 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.337285+0000", 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036710179999999999 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.352713+0000", 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015427457 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.352766+0000", 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3457e-05 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.352806+0000", 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0240000000000001e-05 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.42808359499999998, 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:29.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.35328402399999997, 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:29.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:29.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.875 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.319218526, 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.876 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:29.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.881 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.16614142500000001, 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.882 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:29.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:29.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.087440233000000006, 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:29.888 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:29.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:29.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:29.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:29.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:29.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.894 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:29.894 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:29.894 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:29.897 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:29.898 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:29.894+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:2/677: write d0/d3/d11/d2e/d64/f65 [2519957,122081] 0 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:8/731: chown d5/dc/d8a/l9c 8254725 1 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:0/744: readlink d5/d7/d2c/d44/d6a/d52/l62 0 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:1/765: write d1/d2/d18/d29/d51/f85 [1081101,25188] 0 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:9/763: symlink d12/dd7/dc7/d74/d77/l101 0 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:5/783: chown d0/d1d/d4f/d47/d57/d98 62 1 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:7/731: write da/d19/f50 [1612703,14962] 0 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:0/745: creat d5/d87/f100 x:0 0 0 2024-09-12T22:11:29.920 INFO:tasks.workunit.client.0.smithi019.stdout:2/678: rmdir d0/d3/d11/d77/d78/d2c/d56 39 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:5/784: write d0/d4e/d50/f62 [1028050,136] 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:6/871: dwrite d9/d3d/d6f/fbe [4194304,4194304] 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:1/766: creat d1/d2/da2/ffd x:0 0 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:7/732: chown da/d24/d28/l7b 3756 1 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:5/785: write d0/f18 [400653,30075] 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:3/766: dread d18/d26/d30/d4e/f52 [0,4194304] 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:5/786: readlink d0/d1d/d4f/l43 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:7/733: dread - da/d24/d28/d1c/fe9 zero size 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:5/787: stat d0/d24/d58/f66 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:3/767: unlink d18/d26/d30/d4e/d80/fa4 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:9/764: dwrite d12/dd7/dc7/d92/fc5 [0,4194304] 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:1/767: creat d1/d2/d18/d35/d84/dc/df/d2c/d5d/ddd/ffe x:0 0 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:8/732: write d5/d16/f63 [4861652,15748] 0 2024-09-12T22:11:29.921 INFO:tasks.workunit.client.0.smithi019.stdout:2/679: creat d0/d3/d11/d77/d78/d2c/d56/d60/fdc x:0 0 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:3/768: fdatasync d18/d26/fd3 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:7/734: mknod da/d19/cf6 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:8/733: fdatasync d5/dc/d26/fcd 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:6/872: rmdir d9/dc/d20/d4b/d6c/d8c/d115 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:4/743: dread d9/db/f99 [0,4194304] 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:0/746: truncate d5/d7/d2c/d44/d6a/d76/f7e 370397 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:9/765: rename d12/c31 to d12/dd7/dc7/d56/df5/c102 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:1/768: chown d1/d2/d18/d35/d84/dc/df/d2c/fd2 606244227 1 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:6/873: rmdir d9/dc/d20/d71 39 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:2/680: mkdir d0/d3/df/d7b/d44/ddd 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:0/747: readlink d5/d7/d2c/d44/d6a/d46/db2/lbb 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:7/735: mknod da/d24/d28/d1c/d32/d5e/dc3/dd9/cf7 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:8/734: rename d5/dc/ff to d5/dc/d26/d76/fef 0 2024-09-12T22:11:29.922 INFO:tasks.workunit.client.0.smithi019.stdout:1/769: creat d1/d2/d18/d35/d84/df8/d55/d56/fff x:0 0 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:2/681: dread - d0/d3/df/d6b/fb5 zero size 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:7/736: fsync da/d24/d28/d1c/fe9 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:4/744: write d9/db/dcd/fd6 [982912,105868] 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:3/769: dread d18/d58/fc3 [0,4194304] 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:0/748: chown d5/d7/d2c/d44/d6a/d46/fb0 0 1 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:9/766: truncate d12/dd7/dc7/d74/d77/fcc 4263562 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:2/682: creat d0/d3/df/d6b/fde x:0 0 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:8/735: dread - d5/dc/d26/d43/d49/d92/fb6 zero size 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:3/770: rename d18/d1d/f2b to d18/d1d/d35/ded/fee 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:7/737: truncate da/d24/d28/d1c/d32/d99/fa1 877389 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:1/770: dread d1/d2/d18/d35/d84/dc/fa6 [0,4194304] 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:3/771: chown d18/d1d/d35/f8d 73104083 1 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:6/874: dwrite d9/dc/d20/d30/fed [0,4194304] 0 2024-09-12T22:11:29.923 INFO:tasks.workunit.client.0.smithi019.stdout:2/683: link d0/d3/d11/d77/d78/f7c d0/d3/d11/d77/d78/fdf 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:7/738: mkdir da/d19/d25/d39/d51/df8 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:8/736: dread d5/d53/d66/fb5 [0,4194304] 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:4/745: dwrite d9/d87/fcf [0,4194304] 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:0/749: dwrite d5/d7/d10/d26/f3e [4194304,4194304] 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:4/746: creat d9/d58/ff4 x:0 0 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:9/767: dwrite d12/d1b/d40/fe4 [0,4194304] 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:3/772: creat d18/d26/d30/fef x:0 0 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:7/739: unlink da/d24/d28/d1c/d32/d5e/dc3/ff1 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:8/737: creat d5/dc/d8d/d96/da7/ff0 x:0 0 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:4/747: chown d9/db/d2b/de0/lf1 200979 1 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:9/768: symlink d12/d1b/d20/d59/d5b/d9a/l103 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:8/738: stat d5/d16/c22 0 2024-09-12T22:11:29.924 INFO:tasks.workunit.client.0.smithi019.stdout:3/773: mknod d18/d26/d30/d4a/cf0 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/769: stat d12/d1b/d20/f2a 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:8/739: chown d5/dc/d26/d4b/c5d 5682229 1 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/770: readlink d12/d1b/d20/da0/la4 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:4/748: mknod d9/d14/d57/d95/dbe/dc6/cf5 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:6/875: truncate d9/d3d/d6f/fbe 6980180 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:2/684: truncate d0/d3/d11/d77/d78/d2c/fc6 745343 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:8/740: dread - d5/dc/d8d/d96/da7/ff0 zero size 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/771: chown d12/d1b/d20/d25/ffb 278 1 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:4/749: symlink d9/d14/d57/d95/dbe/dc6/deb/lf6 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:2/685: mknod d0/d3/df/d7b/d80/d9a/ce0 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:4/750: mkdir d9/db/d2b/df7 0 2024-09-12T22:11:29.925 INFO:tasks.workunit.client.0.smithi019.stdout:6/876: truncate d9/dc/d20/d71/fd0 778882 0 2024-09-12T22:11:29.926 INFO:tasks.workunit.client.0.smithi019.stdout:2/686: truncate d0/d3/d11/d2e/d64/f65 4348095 0 2024-09-12T22:11:29.926 INFO:tasks.workunit.client.0.smithi019.stdout:2/687: fdatasync d0/d31/d12/f83 0 2024-09-12T22:11:29.926 INFO:tasks.workunit.client.0.smithi019.stdout:6/877: chown d9/d3d/d4f/d59/d79/caa 1045 1 2024-09-12T22:11:29.926 INFO:tasks.workunit.client.0.smithi019.stdout:9/772: dread d12/dd7/dc7/d74/d77/fcc [0,4194304] 0 2024-09-12T22:11:29.926 INFO:tasks.workunit.client.0.smithi019.stdout:8/741: dwrite d5/d16/f83 [8388608,4194304] 0 2024-09-12T22:11:29.926 INFO:tasks.workunit.client.0.smithi019.stdout:8/742: chown d5/d53/d66/cdc 516917 1 2024-09-12T22:11:29.926 INFO:tasks.workunit.client.0.smithi019.stdout:9/773: readlink d12/dd7/dc7/d74/d77/d86/dbd/lc4 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:2/688: chown d0/d3/d11/d77/d78/d2c/d56/d60/fc9 43693076 1 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:4/751: dwrite d9/d6c/f7e [0,4194304] 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:2/689: mkdir d0/d3/de1 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:7/740: dread da/d19/d25/f9e [0,4194304] 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:0/750: read d5/d7/f30 [9988,119290] 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:9/774: creat d12/dd7/dc7/d92/d9d/da5/f104 x:0 0 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:4/752: write d9/db/f24 [2654385,7959] 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:8/743: fdatasync d5/d16/d19/d29/f38 0 2024-09-12T22:11:29.927 INFO:tasks.workunit.client.0.smithi019.stdout:5/788: sync 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:8/744: fsync d5/d53/d66/fc1 0 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:5/789: read - d0/d24/d58/f66 zero size 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:4/753: chown d9/d14/d57/f7c 33 1 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:9/775: creat d12/d1b/d40/d85/de8/def/f105 x:0 0 0 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:7/741: link da/d24/d28/d1c/d32/d94/fe3 da/d19/d25/d39/d51/dd7/ff9 0 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:6/878: dwrite d9/d3d/f6e [0,4194304] 0 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:1/771: dread d1/fce [0,4194304] 0 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:2/690: dwrite d0/d3/d11/d2e/d70/f97 [0,4194304] 0 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:7/742: write da/d24/d28/f57 [3128354,46102] 0 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:6/879: chown d9/d3d/d4f/d59/d79/f108 11 1 2024-09-12T22:11:29.928 INFO:tasks.workunit.client.0.smithi019.stdout:8/745: getdents d5/dc/d8a/d98 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:6/880: unlink d9/dc/d20/f14 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:2/691: creat d0/d3/d11/d77/d78/d2c/d56/fe2 x:0 0 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:9/776: mknod d12/dd7/dc7/d74/d77/d86/ddf/df2/c106 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:0/751: dwrite d5/d7/d2c/d44/d6a/d46/fb0 [0,4194304] 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:9/777: chown d12/d1b/d20/d59/d5b/d9e 5665943 1 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:8/746: creat d5/d53/ff1 x:0 0 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:4/754: truncate d9/d14/fa2 257518 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:6/881: symlink d9/dc/df7/d78/da1/l128 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:8/747: unlink d5/dc/d8d/d96/fb9 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:9/778: chown d12/d1b/d40/c73 7 1 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:1/772: dwrite d1/d2/d18/d35/d84/dc/df/fb7 [0,4194304] 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:7/743: dwrite da/d24/d28/fe4 [0,4194304] 0 2024-09-12T22:11:29.929 INFO:tasks.workunit.client.0.smithi019.stdout:4/755: unlink d9/d14/d33/f46 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:0/752: getdents d5/d7 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:8/748: fsync d5/dc/d26/f36 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:1/773: dread - d1/d2/d18/d35/d84/d98/dbc/fe5 zero size 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:9/779: mknod d12/d1b/d20/d59/d5b/d9e/c107 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:0/753: readlink d5/d7/d10/d26/d8a/daf/ld9 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:6/882: creat d9/d3d/d4f/d59/d113/f129 x:0 0 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:7/744: mkdir da/d24/d28/d1c/d32/daf/dfa 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:2/692: dwrite d0/d3/df/d6b/fde [0,4194304] 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:4/756: symlink d9/d14/d57/d95/dbe/dc6/deb/lf8 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:7/745: read da/d24/fb7 [3566541,22471] 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:8/749: rename d5/c8 to d5/dc/d8a/cf2 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:7/746: unlink da/d24/d28/d1c/fe9 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:8/750: symlink d5/dc/d8a/d98/lf3 0 2024-09-12T22:11:29.930 INFO:tasks.workunit.client.0.smithi019.stdout:6/883: chown d9/dc/df7/d78/da1/laf 7778 1 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:1/774: dwrite d1/d37/ff4 [0,4194304] 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:6/884: rmdir d9/d3d 39 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:2/693: dwrite d0/d3/d11/d2e/d64/daf/fd4 [0,4194304] 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:5/790: dread d0/d4e/f5a [0,4194304] 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:9/780: dwrite d12/d1b/d20/d25/fad [0,4194304] 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:2/694: read d0/d3/d11/d2e/d64/f65 [3747707,121737] 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:3/774: dread d18/f34 [4194304,4194304] 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:6/885: creat d9/dc/df7/d78/da1/f12a x:0 0 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:5/791: mkdir d0/d26/d6f/d107/d10a 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:9/781: readlink d12/dd7/dc7/d74/d77/d86/ddf/df2/l100 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:2/695: chown d0/d31/d12/c26 3178 1 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:3/775: truncate d18/d1d/d35/fea 656644 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:1/775: dwrite d1/d2/da2/fa5 [0,4194304] 0 2024-09-12T22:11:29.931 INFO:tasks.workunit.client.0.smithi019.stdout:5/792: truncate d0/d1d/d3d/fa3 926343 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:6/886: creat d9/dc/df7/d78/da1/f12b x:0 0 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:9/782: creat d12/dd7/dc7/d74/d77/d86/dbd/f108 x:0 0 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:6/887: creat d9/d6b/f12c x:0 0 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:2/696: link d0/d3/df/lb3 d0/d3/d11/le3 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:3/776: mkdir d18/d1d/d8b/dc5/dbb/df1 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:9/783: dread - d12/dd7/dc7/d74/d77/d86/dbd/f108 zero size 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:5/793: link d0/d1d/c2a d0/d1d/d4f/d47/d57/dba/df6/c10b 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:1/776: truncate d1/d2/d18/d35/d84/dc/df/d61/fa7 1096705 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:6/888: mknod d9/dc/d20/d4b/d6c/dfe/c12d 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:2/697: write d0/d3/df/d6b/f86 [1411013,13195] 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:3/777: mkdir d18/d26/d30/d4e/d80/df2 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:2/698: stat d0/d3/d11/d77/d78/d2c/d2d/c4b 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:6/889: creat d9/dc/d122/f12e x:0 0 0 2024-09-12T22:11:29.932 INFO:tasks.workunit.client.0.smithi019.stdout:6/890: readlink d9/dc/d20/l58 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:2/699: mkdir d0/d3/d11/d77/d78/d2c/d2d/de4 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:2/700: write d0/d3/df/d6b/f86 [12288,107582] 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:6/891: rmdir d9/dc/d20/d4b/d6c/dfe/d120 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:5/794: truncate d0/d4e/fbc 3077499 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:2/701: read d0/d3/df/f61 [3349910,90907] 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:6/892: symlink d9/dc/df7/d78/da1/l12f 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:3/778: dwrite d18/d26/d30/d71/d86/f9e [0,4194304] 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:4/757: dread d9/d14/d57/d95/dbe/dc6/f8b [0,4194304] 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:1/777: dwrite d1/d2/d18/d29/f9b [0,4194304] 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:3/779: creat d18/d26/d30/d4e/d80/ff3 x:0 0 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:9/784: dwrite d12/dd7/dc7/d74/de3/ff6 [0,4194304] 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:5/795: rename d0/d1d/d3d/fa3 to d0/d1d/d4f/d47/d57/dba/f10c 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:6/893: link d9/d3d/d4f/d59/ldd d9/d3d/d4f/d59/d113/l130 0 2024-09-12T22:11:29.933 INFO:tasks.workunit.client.0.smithi019.stdout:4/758: rename d9/d14/d57/d95/dbe/dc6/d3f/f48 to d9/d17/ff9 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:2/702: rename d0/d31/d12/d3b/d5c to d0/d3/d11/d77/d78/d2c/d30/d32/de5 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:4/759: chown d9/d14/l32 6 1 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:6/894: write d9/f22 [5835688,30546] 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:6/895: dread - d9/dc/df7/d78/da1/f10b zero size 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:1/778: dwrite d1/d2/d18/d35/d84/dc/df/d61/f44 [0,4194304] 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:4/760: mknod d9/d14/d57/d95/d96/ddd/dc5/cfa 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:5/796: truncate d0/d26/d6f/f74 3060511 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:2/703: rename d0/d3/d11/fbd to d0/d3/d11/d77/d78/d2c/d2d/fe6 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:3/780: dwrite d18/d26/d30/d64/f88 [4194304,4194304] 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:1/779: fdatasync d1/d2/d18/d35/d84/d98/dbc/fe5 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:9/785: read d12/d1b/d20/f2a [2395167,124174] 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:2/704: creat d0/d3/d11/d77/d82/d94/fe7 x:0 0 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:9/786: creat d12/dd7/dc7/d56/df5/f109 x:0 0 0 2024-09-12T22:11:29.934 INFO:tasks.workunit.client.0.smithi019.stdout:5/797: dwrite d0/d24/d97/fce [0,4194304] 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:4/761: creat d9/d14/d57/d95/dbe/dc6/ffb x:0 0 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:2/705: chown d0/d3/df/d52/f96 2936 1 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:8/751: dread d5/d16/d19/d29/f4d [4194304,4194304] 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:3/781: dwrite f9 [4194304,4194304] 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:4/762: unlink d9/d14/fb7 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:9/787: mknod d12/dd7/dc7/d74/d77/d86/c10a 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:5/798: chown d0/d1d/d3d/ff1 171161845 1 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:8/752: creat d5/ff4 x:0 0 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:3/782: fsync d18/d26/d30/fef 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:5/799: symlink d0/d26/d3a/l10d 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:8/753: read d5/d53/d66/fb5 [340390,98854] 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:4/763: mkdir d9/d14/d57/d95/d96/ddd/dfc 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:1/780: dwrite d1/f14 [0,4194304] 0 2024-09-12T22:11:29.935 INFO:tasks.workunit.client.0.smithi019.stdout:0/754: sync 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:6/896: dwrite d9/dc/d20/d4b/d6c/d8c/fd8 [0,4194304] 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:5/800: mknod d0/d4e/c10e 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:3/783: rename d18/d1d/l8a to d18/d26/d30/d71/lf4 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:7/747: dread da/d24/d28/d1c/d32/d99/fc0 [4194304,4194304] 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:5/801: readlink d0/d26/d5f/dc3/leb 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:0/755: write d5/d7/d10/f5e [1317608,128538] 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:1/781: unlink d1/d2/d18/d29/d27/c40 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:9/788: dwrite d12/dd7/dc7/d92/d9d/da5/fdd [0,4194304] 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:0/756: dread - d5/d7/de/d8d/ff8 zero size 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:7/748: mknod da/d19/d25/d39/d51/dd7/db1/cfb 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:4/764: creat d9/db/ffd x:0 0 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:0/757: chown d5/d87/f100 131753648 1 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:8/754: dwrite d5/dc/d26/d4b/f91 [4194304,4194304] 0 2024-09-12T22:11:29.936 INFO:tasks.workunit.client.0.smithi019.stdout:6/897: getdents d9/d3d/d4f/d59/d79/dfc 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:1/782: creat d1/d2/d18/d29/d27/f100 x:0 0 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:5/802: getdents d0/d26/d42 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:4/765: chown d9/db/dcd/cba 0 1 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:8/755: fdatasync d5/dc/d26/fcd 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:7/749: write da/d24/d28/d1c/d32/f3c [4401376,36953] 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:0/758: read - d5/d7/d2c/d44/d6a/d46/fe3 zero size 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:6/898: write d9/dc/d20/d4b/d6c/d8c/fd8 [2070901,51565] 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:8/756: mkdir d5/dc/d26/d4b/df5 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:8/757: readlink d5/dc/d8a/l9c 0 2024-09-12T22:11:29.937 INFO:tasks.workunit.client.0.smithi019.stdout:6/899: mkdir d9/d6b/d131 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:1/783: creat d1/d2/d18/d35/d84/df8/d66/f101 x:0 0 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:0/759: creat d5/d7/dac/db6/f101 x:0 0 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:7/750: mkdir da/d24/d28/d1c/d32/df0/dfc 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:4/766: mkdir d9/d14/d57/d95/dbe/d6f/dfe 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:8/758: rename d5/dc/d26/d43/d49/d7a/f80 to d5/dc/d26/dc8/ff6 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:7/751: symlink da/d24/d28/d1c/d32/d5e/dc3/lfd 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:1/784: rmdir d1 39 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:5/803: dwrite d0/f63 [0,4194304] 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:7/752: truncate da/d30/f6a 5103536 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:5/804: write d0/d26/d42/faf [196716,47866] 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:4/767: link d9/db/d2b/fc2 d9/d14/d33/fff 0 2024-09-12T22:11:29.938 INFO:tasks.workunit.client.0.smithi019.stdout:6/900: dwrite d9/dc/df7/f104 [0,4194304] 0 2024-09-12T22:11:29.939 INFO:tasks.workunit.client.0.smithi019.stdout:0/760: dwrite d5/d7/d10/f24 [0,4194304] 0 2024-09-12T22:11:29.939 INFO:tasks.workunit.client.0.smithi019.stdout:7/753: write da/d19/d25/d39/ff2 [358523,60104] 0 2024-09-12T22:11:29.939 INFO:tasks.workunit.client.0.smithi019.stdout:5/805: truncate d0/d26/d5f/dc3/fd2 285372 0 2024-09-12T22:11:29.939 INFO:tasks.workunit.client.0.smithi019.stdout:7/754: sync 2024-09-12T22:11:29.939 INFO:tasks.workunit.client.0.smithi019.stdout:8/759: dwrite d5/d16/d19/fba [0,4194304] 0 2024-09-12T22:11:29.939 INFO:tasks.workunit.client.0.smithi019.stdout:9/789: dread d12/dd7/dc7/d92/d9d/feb [4194304,4194304] 0 2024-09-12T22:11:29.945 INFO:tasks.workunit.client.0.smithi019.stdout:8/760: creat d5/dc/d17/dce/ff7 x:0 0 0 2024-09-12T22:11:29.945 INFO:tasks.workunit.client.0.smithi019.stdout:7/755: rename da/d24/fb7 to da/d24/d28/ffe 0 2024-09-12T22:11:29.945 INFO:tasks.workunit.client.0.smithi019.stdout:1/785: dread d1/d83/fc8 [0,4194304] 0 2024-09-12T22:11:29.945 INFO:tasks.workunit.client.0.smithi019.stdout:4/768: getdents d9/d14/d57/d95/dbe/d6f 0 2024-09-12T22:11:29.945 INFO:tasks.workunit.client.0.smithi019.stdout:6/901: read d9/dc/d20/d4b/f2c [51489,25233] 0 2024-09-12T22:11:29.945 INFO:tasks.workunit.client.0.smithi019.stdout:4/769: write d9/d14/d57/d95/dbe/dc6/f8b [754182,9667] 0 2024-09-12T22:11:29.946 INFO:tasks.workunit.client.0.smithi019.stdout:7/756: truncate da/d30/da5/fec 875648 0 2024-09-12T22:11:29.946 INFO:tasks.workunit.client.0.smithi019.stdout:5/806: dwrite d0/d26/d5f/f8e [0,4194304] 0 2024-09-12T22:11:29.946 INFO:tasks.workunit.client.0.smithi019.stdout:1/786: stat d1/d2/d18/d35/d84/df8/ccf 0 2024-09-12T22:11:29.946 INFO:tasks.workunit.client.0.smithi019.stdout:6/902: write d9/dc/d20/d30/db7/f11e [991447,11779] 0 2024-09-12T22:11:29.946 INFO:tasks.workunit.client.0.smithi019.stdout:8/761: dwrite d5/d16/f63 [4194304,4194304] 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:9/790: dwrite d12/d1b/d20/d25/fb9 [0,4194304] 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:9/791: read - d12/d1b/d20/fea zero size 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:6/903: truncate d9/dc/d20/d30/d5b/fe5 19913 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:6/904: chown d9/dc/d20/d30/l33 6346 1 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:1/787: mknod d1/d2/d18/d35/d84/d98/c102 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:7/757: rename da/d24/d28/d1c/d32/d5e/dc3 to da/d24/dff 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:8/762: mkdir d5/dc/d26/d43/d49/d7a/df8 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:9/792: mknod d12/d1b/d40/d52/c10b 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:6/905: truncate d9/d3d/d4f/d59/fc9 781601 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:7/758: readlink da/d19/l21 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:4/770: rename d9/d4c/d76/dc9/df0/de2/lef to d9/d4c/d9c/l100 0 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:7/759: dread - da/d8f/fd6 zero size 2024-09-12T22:11:29.947 INFO:tasks.workunit.client.0.smithi019.stdout:1/788: symlink d1/d2/d18/d35/d84/d6e/l103 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:9/793: mknod d12/dd7/dc7/d92/d9d/da5/c10c 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:4/771: symlink d9/db/l101 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:7/760: creat da/d24/d28/d1c/d32/daf/f100 x:0 0 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:8/763: creat d5/dc/ff9 x:0 0 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:1/789: symlink d1/d2/d18/d29/d27/l104 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:7/761: chown da/d24/d28/c1b 2387457 1 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:4/772: creat d9/d14/f102 x:0 0 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:8/764: creat d5/dc/ffa x:0 0 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:1/790: mkdir d1/d2/d18/d35/d84/d98/d105 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:9/794: link d12/d1b/d40/d85/de8/def/ffe d12/d1b/d20/d59/f10d 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:7/762: fsync da/d19/d25/d39/f6b 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:4/773: fdatasync f7 0 2024-09-12T22:11:29.948 INFO:tasks.workunit.client.0.smithi019.stdout:8/765: chown d5/c1d 1 1 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:2/706: dread d0/d31/d4/f16 [0,4194304] 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:9/795: mkdir d12/d1b/d40/d10e 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/791: creat d1/ddb/f106 x:0 0 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:7/763: unlink da/d19/d25/d39/d51/fbf 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:4/774: creat d9/d14/d33/d4e/f103 x:0 0 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:9/796: write d12/dd7/dc7/f2d [3812052,58440] 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:7/764: mkdir da/d24/d101 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:2/707: readlink d0/d3/d11/d77/d78/d2c/d56/d60/lcf 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:6/906: truncate d9/dc/d20/d30/d5b/f6d 106086 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/792: write d1/d2/d18/d35/d84/dc/df/d61/f44 [5797274,15045] 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:7/765: readlink da/d19/d79/ld5 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:8/766: getdents d5/dc/d26/dc8 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:9/797: mkdir d12/d1b/d40/d85/d10f 0 2024-09-12T22:11:29.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/793: chown d1/d2/d18/d35/cf1 143 1 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:2/708: creat d0/d3/d11/d77/d78/d2c/d2d/de4/fe8 x:0 0 0 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:9/798: write ff [1028546,82902] 0 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:0/761: dread d5/d7/d10/d26/d2a/f37 [0,4194304] 0 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:8/767: write d5/d16/d19/f50 [87207,61387] 0 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:1/794: dread - d1/d2/d18/d35/d84/df8/d66/f101 zero size 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:2/709: mkdir d0/d3/df/d7b/d44/de9 0 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:6/907: dread d9/dc/d20/d30/f34 [0,4194304] 0 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:9/799: symlink d12/d1b/d40/d52/l110 0 2024-09-12T22:11:29.950 INFO:tasks.workunit.client.0.smithi019.stdout:0/762: symlink d5/d7/d10/d26/l102 0 2024-09-12T22:11:29.951 INFO:tasks.workunit.client.0.smithi019.stdout:3/784: dread d18/d26/d30/f3c [0,4194304] 0 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:2/710: symlink d0/d3/df/d7b/d44/de9/lea 0 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:1/795: write d1/d2/d18/d35/f3a [5595578,96516] 0 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:3/785: write d18/d58/f7b [3200812,76608] 0 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:5/807: sync 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:0/763: sync 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:4/775: dread d9/d14/d33/f6e [0,4194304] 0 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:9/800: truncate d12/dd7/dc7/d74/d77/fa8 551364 0 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:4/776: readlink d9/db/l101 0 2024-09-12T22:11:29.952 INFO:tasks.workunit.client.0.smithi019.stdout:9/801: creat d12/d1b/d20/d25/f111 x:0 0 0 2024-09-12T22:11:29.953 INFO:tasks.workunit.client.0.smithi019.stdout:8/768: dread d5/dc/f2e [0,4194304] 0 2024-09-12T22:11:29.955 INFO:tasks.workunit.client.0.smithi019.stdout:6/908: dwrite d9/dc/f4d [0,4194304] 0 2024-09-12T22:11:29.955 INFO:tasks.workunit.client.0.smithi019.stdout:5/808: write d0/d1d/d3d/f69 [4602506,111999] 0 2024-09-12T22:11:29.956 INFO:tasks.workunit.client.0.smithi019.stdout:4/777: fsync d9/d14/d57/d95/d96/faa 0 2024-09-12T22:11:29.957 INFO:tasks.workunit.client.0.smithi019.stdout:0/764: getdents d5/d7/de/d8d 0 2024-09-12T22:11:29.958 INFO:tasks.workunit.client.0.smithi019.stdout:8/769: dread - d5/d53/d66/f99 zero size 2024-09-12T22:11:29.958 INFO:tasks.workunit.client.0.smithi019.stdout:2/711: dwrite d0/fcd [0,4194304] 0 2024-09-12T22:11:29.958 INFO:tasks.workunit.client.0.smithi019.stdout:1/796: dwrite d1/d2/d18/d35/d84/dc/df/d61/f44 [0,4194304] 0 2024-09-12T22:11:29.959 INFO:tasks.workunit.client.0.smithi019.stdout:6/909: creat d9/d3d/d4f/d59/d79/f132 x:0 0 0 2024-09-12T22:11:29.959 INFO:tasks.workunit.client.0.smithi019.stdout:3/786: dwrite d18/d58/f7b [0,4194304] 0 2024-09-12T22:11:29.960 INFO:tasks.workunit.client.0.smithi019.stdout:8/770: chown d5/dc/d26/d43/d7d/cd0 11316 1 2024-09-12T22:11:29.960 INFO:tasks.workunit.client.0.smithi019.stdout:1/797: fdatasync d1/d2/d18/d70/fb6 0 2024-09-12T22:11:29.960 INFO:tasks.workunit.client.0.smithi019.stdout:7/766: dread da/d19/d25/d39/f71 [0,4194304] 0 2024-09-12T22:11:29.961 INFO:tasks.workunit.client.0.smithi019.stdout:8/771: dread - d5/dc/d8d/d96/fe7 zero size 2024-09-12T22:11:29.961 INFO:tasks.workunit.client.0.smithi019.stdout:7/767: chown da/d24/d28/lea 1358156435 1 2024-09-12T22:11:29.961 INFO:tasks.workunit.client.0.smithi019.stdout:7/768: fdatasync da/d24/d28/f98 0 2024-09-12T22:11:29.962 INFO:tasks.workunit.client.0.smithi019.stdout:9/802: rename d12/f1a to d12/dd7/dc7/d74/d77/d86/ddf/df2/f112 0 2024-09-12T22:11:29.962 INFO:tasks.workunit.client.0.smithi019.stdout:0/765: creat d5/d7/d2c/dc1/f103 x:0 0 0 2024-09-12T22:11:29.962 INFO:tasks.workunit.client.0.smithi019.stdout:1/798: creat d1/d2/d18/d35/d84/dc/df/f107 x:0 0 0 2024-09-12T22:11:29.963 INFO:tasks.workunit.client.0.smithi019.stdout:3/787: mkdir d18/d1d/d8b/db5/df5 0 2024-09-12T22:11:29.963 INFO:tasks.workunit.client.0.smithi019.stdout:7/769: mknod da/d8f/c102 0 2024-09-12T22:11:29.963 INFO:tasks.workunit.client.0.smithi019.stdout:0/766: chown d5/d7/dac/db6/f101 180211 1 2024-09-12T22:11:29.963 INFO:tasks.workunit.client.0.smithi019.stdout:9/803: write d12/d1b/d20/d59/d5b/fde [755308,20902] 0 2024-09-12T22:11:29.964 INFO:tasks.workunit.client.0.smithi019.stdout:3/788: chown d18/d26/d30/d4a/cf0 24412 1 2024-09-12T22:11:29.964 INFO:tasks.workunit.client.0.smithi019.stdout:1/799: creat d1/d2/f108 x:0 0 0 2024-09-12T22:11:29.965 INFO:tasks.workunit.client.0.smithi019.stdout:6/910: sync 2024-09-12T22:11:29.965 INFO:tasks.workunit.client.0.smithi019.stdout:0/767: fsync d5/d7/de/d9a/fa5 0 2024-09-12T22:11:29.965 INFO:tasks.workunit.client.0.smithi019.stdout:8/772: sync 2024-09-12T22:11:29.966 INFO:tasks.workunit.client.0.smithi019.stdout:7/770: write da/d19/d25/d39/ff2 [631836,36032] 0 2024-09-12T22:11:29.966 INFO:tasks.workunit.client.0.smithi019.stdout:8/773: chown d5/d16/f63 10602 1 2024-09-12T22:11:29.966 INFO:tasks.workunit.client.0.smithi019.stdout:6/911: chown d9/dc/c98 3151171 1 2024-09-12T22:11:29.967 INFO:tasks.workunit.client.0.smithi019.stdout:1/800: creat d1/d2/d18/d35/d84/df8/d55/f109 x:0 0 0 2024-09-12T22:11:29.968 INFO:tasks.workunit.client.0.smithi019.stdout:5/809: dread d0/d26/d6f/f9d [0,4194304] 0 2024-09-12T22:11:29.969 INFO:tasks.workunit.client.0.smithi019.stdout:8/774: creat d5/d16/ffb x:0 0 0 2024-09-12T22:11:29.969 INFO:tasks.workunit.client.0.smithi019.stdout:0/768: getdents d5/d7/d10/d26/d8a 0 2024-09-12T22:11:29.970 INFO:tasks.workunit.client.0.smithi019.stdout:6/912: symlink d9/dc/d20/d4b/d6c/dfe/l133 0 2024-09-12T22:11:29.970 INFO:tasks.workunit.client.0.smithi019.stdout:5/810: chown d0/d1d/d3d/f48 391464 1 2024-09-12T22:11:29.971 INFO:tasks.workunit.client.0.smithi019.stdout:4/778: truncate d9/db/d2b/f37 725453 0 2024-09-12T22:11:29.971 INFO:tasks.workunit.client.0.smithi019.stdout:9/804: dwrite d12/dd7/dc7/d56/df5/f109 [0,4194304] 0 2024-09-12T22:11:29.972 INFO:tasks.workunit.client.0.smithi019.stdout:3/789: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:29.972 INFO:tasks.workunit.client.0.smithi019.stdout:4/779: stat d9/l4d 0 2024-09-12T22:11:29.973 INFO:tasks.workunit.client.0.smithi019.stdout:7/771: rename da/d19/d25/d39/d51/dd7/db1/fdc to da/d24/d28/d1c/d32/dc2/f103 0 2024-09-12T22:11:29.975 INFO:tasks.workunit.client.0.smithi019.stdout:7/772: chown da/d24/fbb 7830 1 2024-09-12T22:11:29.976 INFO:tasks.workunit.client.0.smithi019.stdout:0/769: creat d5/d7/d10/d26/d8a/f104 x:0 0 0 2024-09-12T22:11:29.976 INFO:tasks.workunit.client.0.smithi019.stdout:8/775: creat d5/dc/d26/d4b/df5/ffc x:0 0 0 2024-09-12T22:11:29.976 INFO:tasks.workunit.client.0.smithi019.stdout:1/801: rename d1/d2/d18/d35/d84/df8/dc0 to d1/d2/d18/d35/d84/dc/df/d61/d10a 0 2024-09-12T22:11:29.976 INFO:tasks.workunit.client.0.smithi019.stdout:3/790: mkdir d18/d26/dce/df6 0 2024-09-12T22:11:29.977 INFO:tasks.workunit.client.0.smithi019.stdout:0/770: mknod d5/d7/d2c/ddc/de7/c105 0 2024-09-12T22:11:29.977 INFO:tasks.workunit.client.0.smithi019.stdout:6/913: getdents d9/d3d/d4f/d59/d79/dfc/d124 0 2024-09-12T22:11:29.977 INFO:tasks.workunit.client.0.smithi019.stdout:2/712: dwrite d0/d3/d11/d77/d78/f7c [0,4194304] 0 2024-09-12T22:11:29.977 INFO:tasks.workunit.client.0.smithi019.stdout:9/805: creat d12/dd7/dc7/f113 x:0 0 0 2024-09-12T22:11:29.978 INFO:tasks.workunit.client.0.smithi019.stdout:5/811: link d0/d26/d42/ccb d0/d26/d6f/d107/d10a/c10f 0 2024-09-12T22:11:29.978 INFO:tasks.workunit.client.0.smithi019.stdout:4/780: write d9/d4c/d9c/f9e [1798679,111602] 0 2024-09-12T22:11:29.978 INFO:tasks.workunit.client.0.smithi019.stdout:7/773: mknod da/d24/d28/d1c/d32/df0/dfc/c104 0 2024-09-12T22:11:29.979 INFO:tasks.workunit.client.0.smithi019.stdout:3/791: creat d18/d26/dce/df6/ff7 x:0 0 0 2024-09-12T22:11:29.979 INFO:tasks.workunit.client.0.smithi019.stdout:0/771: truncate d5/de2/fdb 840574 0 2024-09-12T22:11:29.980 INFO:tasks.workunit.client.0.smithi019.stdout:3/792: chown d18/d1d/d35/f49 27562 1 2024-09-12T22:11:29.980 INFO:tasks.workunit.client.0.smithi019.stdout:8/776: unlink d5/d53/d66/d69/lb4 0 2024-09-12T22:11:29.980 INFO:tasks.workunit.client.0.smithi019.stdout:1/802: fdatasync d1/d2/fb5 0 2024-09-12T22:11:29.981 INFO:tasks.workunit.client.0.smithi019.stdout:6/914: creat d9/dc/df7/d78/d10d/f134 x:0 0 0 2024-09-12T22:11:29.981 INFO:tasks.workunit.client.0.smithi019.stdout:3/793: mknod d18/d1d/d8b/cf8 0 2024-09-12T22:11:29.981 INFO:tasks.workunit.client.0.smithi019.stdout:5/812: rename d0/d26/d6f/f74 to d0/d1d/d4f/d47/d57/d98/dd6/f110 0 2024-09-12T22:11:29.981 INFO:tasks.workunit.client.0.smithi019.stdout:4/781: getdents d9/db/dcd/dc1 0 2024-09-12T22:11:29.982 INFO:tasks.workunit.client.0.smithi019.stdout:6/915: stat d9/d3d/d4f/d59/d79/de4 0 2024-09-12T22:11:29.982 INFO:tasks.workunit.client.0.smithi019.stdout:8/777: unlink d5/dc/d26/d4b/f79 0 2024-09-12T22:11:29.983 INFO:tasks.workunit.client.0.smithi019.stdout:0/772: rename d5/d7/d10/d26/l102 to d5/d7/d10/l106 0 2024-09-12T22:11:29.983 INFO:tasks.workunit.client.0.smithi019.stdout:5/813: mkdir d0/d1d/d4f/d47/d57/d98/dd6/d111 0 2024-09-12T22:11:29.983 INFO:tasks.workunit.client.0.smithi019.stdout:4/782: write d9/d14/d33/d4e/f103 [370819,88309] 0 2024-09-12T22:11:29.983 INFO:tasks.workunit.client.0.smithi019.stdout:3/794: truncate f16 6898134 0 2024-09-12T22:11:29.983 INFO:tasks.workunit.client.0.smithi019.stdout:8/778: chown d5/dc/d8d/fd7 472 1 2024-09-12T22:11:29.984 INFO:tasks.workunit.client.0.smithi019.stdout:2/713: write d0/d3/d11/d2e/d64/fb1 [2222332,39336] 0 2024-09-12T22:11:29.984 INFO:tasks.workunit.client.0.smithi019.stdout:0/773: write d5/d7/de/f7f [1204916,102568] 0 2024-09-12T22:11:29.985 INFO:tasks.workunit.client.0.smithi019.stdout:1/803: mkdir d1/d2/d18/d35/d84/df8/d55/d10b 0 2024-09-12T22:11:29.986 INFO:tasks.workunit.client.0.smithi019.stdout:0/774: chown c3 954276 1 2024-09-12T22:11:29.986 INFO:tasks.workunit.client.0.smithi019.stdout:5/814: creat d0/d1d/d4f/d47/d57/d98/f112 x:0 0 0 2024-09-12T22:11:29.986 INFO:tasks.workunit.client.0.smithi019.stdout:3/795: rename d18/d1d/d35/cd4 to d18/d1d/d8b/cf9 0 2024-09-12T22:11:29.989 INFO:tasks.workunit.client.0.smithi019.stdout:3/796: dread - d18/d26/d30/d4e/fc7 zero size 2024-09-12T22:11:29.989 INFO:tasks.workunit.client.0.smithi019.stdout:0/775: readlink d5/d7/d2c/d44/d6a/d46/l89 0 2024-09-12T22:11:29.990 INFO:tasks.workunit.client.0.smithi019.stdout:3/797: sync 2024-09-12T22:11:29.990 INFO:tasks.workunit.client.0.smithi019.stdout:5/815: read - d0/d1d/d4f/d47/d57/dba/ff2 zero size 2024-09-12T22:11:29.991 INFO:tasks.workunit.client.0.smithi019.stdout:7/774: dwrite da/d19/d25/d39/fa0 [0,4194304] 0 2024-09-12T22:11:29.992 INFO:tasks.workunit.client.0.smithi019.stdout:6/916: dwrite d9/dc/d20/d4b/f2d [4194304,4194304] 0 2024-09-12T22:11:29.993 INFO:tasks.workunit.client.0.smithi019.stdout:8/779: dwrite d5/d53/d66/fc1 [0,4194304] 0 2024-09-12T22:11:29.993 INFO:tasks.workunit.client.0.smithi019.stdout:7/775: stat da/d19/d25/lc4 0 2024-09-12T22:11:29.994 INFO:tasks.workunit.client.0.smithi019.stdout:6/917: write d9/d3d/d4f/d59/fda [30050,97958] 0 2024-09-12T22:11:29.994 INFO:tasks.workunit.client.0.smithi019.stdout:8/780: chown d5/dc/d17/l1b 5127163 1 2024-09-12T22:11:29.995 INFO:tasks.workunit.client.0.smithi019.stdout:0/776: unlink d5/d7/d2c/d44/d6a/d46/l89 0 2024-09-12T22:11:29.995 INFO:tasks.workunit.client.0.smithi019.stdout:5/816: rename d0/d24/d58/fd1 to d0/d24/d7a/f113 0 2024-09-12T22:11:29.995 INFO:tasks.workunit.client.0.smithi019.stdout:8/781: unlink d5/dc/d17/dce/ff7 0 2024-09-12T22:11:29.997 INFO:tasks.workunit.client.0.smithi019.stdout:0/777: creat d5/d7/dac/f107 x:0 0 0 2024-09-12T22:11:29.998 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:29.996+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:29.999 INFO:tasks.workunit.client.0.smithi019.stdout:7/776: rename da/d30/da5/lce to da/d24/d28/d1c/d32/dc2/dca/l105 0 2024-09-12T22:11:30.000 INFO:tasks.workunit.client.0.smithi019.stdout:1/804: truncate d1/d2/d18/d35/d84/df8/d55/d56/f79 1593019 0 2024-09-12T22:11:30.000 INFO:tasks.workunit.client.0.smithi019.stdout:3/798: truncate d18/d1d/d8b/fa0 4169224 0 2024-09-12T22:11:30.000 INFO:tasks.workunit.client.0.smithi019.stdout:0/778: link d5/de2/fdb d5/d7/d2c/f108 0 2024-09-12T22:11:30.001 INFO:tasks.workunit.client.0.smithi019.stdout:8/782: creat d5/d16/ffd x:0 0 0 2024-09-12T22:11:30.001 INFO:tasks.workunit.client.0.smithi019.stdout:1/805: fsync d1/ddb/ff0 0 2024-09-12T22:11:30.001 INFO:tasks.workunit.client.0.smithi019.stdout:3/799: chown d18/d26/dce/fe3 873655 1 2024-09-12T22:11:30.002 INFO:tasks.workunit.client.0.smithi019.stdout:8/783: read d5/dc/d8d/fb0 [18343,6817] 0 2024-09-12T22:11:30.002 INFO:tasks.workunit.client.0.smithi019.stdout:1/806: rename d1/d2/d18/d35/d84/df8/d55/d56 to d1/d2/d18/d35/d84/df8/d55/d56/d10c 22 2024-09-12T22:11:30.003 INFO:tasks.workunit.client.0.smithi019.stdout:6/918: truncate d9/dc/d20/d30/f42 783912 0 2024-09-12T22:11:30.003 INFO:tasks.workunit.client.0.smithi019.stdout:3/800: getdents d18/d1d 0 2024-09-12T22:11:30.004 INFO:tasks.workunit.client.0.smithi019.stdout:0/779: write d5/d7/d2c/d81/f9c [2636263,21193] 0 2024-09-12T22:11:30.004 INFO:tasks.workunit.client.0.smithi019.stdout:8/784: creat d5/dc/d26/d43/d7d/ffe x:0 0 0 2024-09-12T22:11:30.004 INFO:tasks.workunit.client.0.smithi019.stdout:1/807: creat d1/d2/d18/f10d x:0 0 0 2024-09-12T22:11:30.004 INFO:tasks.workunit.client.0.smithi019.stdout:6/919: mknod d9/d3d/c135 0 2024-09-12T22:11:30.005 INFO:tasks.workunit.client.0.smithi019.stdout:8/785: rmdir d5/dc/d26/d43/d49/d92 39 2024-09-12T22:11:30.006 INFO:tasks.workunit.client.0.smithi019.stdout:1/808: chown d1/d2/d18/d29/d27/ce4 3357057 1 2024-09-12T22:11:30.006 INFO:tasks.workunit.client.0.smithi019.stdout:8/786: fdatasync d5/d16/d19/f31 0 2024-09-12T22:11:30.011 INFO:tasks.workunit.client.0.smithi019.stdout:4/783: dread d9/d14/d57/f7c [0,4194304] 0 2024-09-12T22:11:30.012 INFO:tasks.workunit.client.0.smithi019.stdout:8/787: dwrite d5/d16/f28 [0,4194304] 0 2024-09-12T22:11:30.013 INFO:tasks.workunit.client.0.smithi019.stdout:1/809: dread d1/d2/fe2 [0,4194304] 0 2024-09-12T22:11:30.015 INFO:tasks.workunit.client.0.smithi019.stdout:4/784: mknod d9/d6c/c104 0 2024-09-12T22:11:30.015 INFO:tasks.workunit.client.0.smithi019.stdout:2/714: dread d0/f42 [0,4194304] 0 2024-09-12T22:11:30.016 INFO:tasks.workunit.client.0.smithi019.stdout:3/801: dwrite d18/d26/d30/d71/d86/f90 [0,4194304] 0 2024-09-12T22:11:30.016 INFO:tasks.workunit.client.0.smithi019.stdout:9/806: dread d12/d1b/d20/d25/f49 [0,4194304] 0 2024-09-12T22:11:30.018 INFO:tasks.workunit.client.0.smithi019.stdout:9/807: mkdir d12/dd7/dc7/d88/d114 0 2024-09-12T22:11:30.018 INFO:tasks.workunit.client.0.smithi019.stdout:3/802: truncate d18/d1d/d8b/fa3 554784 0 2024-09-12T22:11:30.019 INFO:tasks.workunit.client.0.smithi019.stdout:8/788: link d5/l21 d5/lff 0 2024-09-12T22:11:30.021 INFO:tasks.workunit.client.0.smithi019.stdout:8/789: symlink d5/d53/l100 0 2024-09-12T22:11:30.021 INFO:tasks.workunit.client.0.smithi019.stdout:2/715: getdents d0/d3/df/d7b/d44/de9 0 2024-09-12T22:11:30.021 INFO:tasks.workunit.client.0.smithi019.stdout:0/780: dread d5/d7/f12 [0,4194304] 0 2024-09-12T22:11:30.021 INFO:tasks.workunit.client.0.smithi019.stdout:3/803: chown d18/d26/d30/d71/lf4 556 1 2024-09-12T22:11:30.022 INFO:tasks.workunit.client.0.smithi019.stdout:1/810: truncate d1/d2/d18/d35/d84/dc/fc9 3300168 0 2024-09-12T22:11:30.022 INFO:tasks.workunit.client.0.smithi019.stdout:2/716: fdatasync d0/d3/df/d52/fd2 0 2024-09-12T22:11:30.022 INFO:tasks.workunit.client.0.smithi019.stdout:0/781: chown d5/d7/d10/d26/d8a/daf/df9 21410272 1 2024-09-12T22:11:30.023 INFO:tasks.workunit.client.0.smithi019.stdout:8/790: write d5/dc/d26/dc8/ff6 [1702805,106552] 0 2024-09-12T22:11:30.023 INFO:tasks.workunit.client.0.smithi019.stdout:3/804: rmdir d18/d26/dde 0 2024-09-12T22:11:30.024 INFO:tasks.workunit.client.0.smithi019.stdout:1/811: mkdir d1/d37/d10e 0 2024-09-12T22:11:30.024 INFO:tasks.workunit.client.0.smithi019.stdout:0/782: stat d5/d7/d2c/dc1/f103 0 2024-09-12T22:11:30.025 INFO:tasks.workunit.client.0.smithi019.stdout:8/791: mkdir d5/dc/d26/d4b/d101 0 2024-09-12T22:11:30.025 INFO:tasks.workunit.client.0.smithi019.stdout:4/785: dwrite d9/d4c/d76/dc9/df0/d8f/d93/fe1 [0,4194304] 0 2024-09-12T22:11:30.026 INFO:tasks.workunit.client.0.smithi019.stdout:4/786: creat d9/d87/f105 x:0 0 0 2024-09-12T22:11:30.028 INFO:tasks.workunit.client.0.smithi019.stdout:8/792: symlink d5/dc/d26/d43/d49/d92/l102 0 2024-09-12T22:11:30.028 INFO:tasks.workunit.client.0.smithi019.stdout:0/783: getdents d5/d7/d2c/d44/db7 0 2024-09-12T22:11:30.029 INFO:tasks.workunit.client.0.smithi019.stdout:3/805: write f13 [791646,125103] 0 2024-09-12T22:11:30.029 INFO:tasks.workunit.client.0.smithi019.stdout:2/717: link d0/d3/d11/d77/d78/d2c/d30/d32/f81 d0/d3/d11/d77/d78/d2c/d56/d60/feb 0 2024-09-12T22:11:30.029 INFO:tasks.workunit.client.0.smithi019.stdout:8/793: chown d5/dc/d26/d43/d7d 1632 1 2024-09-12T22:11:30.030 INFO:tasks.workunit.client.0.smithi019.stdout:6/920: dread d9/dc/df7/d7d/da7/fb0 [0,4194304] 0 2024-09-12T22:11:30.030 INFO:tasks.workunit.client.0.smithi019.stdout:3/806: mknod d18/d1d/d8b/cfa 0 2024-09-12T22:11:30.030 INFO:tasks.workunit.client.0.smithi019.stdout:4/787: write d9/d14/d57/d95/d96/faa [3435206,82799] 0 2024-09-12T22:11:30.031 INFO:tasks.workunit.client.0.smithi019.stdout:6/921: chown d9/d6b 23162 1 2024-09-12T22:11:30.031 INFO:tasks.workunit.client.0.smithi019.stdout:2/718: mkdir d0/d3/d11/d77/d78/d2c/d56/dec 0 2024-09-12T22:11:30.031 INFO:tasks.workunit.client.0.smithi019.stdout:8/794: mknod d5/dc/d26/d43/d49/c103 0 2024-09-12T22:11:30.032 INFO:tasks.workunit.client.0.smithi019.stdout:0/784: rename d5/d7/d10/d26/d2a/f5d to d5/d7/d2c/d81/dcb/deb/f109 0 2024-09-12T22:11:30.032 INFO:tasks.workunit.client.0.smithi019.stdout:4/788: creat d9/db/d2b/dc7/dd3/f106 x:0 0 0 2024-09-12T22:11:30.033 INFO:tasks.workunit.client.0.smithi019.stdout:1/812: dread d1/d2/d18/d59/f9f [0,4194304] 0 2024-09-12T22:11:30.033 INFO:tasks.workunit.client.0.smithi019.stdout:2/719: write d0/d3/df/d6b/fab [1040386,122237] 0 2024-09-12T22:11:30.033 INFO:tasks.workunit.client.0.smithi019.stdout:8/795: symlink d5/dc/d26/d43/l104 0 2024-09-12T22:11:30.033 INFO:tasks.workunit.client.0.smithi019.stdout:4/789: write d9/d4c/d9c/f9e [1803437,107903] 0 2024-09-12T22:11:30.034 INFO:tasks.workunit.client.0.smithi019.stdout:0/785: truncate d5/de2/fdb 1734328 0 2024-09-12T22:11:30.034 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14485 4.6 4:60751006:::10000003203.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.025971+0000", 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0081154320000000005, 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.008140184, 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.035 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14485 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.025971+0000", 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.025971+0000", 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.025972+0000", 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5300000000000003e-07 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.031228+0000", 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052565219999999996 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.031240+0000", 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2024e-05 2024-09-12T22:11:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.031245+0000", 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2190000000000003e-06 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.031298+0000", 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.287e-05 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.031383+0000", 2024-09-12T22:11:30.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4215000000000006e-05 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.031507+0000", 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000124296 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14494 4.5 4:a021e312:::10000003697.00000000:head [write 1040386~122237 in=122237b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.033120+0000", 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.00096668700000000004, 2024-09-12T22:11:30.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001074321, 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14494 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033120+0000", 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033120+0000", 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033121+0000", 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.119e-06 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033211+0000", 2024-09-12T22:11:30.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0530000000000002e-05 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033219+0000", 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.038e-06 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033226+0000", 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4579999999999998e-06 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033302+0000", 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6213999999999999e-05 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033496+0000", 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000193742 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14495 4.2c 4:37bc0ea1:::100000035cb.00000000:head [write 1803437~107903 in=107903b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.033912+0000", 2024-09-12T22:11:30.043 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.00017429000000000001, 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034776099999999998, 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14495 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033912+0000", 2024-09-12T22:11:30.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033912+0000", 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033912+0000", 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.37e-07 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033957+0000", 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4468000000000002e-05 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033964+0000", 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0820000000000001e-06 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.033968+0000", 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4349999999999999e-06 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.034011+0000", 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2518999999999997e-05 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.034096+0000", 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4961000000000002e-05 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.034236+0000", 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014016000000000001 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.047 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.048 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:11:30.048 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 3 2024-09-12T22:11:30.048 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:30.050 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:1/813: fsync d1/d2/d18/d35/d84/dc/df/d2c/f42 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:4/790: write d9/d58/ff4 [247341,67160] 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:9/808: dread d12/d1b/d20/f36 [4194304,4194304] 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:7/777: dread da/d19/f88 [0,4194304] 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:2/720: rename d0/d3/df/d7b/cbf to d0/d3/df/d7b/ced 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:1/814: read d1/d2/fe2 [201171,82265] 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:0/786: write d5/d7/f30 [4821552,29566] 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:5/817: dread d0/d1d/d3d/f55 [0,4194304] 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:9/809: write d12/d1b/d20/d64/d83/fec [305146,87004] 0 2024-09-12T22:11:30.053 INFO:tasks.workunit.client.0.smithi019.stdout:2/721: write d0/d3/df/d52/fd0 [1209538,115006] 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:3/807: dwrite f16 [4194304,4194304] 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:0/787: creat d5/d7/d10/d26/f10a x:0 0 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:4/791: truncate d9/db/d2b/f30 2148459 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:7/778: creat da/d24/d28/d1c/d32/daf/dfa/f106 x:0 0 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:6/922: dread d9/d3d/d6f/f5c [0,4194304] 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:8/796: dwrite d5/dc/d17/fd5 [0,4194304] 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:5/818: chown d0/d1d/d3d/f69 484770 1 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:4/792: fdatasync d9/d4c/fdf 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:9/810: chown d12/d1b/d20/d25/fb9 421077008 1 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:0/788: creat d5/d7/de/f10b x:0 0 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:3/808: symlink d18/d1d/d8b/dc5/lfb 0 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:4/793: read - d9/d4c/fdf zero size 2024-09-12T22:11:30.054 INFO:tasks.workunit.client.0.smithi019.stdout:9/811: unlink d12/d1b/f8a 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:8/797: chown d5/dc/d8a/cbb 288631 1 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:7/779: mknod da/d19/d25/d39/d51/dd7/c107 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:6/923: chown d9/dc/d20/d30/f37 209 1 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:3/809: fsync d18/d1d/d35/f49 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:2/722: symlink d0/d3/d11/d77/d82/d94/dba/lee 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:0/789: mkdir d5/d7/d2c/d44/d6a/d46/db2/d10c 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:4/794: mkdir d9/db/d2b/dc7/d107 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:6/924: mknod d9/d6b/d131/c136 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:3/810: mkdir d18/d26/dce/df6/dfc 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:1/815: dwrite d1/d2/d18/d35/d84/dc/df/d2c/fd2 [0,4194304] 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:5/819: getdents d0/d24/d58 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:0/790: write d5/d7/dac/db6/ffb [453311,12986] 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:2/723: creat d0/d31/d4/fef x:0 0 0 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:6/925: chown d9/d3d/d4f/d59/d79/f108 1496402 1 2024-09-12T22:11:30.055 INFO:tasks.workunit.client.0.smithi019.stdout:3/811: read d18/d58/f8e [573913,51444] 0 2024-09-12T22:11:30.056 INFO:tasks.workunit.client.0.smithi019.stdout:8/798: rename d5/dc/d8a/d98/fe6 to d5/dc/d8d/d96/f105 0 2024-09-12T22:11:30.056 INFO:tasks.workunit.client.0.smithi019.stdout:5/820: mknod d0/d24/d97/c114 0 2024-09-12T22:11:30.056 INFO:tasks.workunit.client.0.smithi019.stdout:9/812: truncate d12/d1b/d40/d52/ff4 4586103 0 2024-09-12T22:11:30.056 INFO:tasks.workunit.client.0.smithi019.stdout:2/724: chown d0/d31/d12/d15/dae 1 1 2024-09-12T22:11:30.056 INFO:tasks.workunit.client.0.smithi019.stdout:3/812: write d18/d26/d30/d91/fc9 [532130,21479] 0 2024-09-12T22:11:30.057 INFO:tasks.workunit.client.0.smithi019.stdout:1/816: mknod d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/c10f 0 2024-09-12T22:11:30.057 INFO:tasks.workunit.client.0.smithi019.stdout:6/926: rename d9/dc/d20/d30/l33 to d9/d3d/d4f/d59/d79/l137 0 2024-09-12T22:11:30.057 INFO:tasks.workunit.client.0.smithi019.stdout:2/725: creat d0/d3/d11/d77/d82/d94/dba/ff0 x:0 0 0 2024-09-12T22:11:30.057 INFO:tasks.workunit.client.0.smithi019.stdout:5/821: creat d0/d1d/d4f/d47/d57/dba/ddb/f115 x:0 0 0 2024-09-12T22:11:30.057 INFO:tasks.workunit.client.0.smithi019.stdout:7/780: dread da/d24/f74 [0,4194304] 0 2024-09-12T22:11:30.058 INFO:tasks.workunit.client.0.smithi019.stdout:3/813: getdents d18/d1d/d8b/db5 0 2024-09-12T22:11:30.060 INFO:tasks.workunit.client.0.smithi019.stdout:1/817: dread d1/fa8 [0,4194304] 0 2024-09-12T22:11:30.060 INFO:tasks.workunit.client.0.smithi019.stdout:4/795: dwrite d9/d14/d57/d95/dbe/dc6/ffb [0,4194304] 0 2024-09-12T22:11:30.061 INFO:tasks.workunit.client.0.smithi019.stdout:3/814: fdatasync d18/d26/d30/d4e/f6c 0 2024-09-12T22:11:30.061 INFO:tasks.workunit.client.0.smithi019.stdout:8/799: dwrite d5/dc/d26/fcd [0,4194304] 0 2024-09-12T22:11:30.061 INFO:tasks.workunit.client.0.smithi019.stdout:0/791: dwrite d5/d7/f12 [0,4194304] 0 2024-09-12T22:11:30.062 INFO:tasks.workunit.client.0.smithi019.stdout:2/726: mkdir d0/d3/d11/d2e/df1 0 2024-09-12T22:11:30.062 INFO:tasks.workunit.client.0.smithi019.stdout:9/813: rename d12/d1b/d20/d25/ca3 to d12/d1b/d20/d59/c115 0 2024-09-12T22:11:30.062 INFO:tasks.workunit.client.0.smithi019.stdout:4/796: write d9/d87/f105 [137892,94580] 0 2024-09-12T22:11:30.063 INFO:tasks.workunit.client.0.smithi019.stdout:1/818: mkdir d1/d2/d18/d35/d84/dc/df/d61/d10a/d110 0 2024-09-12T22:11:30.065 INFO:tasks.workunit.client.0.smithi019.stdout:0/792: write d5/d7/d2c/f75 [3269965,129818] 0 2024-09-12T22:11:30.065 INFO:tasks.workunit.client.0.smithi019.stdout:3/815: write d18/d26/da5/fbf [1699126,65180] 0 2024-09-12T22:11:30.065 INFO:tasks.workunit.client.0.smithi019.stdout:4/797: write d9/d14/ff3 [943398,50400] 0 2024-09-12T22:11:30.065 INFO:tasks.workunit.client.0.smithi019.stdout:9/814: read d12/d1b/d20/d25/f78 [429038,22711] 0 2024-09-12T22:11:30.066 INFO:tasks.workunit.client.0.smithi019.stdout:6/927: rename d9/d3d/d4f/d59/d79/dfc/d124 to d9/dc/dd9/d138 0 2024-09-12T22:11:30.067 INFO:tasks.workunit.client.0.smithi019.stdout:5/822: dwrite d0/d26/d5f/dc3/fd2 [0,4194304] 0 2024-09-12T22:11:30.067 INFO:tasks.workunit.client.0.smithi019.stdout:2/727: creat d0/d31/d12/d3b/ff2 x:0 0 0 2024-09-12T22:11:30.068 INFO:tasks.workunit.client.0.smithi019.stdout:3/816: mkdir d18/d1d/d8b/dc5/dbb/df1/dfd 0 2024-09-12T22:11:30.068 INFO:tasks.workunit.client.0.smithi019.stdout:1/819: rename d1/d2/d18/d59/cf6 to d1/d2/d18/c111 0 2024-09-12T22:11:30.070 INFO:tasks.workunit.client.0.smithi019.stdout:6/928: stat d9/d3d/d4f/d59/ldd 0 2024-09-12T22:11:30.070 INFO:tasks.workunit.client.0.smithi019.stdout:3/817: chown d18/d1d/f3b 35575135 1 2024-09-12T22:11:30.072 INFO:tasks.workunit.client.0.smithi019.stdout:3/818: creat d18/d1d/dad/ffe x:0 0 0 2024-09-12T22:11:30.072 INFO:tasks.workunit.client.0.smithi019.stdout:2/728: rename d0/d3/d11/d77/d82/d94 to d0/d3/d11/d77/d82/df3 0 2024-09-12T22:11:30.074 INFO:tasks.workunit.client.0.smithi019.stdout:6/929: symlink d9/d3d/d4f/d8d/l139 0 2024-09-12T22:11:30.074 INFO:tasks.workunit.client.0.smithi019.stdout:4/798: dwrite d9/d6c/f7e [0,4194304] 0 2024-09-12T22:11:30.074 INFO:tasks.workunit.client.0.smithi019.stdout:1/820: write d1/d2/d18/d35/d84/df8/d55/f6b [766196,33804] 0 2024-09-12T22:11:30.074 INFO:tasks.workunit.client.0.smithi019.stdout:9/815: dwrite d12/f15 [0,4194304] 0 2024-09-12T22:11:30.074 INFO:tasks.workunit.client.0.smithi019.stdout:3/819: write d18/d26/d30/d4e/f6c [2378394,126107] 0 2024-09-12T22:11:30.075 INFO:tasks.workunit.client.0.smithi019.stdout:1/821: chown d1/d2/d18/d35/d84/d98/d105 3260 1 2024-09-12T22:11:30.077 INFO:tasks.workunit.client.0.smithi019.stdout:1/822: unlink d1/d2/d18/d35/d84/df8/d66/f8c 0 2024-09-12T22:11:30.078 INFO:tasks.workunit.client.0.smithi019.stdout:2/729: dread d0/d3/d11/d77/d78/d2c/d2d/fe6 [0,4194304] 0 2024-09-12T22:11:30.080 INFO:tasks.workunit.client.0.smithi019.stdout:1/823: link d1/d2/d18/f1c d1/d2/d18/d29/f112 0 2024-09-12T22:11:30.081 INFO:tasks.workunit.client.0.smithi019.stdout:6/930: write d9/dc/d20/d30/f42 [1686478,79582] 0 2024-09-12T22:11:30.081 INFO:tasks.workunit.client.0.smithi019.stdout:2/730: rmdir d0/d3/df/d7b/d80/d9a/daa 39 2024-09-12T22:11:30.082 INFO:tasks.workunit.client.0.smithi019.stdout:3/820: dwrite d18/d26/d30/d4e/d9a/dae/fb7 [0,4194304] 0 2024-09-12T22:11:30.083 INFO:tasks.workunit.client.0.smithi019.stdout:9/816: dwrite d12/d1b/d20/d59/d5b/fdc [0,4194304] 0 2024-09-12T22:11:30.083 INFO:tasks.workunit.client.0.smithi019.stdout:6/931: read d9/dc/d20/d71/f88 [1770005,29917] 0 2024-09-12T22:11:30.085 INFO:tasks.workunit.client.0.smithi019.stdout:0/793: fsync d5/d7/f12 0 2024-09-12T22:11:30.085 INFO:tasks.workunit.client.0.smithi019.stdout:3/821: mkdir d18/d1d/d8b/dc5/dbb/dff 0 2024-09-12T22:11:30.085 INFO:tasks.workunit.client.0.smithi019.stdout:2/731: getdents d0/d3/d11/d2e/d64 0 2024-09-12T22:11:30.085 INFO:tasks.workunit.client.0.smithi019.stdout:5/823: dread d0/d1d/d4f/f64 [4194304,4194304] 0 2024-09-12T22:11:30.085 INFO:tasks.workunit.client.0.smithi019.stdout:6/932: mknod d9/d3d/d4f/c13a 0 2024-09-12T22:11:30.085 INFO:tasks.workunit.client.0.smithi019.stdout:0/794: creat d5/d88/dea/f10d x:0 0 0 2024-09-12T22:11:30.085 INFO:tasks.workunit.client.0.smithi019.stdout:2/732: mknod d0/d31/d4/cf4 0 2024-09-12T22:11:30.086 INFO:tasks.workunit.client.0.smithi019.stdout:5/824: creat d0/d24/f116 x:0 0 0 2024-09-12T22:11:30.086 INFO:tasks.workunit.client.0.smithi019.stdout:4/799: dread d9/d4c/fbf [0,4194304] 0 2024-09-12T22:11:30.086 INFO:tasks.workunit.client.0.smithi019.stdout:5/825: read - d0/d24/fd7 zero size 2024-09-12T22:11:30.087 INFO:tasks.workunit.client.0.smithi019.stdout:9/817: symlink d12/dd7/dc7/d74/de3/l116 0 2024-09-12T22:11:30.087 INFO:tasks.workunit.client.0.smithi019.stdout:2/733: mknod d0/d3/dc5/cf5 0 2024-09-12T22:11:30.087 INFO:tasks.workunit.client.0.smithi019.stdout:6/933: rename d9/d3d/f90 to d9/d3d/d4f/d59/d79/dfc/f13b 0 2024-09-12T22:11:30.087 INFO:tasks.workunit.client.0.smithi019.stdout:4/800: write d9/d4c/f88 [3013576,45321] 0 2024-09-12T22:11:30.089 INFO:tasks.workunit.client.0.smithi019.stdout:5/826: mkdir d0/d26/d5f/d117 0 2024-09-12T22:11:30.089 INFO:tasks.workunit.client.0.smithi019.stdout:0/795: truncate d5/d7/d10/d26/f9e 984122 0 2024-09-12T22:11:30.090 INFO:tasks.workunit.client.0.smithi019.stdout:2/734: mknod d0/d31/d12/d3b/cf6 0 2024-09-12T22:11:30.090 INFO:tasks.workunit.client.0.smithi019.stdout:9/818: truncate d12/d1b/f1c 3540068 0 2024-09-12T22:11:30.090 INFO:tasks.workunit.client.0.smithi019.stdout:6/934: rename d9/dc/dd9/d138 to d9/dc/df7/d13c 0 2024-09-12T22:11:30.090 INFO:tasks.workunit.client.0.smithi019.stdout:4/801: chown d9/d4c/d76/dc9/df0/d8f/d93/dad/cc3 23 1 2024-09-12T22:11:30.090 INFO:tasks.workunit.client.0.smithi019.stdout:9/819: read - d12/d1b/d20/d59/f10d zero size 2024-09-12T22:11:30.091 INFO:tasks.workunit.client.0.smithi019.stdout:5/827: rename d0/d1d/d4f/d47/d57/dba/ddb/lfc to d0/d1d/d6d/dca/l118 0 2024-09-12T22:11:30.091 INFO:tasks.workunit.client.0.smithi019.stdout:4/802: write d9/d17/f84 [860905,15491] 0 2024-09-12T22:11:30.091 INFO:tasks.workunit.client.0.smithi019.stdout:6/935: write d9/dc/d20/d71/f88 [4278063,107615] 0 2024-09-12T22:11:30.092 INFO:tasks.workunit.client.0.smithi019.stdout:5/828: truncate d0/f4 4593922 0 2024-09-12T22:11:30.092 INFO:tasks.workunit.client.0.smithi019.stdout:9/820: creat d12/d1b/d40/d52/d62/de7/f117 x:0 0 0 2024-09-12T22:11:30.092 INFO:tasks.workunit.client.0.smithi019.stdout:4/803: write d9/d17/f1d [951311,36827] 0 2024-09-12T22:11:30.092 INFO:tasks.workunit.client.0.smithi019.stdout:3/822: write d18/d1d/d8b/fa0 [1052867,69940] 0 2024-09-12T22:11:30.093 INFO:tasks.workunit.client.0.smithi019.stdout:4/804: stat d9/de5/lec 0 2024-09-12T22:11:30.093 INFO:tasks.workunit.client.0.smithi019.stdout:6/936: fsync d9/dc/d20/d30/f37 0 2024-09-12T22:11:30.094 INFO:tasks.workunit.client.0.smithi019.stdout:3/823: symlink d18/d26/da5/dbd/l100 0 2024-09-12T22:11:30.094 INFO:tasks.workunit.client.0.smithi019.stdout:2/735: rename d0/d3/d11/d2e/d64/dce/c9d to d0/d3/d11/d77/d78/d2c/d2d/de4/cf7 0 2024-09-12T22:11:30.095 INFO:tasks.workunit.client.0.smithi019.stdout:3/824: write d18/d26/d30/d71/fb4 [855375,3204] 0 2024-09-12T22:11:30.095 INFO:tasks.workunit.client.0.smithi019.stdout:6/937: unlink d9/d3d/d4f/d8d/fdb 0 2024-09-12T22:11:30.096 INFO:tasks.workunit.client.0.smithi019.stdout:0/796: read d5/d7/d10/d26/f9e [927789,122779] 0 2024-09-12T22:11:30.097 INFO:tasks.workunit.client.0.smithi019.stdout:2/736: getdents d0/d3/df/d7b/d80/d9a/daa 0 2024-09-12T22:11:30.097 INFO:tasks.workunit.client.0.smithi019.stdout:0/797: dread - d5/d7/d10/d26/d8a/fe9 zero size 2024-09-12T22:11:30.098 INFO:tasks.workunit.client.0.smithi019.stdout:8/800: dread d5/dc/d8a/fbc [0,4194304] 0 2024-09-12T22:11:30.098 INFO:tasks.workunit.client.0.smithi019.stdout:5/829: write d0/d4e/fbc [1719044,52530] 0 2024-09-12T22:11:30.099 INFO:tasks.workunit.client.0.smithi019.stdout:2/737: mknod d0/d3/df/d7b/d44/de9/cf8 0 2024-09-12T22:11:30.100 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:30.099+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:30.100 INFO:tasks.workunit.client.0.smithi019.stdout:8/801: write d5/f15 [2210632,92522] 0 2024-09-12T22:11:30.104 INFO:tasks.workunit.client.0.smithi019.stdout:5/830: dread - d0/d1d/d4f/d47/f99 zero size 2024-09-12T22:11:30.104 INFO:tasks.workunit.client.0.smithi019.stdout:8/802: readlink d5/l8c 0 2024-09-12T22:11:30.105 INFO:tasks.workunit.client.0.smithi019.stdout:4/805: dread d9/d4c/d9c/f9e [0,4194304] 0 2024-09-12T22:11:30.105 INFO:tasks.workunit.client.0.smithi019.stdout:6/938: dwrite d9/f4e [0,4194304] 0 2024-09-12T22:11:30.105 INFO:tasks.workunit.client.0.smithi019.stdout:9/821: dwrite d12/dd7/dc7/d74/d77/fcc [4194304,4194304] 0 2024-09-12T22:11:30.105 INFO:tasks.workunit.client.0.smithi019.stdout:4/806: write d9/db/f99 [1546501,85144] 0 2024-09-12T22:11:30.106 INFO:tasks.workunit.client.0.smithi019.stdout:6/939: rename d9/dc/d20/d4b/d7a/f80 to d9/d3d/d4f/d59/f13d 0 2024-09-12T22:11:30.106 INFO:tasks.workunit.client.0.smithi019.stdout:1/824: sync 2024-09-12T22:11:30.107 INFO:tasks.workunit.client.0.smithi019.stdout:4/807: chown d9/d14/ff3 12888650 1 2024-09-12T22:11:30.107 INFO:tasks.workunit.client.0.smithi019.stdout:3/825: dwrite d18/d26/fd3 [0,4194304] 0 2024-09-12T22:11:30.107 INFO:tasks.workunit.client.0.smithi019.stdout:8/803: link d5/dc/l37 d5/dc/d26/d43/d49/l106 0 2024-09-12T22:11:30.107 INFO:tasks.workunit.client.0.smithi019.stdout:6/940: dread - d9/f57 zero size 2024-09-12T22:11:30.108 INFO:tasks.workunit.client.0.smithi019.stdout:8/804: rmdir d5/d16/d19 39 2024-09-12T22:11:30.108 INFO:tasks.workunit.client.0.smithi019.stdout:4/808: symlink d9/d4c/d76/l108 0 2024-09-12T22:11:30.109 INFO:tasks.workunit.client.0.smithi019.stdout:6/941: stat d9/dc/dd9/f123 0 2024-09-12T22:11:30.109 INFO:tasks.workunit.client.0.smithi019.stdout:3/826: unlink d18/d26/da5/cd2 0 2024-09-12T22:11:30.109 INFO:tasks.workunit.client.0.smithi019.stdout:2/738: truncate d0/d3/d11/d77/d78/d2c/d30/d32/de5/fb4 2646431 0 2024-09-12T22:11:30.110 INFO:tasks.workunit.client.0.smithi019.stdout:4/809: rename d9/d6c to d9/d87/d109 0 2024-09-12T22:11:30.110 INFO:tasks.workunit.client.0.smithi019.stdout:3/827: write d18/d26/d30/d4e/f73 [134210,68395] 0 2024-09-12T22:11:30.111 INFO:tasks.workunit.client.0.smithi019.stdout:2/739: fdatasync d0/d3/d11/d2e/d64/f79 0 2024-09-12T22:11:30.111 INFO:tasks.workunit.client.0.smithi019.stdout:8/805: link d5/dc/d26/d5c/l97 d5/dc/d8a/d8e/l107 0 2024-09-12T22:11:30.112 INFO:tasks.workunit.client.0.smithi019.stdout:7/781: dread da/d19/d25/d39/d51/dd7/f64 [0,4194304] 0 2024-09-12T22:11:30.113 INFO:tasks.workunit.client.0.smithi019.stdout:8/806: creat d5/dc/d26/d4b/d101/f108 x:0 0 0 2024-09-12T22:11:30.113 INFO:tasks.workunit.client.0.smithi019.stdout:3/828: chown d18/d26/d30/d4e/l54 681150 1 2024-09-12T22:11:30.113 INFO:tasks.workunit.client.0.smithi019.stdout:7/782: mknod da/d24/d28/d1c/d32/dc2/dca/c108 0 2024-09-12T22:11:30.114 INFO:tasks.workunit.client.0.smithi019.stdout:8/807: mknod d5/dc/d26/dc8/c109 0 2024-09-12T22:11:30.114 INFO:tasks.workunit.client.0.smithi019.stdout:3/829: chown d18/d26/d30/d71/lca 7545 1 2024-09-12T22:11:30.115 INFO:tasks.workunit.client.0.smithi019.stdout:4/810: dwrite d9/db/d2b/dc7/dd3/f106 [0,4194304] 0 2024-09-12T22:11:30.116 INFO:tasks.workunit.client.0.smithi019.stdout:3/830: getdents d18/d1d/d8b/dc5/dbb 0 2024-09-12T22:11:30.116 INFO:tasks.workunit.client.0.smithi019.stdout:4/811: dread - d9/d4c/d76/dc9/df0/d8f/d93/dad/fbc zero size 2024-09-12T22:11:30.117 INFO:tasks.workunit.client.0.smithi019.stdout:0/798: dread d5/d7/f5f [0,4194304] 0 2024-09-12T22:11:30.117 INFO:tasks.workunit.client.0.smithi019.stdout:4/812: creat d9/d87/f10a x:0 0 0 2024-09-12T22:11:30.118 INFO:tasks.workunit.client.0.smithi019.stdout:0/799: read - d5/d7/d10/d26/fcd zero size 2024-09-12T22:11:30.118 INFO:tasks.workunit.client.0.smithi019.stdout:1/825: read d1/d2/d18/d70/fae [1946583,54655] 0 2024-09-12T22:11:30.118 INFO:tasks.workunit.client.0.smithi019.stdout:7/783: read da/d30/da5/fd8 [1087719,61524] 0 2024-09-12T22:11:30.118 INFO:tasks.workunit.client.0.smithi019.stdout:3/831: getdents d18/d26/d30/d91 0 2024-09-12T22:11:30.120 INFO:tasks.workunit.client.0.smithi019.stdout:3/832: unlink d18/d26/f4b 0 2024-09-12T22:11:30.120 INFO:tasks.workunit.client.0.smithi019.stdout:1/826: symlink d1/d2/d18/d59/l113 0 2024-09-12T22:11:30.120 INFO:tasks.workunit.client.0.smithi019.stdout:9/822: truncate d12/d1b/d20/d59/d5b/d9e/f76 326348 0 2024-09-12T22:11:30.121 INFO:tasks.workunit.client.0.smithi019.stdout:2/740: write d0/d3/df/d7b/dbe/fda [2351459,85609] 0 2024-09-12T22:11:30.121 INFO:tasks.workunit.client.0.smithi019.stdout:3/833: unlink d18/d26/d30/d71/d86/c8c 0 2024-09-12T22:11:30.122 INFO:tasks.workunit.client.0.smithi019.stdout:1/827: getdents d1/d37 0 2024-09-12T22:11:30.122 INFO:tasks.workunit.client.0.smithi019.stdout:9/823: read - d12/dd7/dc7/d92/dac/fc8 zero size 2024-09-12T22:11:30.122 INFO:tasks.workunit.client.0.smithi019.stdout:8/808: dread d5/dc/d26/d4b/fb8 [0,4194304] 0 2024-09-12T22:11:30.122 INFO:tasks.workunit.client.0.smithi019.stdout:2/741: fsync d0/d3/d11/d2e/d64/fb1 0 2024-09-12T22:11:30.123 INFO:tasks.workunit.client.0.smithi019.stdout:9/824: creat d12/d1b/d40/d85/de8/f118 x:0 0 0 2024-09-12T22:11:30.124 INFO:tasks.workunit.client.0.smithi019.stdout:1/828: chown d1/d2/d18/d35/d84/fb3 492400821 1 2024-09-12T22:11:30.124 INFO:tasks.workunit.client.0.smithi019.stdout:8/809: chown d5/dc/d26/d43/d49/l106 483352 1 2024-09-12T22:11:30.125 INFO:tasks.workunit.client.0.smithi019.stdout:7/784: dread da/f5b [0,4194304] 0 2024-09-12T22:11:30.125 INFO:tasks.workunit.client.0.smithi019.stdout:3/834: dread f16 [4194304,4194304] 0 2024-09-12T22:11:30.125 INFO:tasks.workunit.client.0.smithi019.stdout:2/742: creat d0/d3/d11/d2e/d64/dce/ff9 x:0 0 0 2024-09-12T22:11:30.125 INFO:tasks.workunit.client.0.smithi019.stdout:8/810: creat d5/dc/d26/d5c/f10a x:0 0 0 2024-09-12T22:11:30.127 INFO:tasks.workunit.client.0.smithi019.stdout:8/811: symlink d5/dc/d8a/d8e/l10b 0 2024-09-12T22:11:30.130 INFO:tasks.workunit.client.0.smithi019.stdout:8/812: truncate d5/dc/ff9 768166 0 2024-09-12T22:11:30.130 INFO:tasks.workunit.client.0.smithi019.stdout:7/785: rename da/d19/d25/d39/c80 to da/d19/d25/d39/d51/dd7/db1/db5/db6/df5/c109 0 2024-09-12T22:11:30.131 INFO:tasks.workunit.client.0.smithi019.stdout:7/786: dread - da/d24/d28/f8b zero size 2024-09-12T22:11:30.132 INFO:tasks.workunit.client.0.smithi019.stdout:6/942: sync 2024-09-12T22:11:30.132 INFO:tasks.workunit.client.0.smithi019.stdout:4/813: sync 2024-09-12T22:11:30.133 INFO:tasks.workunit.client.0.smithi019.stdout:8/813: symlink d5/dc/d26/dc8/l10c 0 2024-09-12T22:11:30.133 INFO:tasks.workunit.client.0.smithi019.stdout:9/825: dwrite d12/dd7/dc7/d92/dac/fc8 [0,4194304] 0 2024-09-12T22:11:30.133 INFO:tasks.workunit.client.0.smithi019.stdout:3/835: dread d18/d1d/d8b/dc5/dbb/fe4 [4194304,4194304] 0 2024-09-12T22:11:30.133 INFO:tasks.workunit.client.0.smithi019.stdout:1/829: dwrite d1/d2/d18/d29/f112 [0,4194304] 0 2024-09-12T22:11:30.134 INFO:tasks.workunit.client.0.smithi019.stdout:7/787: symlink da/d30/l10a 0 2024-09-12T22:11:30.134 INFO:tasks.workunit.client.0.smithi019.stdout:6/943: chown d9/d3d/d4f/d59/d79 85556 1 2024-09-12T22:11:30.135 INFO:tasks.workunit.client.0.smithi019.stdout:1/830: chown d1/d37/l43 1787 1 2024-09-12T22:11:30.136 INFO:tasks.workunit.client.0.smithi019.stdout:5/831: dread d0/d1d/d3d/f90 [0,4194304] 0 2024-09-12T22:11:30.136 INFO:tasks.workunit.client.0.smithi019.stdout:6/944: fdatasync d9/dc/df7/d7d/da7/f10c 0 2024-09-12T22:11:30.136 INFO:tasks.workunit.client.0.smithi019.stdout:1/831: dread - d1/d2/d18/d35/d84/fb3 zero size 2024-09-12T22:11:30.137 INFO:tasks.workunit.client.0.smithi019.stdout:1/832: dread - d1/d2/d18/d29/d27/fd9 zero size 2024-09-12T22:11:30.138 INFO:tasks.workunit.client.0.smithi019.stdout:4/814: creat d9/db/d2b/dc7/dd3/f10b x:0 0 0 2024-09-12T22:11:30.138 INFO:tasks.workunit.client.0.smithi019.stdout:9/826: mkdir d12/d1b/d40/d52/d119 0 2024-09-12T22:11:30.138 INFO:tasks.workunit.client.0.smithi019.stdout:8/814: mkdir d5/dc/d26/d43/d49/d92/d10d 0 2024-09-12T22:11:30.139 INFO:tasks.workunit.client.0.smithi019.stdout:0/800: dread d5/d7/d10/d26/ffc [0,4194304] 0 2024-09-12T22:11:30.139 INFO:tasks.workunit.client.0.smithi019.stdout:6/945: unlink d9/dc/df7/d7d/fd7 0 2024-09-12T22:11:30.139 INFO:tasks.workunit.client.0.smithi019.stdout:5/832: rmdir d0/d26/d6f/d107 39 2024-09-12T22:11:30.139 INFO:tasks.workunit.client.0.smithi019.stdout:1/833: unlink d1/d2/d18/d29/d27/f100 0 2024-09-12T22:11:30.140 INFO:tasks.workunit.client.0.smithi019.stdout:5/833: dread - d0/d24/d97/fec zero size 2024-09-12T22:11:30.140 INFO:tasks.workunit.client.0.smithi019.stdout:0/801: chown d5/d7/d2c/d44/d6a/d46/db2/d10c 207990979 1 2024-09-12T22:11:30.141 INFO:tasks.workunit.client.0.smithi019.stdout:1/834: write d1/d2/d18/d29/f112 [1446106,82638] 0 2024-09-12T22:11:30.141 INFO:tasks.workunit.client.0.smithi019.stdout:4/815: rename d9/d14/l32 to d9/d87/d109/l10c 0 2024-09-12T22:11:30.141 INFO:tasks.workunit.client.0.smithi019.stdout:9/827: creat d12/d1b/d40/d85/d10f/f11a x:0 0 0 2024-09-12T22:11:30.142 INFO:tasks.workunit.client.0.smithi019.stdout:4/816: mknod d9/d14/d57/d95/d96/dc4/c10d 0 2024-09-12T22:11:30.144 INFO:tasks.workunit.client.0.smithi019.stdout:9/828: write d12/d1b/d40/d85/d10f/f11a [849080,93504] 0 2024-09-12T22:11:30.146 INFO:tasks.workunit.client.0.smithi019.stdout:4/817: rmdir d9/d4c/d76/dc9 39 2024-09-12T22:11:30.148 INFO:tasks.workunit.client.0.smithi019.stdout:5/834: sync 2024-09-12T22:11:30.148 INFO:tasks.workunit.client.0.smithi019.stdout:8/815: dwrite d5/d16/d19/f50 [0,4194304] 0 2024-09-12T22:11:30.150 INFO:tasks.workunit.client.0.smithi019.stdout:6/946: dwrite d9/d3d/d4f/d59/d79/dfc/f13b [0,4194304] 0 2024-09-12T22:11:30.150 INFO:tasks.workunit.client.0.smithi019.stdout:0/802: dwrite d5/d7/dac/db6/ffb [0,4194304] 0 2024-09-12T22:11:30.151 INFO:tasks.workunit.client.0.smithi019.stdout:9/829: mknod d12/d1b/d20/d59/c11b 0 2024-09-12T22:11:30.151 INFO:tasks.workunit.client.0.smithi019.stdout:1/835: dwrite d1/d2/fb5 [0,4194304] 0 2024-09-12T22:11:30.151 INFO:tasks.workunit.client.0.smithi019.stdout:4/818: write d9/d4c/fbf [957628,77966] 0 2024-09-12T22:11:30.153 INFO:tasks.workunit.client.0.smithi019.stdout:1/836: readlink d1/d2/d18/d35/d84/l6c 0 2024-09-12T22:11:30.153 INFO:tasks.workunit.client.0.smithi019.stdout:6/947: write d9/dc/d20/f2e [850904,88965] 0 2024-09-12T22:11:30.153 INFO:tasks.workunit.client.0.smithi019.stdout:8/816: mkdir d5/dc/d26/d76/d10e 0 2024-09-12T22:11:30.153 INFO:tasks.workunit.client.0.smithi019.stdout:4/819: mkdir d9/d17/d10e 0 2024-09-12T22:11:30.153 INFO:tasks.workunit.client.0.smithi019.stdout:9/830: write d12/dd7/dc7/d74/de3/ff6 [991172,102814] 0 2024-09-12T22:11:30.154 INFO:tasks.workunit.client.0.smithi019.stdout:2/743: dread d0/d3/d11/d2e/d64/f79 [0,4194304] 0 2024-09-12T22:11:30.154 INFO:tasks.workunit.client.0.smithi019.stdout:6/948: symlink d9/dc/d20/d30/d5b/l13e 0 2024-09-12T22:11:30.154 INFO:tasks.workunit.client.0.smithi019.stdout:4/820: write d9/db/f99 [2534049,73522] 0 2024-09-12T22:11:30.154 INFO:tasks.workunit.client.0.smithi019.stdout:9/831: mknod d12/d1b/d20/c11c 0 2024-09-12T22:11:30.155 INFO:tasks.workunit.client.0.smithi019.stdout:2/744: stat d0/d3/df/d7b/d44/de9 0 2024-09-12T22:11:30.155 INFO:tasks.workunit.client.0.smithi019.stdout:4/821: chown d9/d14/d33/l55 8579234 1 2024-09-12T22:11:30.155 INFO:tasks.workunit.client.0.smithi019.stdout:6/949: chown d9/d3d/d4f/d59/fda 225894 1 2024-09-12T22:11:30.156 INFO:tasks.workunit.client.0.smithi019.stdout:1/837: link d1/d2/d18/d29/d51/fb0 d1/d2/da2/f114 0 2024-09-12T22:11:30.156 INFO:tasks.workunit.client.0.smithi019.stdout:2/745: unlink d0/d3/df/d6b/fde 0 2024-09-12T22:11:30.156 INFO:tasks.workunit.client.0.smithi019.stdout:9/832: write d12/dd7/dc7/d56/d60/f94 [1574,124628] 0 2024-09-12T22:11:30.157 INFO:tasks.workunit.client.0.smithi019.stdout:6/950: unlink d9/d3d/d4f/d59/fda 0 2024-09-12T22:11:30.157 INFO:tasks.workunit.client.0.smithi019.stdout:4/822: rmdir d9/d17/d10e 0 2024-09-12T22:11:30.158 INFO:tasks.workunit.client.0.smithi019.stdout:2/746: fdatasync d0/d3/d11/d77/d82/df3/fe7 0 2024-09-12T22:11:30.160 INFO:tasks.workunit.client.0.smithi019.stdout:4/823: creat d9/d17/f10f x:0 0 0 2024-09-12T22:11:30.160 INFO:tasks.workunit.client.0.smithi019.stdout:1/838: creat d1/d2/d18/d35/d84/dc/df/d61/d10a/d110/f115 x:0 0 0 2024-09-12T22:11:30.160 INFO:tasks.workunit.client.0.smithi019.stdout:4/824: sync 2024-09-12T22:11:30.160 INFO:tasks.workunit.client.0.smithi019.stdout:6/951: getdents d9/dc/df7/d78 0 2024-09-12T22:11:30.160 INFO:tasks.workunit.client.0.smithi019.stdout:2/747: write d0/d3/df/f61 [3779757,46019] 0 2024-09-12T22:11:30.161 INFO:tasks.workunit.client.0.smithi019.stdout:1/839: fdatasync d1/d2/d18/d35/d84/dc/df/f74 0 2024-09-12T22:11:30.162 INFO:tasks.workunit.client.0.smithi019.stdout:2/748: creat d0/d31/d12/d3b/ffa x:0 0 0 2024-09-12T22:11:30.163 INFO:tasks.workunit.client.0.smithi019.stdout:1/840: fsync d1/d2/fe2 0 2024-09-12T22:11:30.163 INFO:tasks.workunit.client.0.smithi019.stdout:9/833: dwrite d12/d1b/d40/d52/f65 [4194304,4194304] 0 2024-09-12T22:11:30.164 INFO:tasks.workunit.client.0.smithi019.stdout:2/749: mknod d0/d3/df/d6b/cfb 0 2024-09-12T22:11:30.166 INFO:tasks.workunit.client.0.smithi019.stdout:4/825: dwrite d9/d17/f10f [0,4194304] 0 2024-09-12T22:11:30.167 INFO:tasks.workunit.client.0.smithi019.stdout:9/834: creat d12/dd7/dc7/d74/d77/d86/dbd/f11d x:0 0 0 2024-09-12T22:11:30.167 INFO:tasks.workunit.client.0.smithi019.stdout:6/952: dwrite d9/d3d/d6f/f67 [0,4194304] 0 2024-09-12T22:11:30.169 INFO:tasks.workunit.client.0.smithi019.stdout:2/750: mknod d0/d3/d11/d2e/d64/dce/cfc 0 2024-09-12T22:11:30.169 INFO:tasks.workunit.client.0.smithi019.stdout:6/953: truncate d9/dc/df7/d78/da1/f12a 487285 0 2024-09-12T22:11:30.169 INFO:tasks.workunit.client.0.smithi019.stdout:9/835: stat d12/dd7/dc7/d74/d77/f84 0 2024-09-12T22:11:30.169 INFO:tasks.workunit.client.0.smithi019.stdout:4/826: truncate d9/db/fd 276397 0 2024-09-12T22:11:30.171 INFO:tasks.workunit.client.0.smithi019.stdout:2/751: creat d0/d3/d11/d2e/d70/ffd x:0 0 0 2024-09-12T22:11:30.171 INFO:tasks.workunit.client.0.smithi019.stdout:4/827: dread - d9/d14/d57/d95/d96/fe6 zero size 2024-09-12T22:11:30.173 INFO:tasks.workunit.client.0.smithi019.stdout:9/836: fdatasync d12/d1b/d20/d59/d5b/d9e/fc1 0 2024-09-12T22:11:30.173 INFO:tasks.workunit.client.0.smithi019.stdout:6/954: rename d9/d3d/db8/lfb to d9/d3d/d4f/d59/d79/dfc/l13f 0 2024-09-12T22:11:30.173 INFO:tasks.workunit.client.0.smithi019.stdout:6/955: dread - d9/dc/dd9/fe6 zero size 2024-09-12T22:11:30.173 INFO:tasks.workunit.client.0.smithi019.stdout:9/837: unlink d12/d1b/d20/d25/fb9 0 2024-09-12T22:11:30.175 INFO:tasks.workunit.client.0.smithi019.stdout:6/956: write d9/dc/d20/d30/fed [3218939,107846] 0 2024-09-12T22:11:30.176 INFO:tasks.workunit.client.0.smithi019.stdout:3/836: dread d18/fc8 [0,4194304] 0 2024-09-12T22:11:30.177 INFO:tasks.workunit.client.0.smithi019.stdout:2/752: dwrite d0/d3/d11/d77/d78/d2c/d30/d32/de5/f90 [0,4194304] 0 2024-09-12T22:11:30.180 INFO:tasks.workunit.client.0.smithi019.stdout:2/753: creat d0/d3/df/d7b/d44/de9/ffe x:0 0 0 2024-09-12T22:11:30.182 INFO:tasks.workunit.client.0.smithi019.stdout:3/837: dwrite f15 [4194304,4194304] 0 2024-09-12T22:11:30.182 INFO:tasks.workunit.client.0.smithi019.stdout:7/788: dread da/d24/d28/f15 [4194304,4194304] 0 2024-09-12T22:11:30.182 INFO:tasks.workunit.client.0.smithi019.stdout:9/838: dread d12/d1b/d40/d85/d10f/f11a [0,4194304] 0 2024-09-12T22:11:30.183 INFO:tasks.workunit.client.0.smithi019.stdout:9/839: chown d12/d1b/f1c 10642 1 2024-09-12T22:11:30.184 INFO:tasks.workunit.client.0.smithi019.stdout:7/789: readlink da/d24/dff/dd9/ld2 0 2024-09-12T22:11:30.184 INFO:tasks.workunit.client.0.smithi019.stdout:3/838: rename d18/lba to d18/d1d/d8b/dc5/l101 0 2024-09-12T22:11:30.184 INFO:tasks.workunit.client.0.smithi019.stdout:7/790: write da/d19/f41 [6704991,65295] 0 2024-09-12T22:11:30.184 INFO:tasks.workunit.client.0.smithi019.stdout:9/840: read - d12/d1b/d20/d64/d83/dd1/fe5 zero size 2024-09-12T22:11:30.184 INFO:tasks.workunit.client.0.smithi019.stdout:2/754: read d0/d3/d11/d2e/d64/daf/fd4 [757871,88724] 0 2024-09-12T22:11:30.185 INFO:tasks.workunit.client.0.smithi019.stdout:7/791: fsync da/f5b 0 2024-09-12T22:11:30.185 INFO:tasks.workunit.client.0.smithi019.stdout:2/755: unlink d0/d3/d11/f10 0 2024-09-12T22:11:30.190 INFO:tasks.workunit.client.0.smithi019.stdout:9/841: dwrite d12/dd7/dc7/d74/de3/ff6 [0,4194304] 0 2024-09-12T22:11:30.193 INFO:tasks.workunit.client.0.smithi019.stdout:4/828: dread d9/d87/f105 [0,4194304] 0 2024-09-12T22:11:30.193 INFO:tasks.workunit.client.0.smithi019.stdout:5/835: dread d0/d1d/d4f/d47/f4a [0,4194304] 0 2024-09-12T22:11:30.194 INFO:tasks.workunit.client.0.smithi019.stdout:5/836: chown d0/f1b 7307 1 2024-09-12T22:11:30.194 INFO:tasks.workunit.client.0.smithi019.stdout:4/829: mkdir d9/d4c/d76/df2/d110 0 2024-09-12T22:11:30.194 INFO:tasks.workunit.client.0.smithi019.stdout:6/957: dread d9/d3d/f6e [0,4194304] 0 2024-09-12T22:11:30.195 INFO:tasks.workunit.client.0.smithi019.stdout:5/837: chown d0/d1d/d6d/f8b 2924970 1 2024-09-12T22:11:30.195 INFO:tasks.workunit.client.0.smithi019.stdout:5/838: sync 2024-09-12T22:11:30.195 INFO:tasks.workunit.client.0.smithi019.stdout:9/842: truncate d12/d1b/d20/d25/f49 926035 0 2024-09-12T22:11:30.196 INFO:tasks.workunit.client.0.smithi019.stdout:2/756: read d0/d31/d12/f1b [2593382,47449] 0 2024-09-12T22:11:30.196 INFO:tasks.workunit.client.0.smithi019.stdout:3/839: truncate d18/fc8 1677317 0 2024-09-12T22:11:30.196 INFO:tasks.workunit.client.0.smithi019.stdout:3/840: stat d18/d1d/l27 0 2024-09-12T22:11:30.196 INFO:tasks.workunit.client.0.smithi019.stdout:5/839: creat d0/dbf/f119 x:0 0 0 2024-09-12T22:11:30.197 INFO:tasks.workunit.client.0.smithi019.stdout:4/830: write d9/d87/f105 [427759,22356] 0 2024-09-12T22:11:30.197 INFO:tasks.workunit.client.0.smithi019.stdout:9/843: mkdir d12/dd7/dc7/d56/d60/d11e 0 2024-09-12T22:11:30.198 INFO:tasks.workunit.client.0.smithi019.stdout:4/831: chown d9/d17/ff9 13 1 2024-09-12T22:11:30.198 INFO:tasks.workunit.client.0.smithi019.stdout:2/757: chown d0/d31/d12/d3b/c59 46818821 1 2024-09-12T22:11:30.199 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:30.197+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:30.199 INFO:tasks.workunit.client.0.smithi019.stdout:5/840: write d0/d1d/d3d/f103 [459365,67265] 0 2024-09-12T22:11:30.199 INFO:tasks.workunit.client.0.smithi019.stdout:9/844: creat d12/d1b/d40/f11f x:0 0 0 2024-09-12T22:11:30.199 INFO:tasks.workunit.client.0.smithi019.stdout:4/832: write d9/d4c/fdf [356956,54823] 0 2024-09-12T22:11:30.200 INFO:tasks.workunit.client.0.smithi019.stdout:5/841: creat d0/d26/d42/f11a x:0 0 0 2024-09-12T22:11:30.200 INFO:tasks.workunit.client.0.smithi019.stdout:6/958: dwrite d9/d6b/f103 [0,4194304] 0 2024-09-12T22:11:30.202 INFO:tasks.workunit.client.0.smithi019.stdout:5/842: readlink d0/d1d/d4f/l25 0 2024-09-12T22:11:30.202 INFO:tasks.workunit.client.0.smithi019.stdout:8/817: dread d5/dc/d17/f67 [0,4194304] 0 2024-09-12T22:11:30.205 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:30.205 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:30.205 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:30.205 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:30.205 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:30.206 INFO:tasks.workunit.client.0.smithi019.stdout:3/841: dwrite d18/d26/d30/d4e/f52 [0,4194304] 0 2024-09-12T22:11:30.206 INFO:tasks.workunit.client.0.smithi019.stdout:4/833: getdents d9/d14/d57/d95/dbe/d6f/dfe 0 2024-09-12T22:11:30.206 INFO:tasks.workunit.client.0.smithi019.stdout:5/843: truncate d0/f18 1813940 0 2024-09-12T22:11:30.206 INFO:tasks.workunit.client.0.smithi019.stdout:8/818: dread - d5/dc/d26/d43/d49/d92/fb6 zero size 2024-09-12T22:11:30.207 INFO:tasks.workunit.client.0.smithi019.stdout:6/959: write d9/dc/df7/d7e/fce [1254873,111066] 0 2024-09-12T22:11:30.208 INFO:tasks.workunit.client.0.smithi019.stdout:3/842: stat d18/d1d/d8b/db5 0 2024-09-12T22:11:30.208 INFO:tasks.workunit.client.0.smithi019.stdout:8/819: readlink d5/dc/l87 0 2024-09-12T22:11:30.209 INFO:tasks.workunit.client.0.smithi019.stdout:7/792: dread da/d24/d28/fe4 [0,4194304] 0 2024-09-12T22:11:30.210 INFO:tasks.workunit.client.0.smithi019.stdout:6/960: rmdir d9/dc/dd9 39 2024-09-12T22:11:30.210 INFO:tasks.workunit.client.0.smithi019.stdout:9/845: dwrite d12/d1b/d20/d64/d83/fec [0,4194304] 0 2024-09-12T22:11:30.210 INFO:tasks.workunit.client.0.smithi019.stdout:5/844: stat d0/d1d/d4f/d47/d57/d98/dd6 0 2024-09-12T22:11:30.211 INFO:tasks.workunit.client.0.smithi019.stdout:4/834: readlink d9/d4c/d76/dc9/df0/d8f/d93/ld1 0 2024-09-12T22:11:30.212 INFO:tasks.workunit.client.0.smithi019.stdout:0/803: dread d5/d7/d2c/d81/dcb/fd0 [0,4194304] 0 2024-09-12T22:11:30.212 INFO:tasks.workunit.client.0.smithi019.stdout:2/758: dwrite d0/d3/d11/d77/d78/d2c/d30/d32/f81 [0,4194304] 0 2024-09-12T22:11:30.212 INFO:tasks.workunit.client.0.smithi019.stdout:0/804: chown d5/d88/l9d 37 1 2024-09-12T22:11:30.213 INFO:tasks.workunit.client.0.smithi019.stdout:1/841: dread d1/d2/d18/d35/d84/f5a [0,4194304] 0 2024-09-12T22:11:30.213 INFO:tasks.workunit.client.0.smithi019.stdout:8/820: creat d5/dc/d17/f10f x:0 0 0 2024-09-12T22:11:30.213 INFO:tasks.workunit.client.0.smithi019.stdout:8/821: sync 2024-09-12T22:11:30.215 INFO:tasks.workunit.client.0.smithi019.stdout:3/843: write d18/fc8 [408583,55717] 0 2024-09-12T22:11:30.215 INFO:tasks.workunit.client.0.smithi019.stdout:5/845: unlink d0/d1d/d3d/f90 0 2024-09-12T22:11:30.216 INFO:tasks.workunit.client.0.smithi019.stdout:0/805: mknod d5/d7/dac/db6/c10e 0 2024-09-12T22:11:30.216 INFO:tasks.workunit.client.0.smithi019.stdout:2/759: mknod d0/d3/d11/d77/d78/d91/cff 0 2024-09-12T22:11:30.216 INFO:tasks.workunit.client.0.smithi019.stdout:1/842: chown d1/d2/d18/d35/d84/dc/df/d61/c82 96692825 1 2024-09-12T22:11:30.218 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:30.219 INFO:tasks.workunit.client.0.smithi019.stdout:4/835: write d9/d14/d33/d4e/f85 [1302264,109229] 0 2024-09-12T22:11:30.219 INFO:tasks.workunit.client.0.smithi019.stdout:8/822: mknod d5/dc/d26/d43/d49/d92/c110 0 2024-09-12T22:11:30.219 INFO:tasks.workunit.client.0.smithi019.stdout:7/793: link da/d24/l4f da/d24/d28/d1c/d32/d99/dc8/de2/l10b 0 2024-09-12T22:11:30.219 INFO:tasks.workunit.client.0.smithi019.stdout:3/844: chown d18/d1d/l27 4365097 1 2024-09-12T22:11:30.219 INFO:tasks.workunit.client.0.smithi019.stdout:6/961: write d9/d3d/d6f/f65 [543770,73716] 0 2024-09-12T22:11:30.219 INFO:tasks.workunit.client.0.smithi019.stdout:5/846: creat d0/d1d/d4f/d47/d57/d98/dd6/d111/f11b x:0 0 0 2024-09-12T22:11:30.219 INFO:tasks.workunit.client.0.smithi019.stdout:4/836: symlink d9/d4c/d76/dc9/df0/d8f/l111 0 2024-09-12T22:11:30.220 INFO:tasks.workunit.client.0.smithi019.stdout:6/962: read d9/d3d/d6f/f67 [3868412,3477] 0 2024-09-12T22:11:30.220 INFO:tasks.workunit.client.0.smithi019.stdout:8/823: link d5/f23 d5/dc/d26/d4b/f111 0 2024-09-12T22:11:30.221 INFO:tasks.workunit.client.0.smithi019.stdout:4/837: fdatasync d9/d17/fac 0 2024-09-12T22:11:30.222 INFO:tasks.workunit.client.0.smithi019.stdout:5/847: write d0/d1d/d6d/dca/fbb [1400045,15606] 0 2024-09-12T22:11:30.222 INFO:tasks.workunit.client.0.smithi019.stdout:3/845: rename d18/d1d/d8b/ce0 to d18/d26/dce/df6/c102 0 2024-09-12T22:11:30.222 INFO:tasks.workunit.client.0.smithi019.stdout:9/846: dwrite d12/d1b/f7d [0,4194304] 0 2024-09-12T22:11:30.224 INFO:tasks.workunit.client.0.smithi019.stdout:4/838: unlink d9/d87/fae 0 2024-09-12T22:11:30.225 INFO:tasks.workunit.client.0.smithi019.stdout:9/847: write d12/d1b/d20/fce [4184173,97721] 0 2024-09-12T22:11:30.226 INFO:tasks.workunit.client.0.smithi019.stdout:3/846: mknod d18/d26/d30/d4e/d9a/c103 0 2024-09-12T22:11:30.226 INFO:tasks.workunit.client.0.smithi019.stdout:5/848: mknod d0/d1d/d4f/d47/d57/d98/c11c 0 2024-09-12T22:11:30.226 INFO:tasks.workunit.client.0.smithi019.stdout:7/794: link da/d19/d25/lc4 da/d24/d28/d1c/d32/l10c 0 2024-09-12T22:11:30.226 INFO:tasks.workunit.client.0.smithi019.stdout:2/760: dwrite d0/d31/d12/d15/fa0 [0,4194304] 0 2024-09-12T22:11:30.226 INFO:tasks.workunit.client.0.smithi019.stdout:4/839: mkdir d9/d4c/d9c/d112 0 2024-09-12T22:11:30.227 INFO:tasks.workunit.client.0.smithi019.stdout:0/806: dwrite d5/d7/d10/d26/ffc [4194304,4194304] 0 2024-09-12T22:11:30.228 INFO:tasks.workunit.client.0.smithi019.stdout:3/847: chown d18/d26/d30/d71/d86/f9e 594771 1 2024-09-12T22:11:30.228 INFO:tasks.workunit.client.0.smithi019.stdout:2/761: chown d0/d3/d21/c29 771059 1 2024-09-12T22:11:30.229 INFO:tasks.workunit.client.0.smithi019.stdout:3/848: stat d18/d1d/c38 0 2024-09-12T22:11:30.229 INFO:tasks.workunit.client.0.smithi019.stdout:3/849: sync 2024-09-12T22:11:30.229 INFO:tasks.workunit.client.0.smithi019.stdout:8/824: rename d5/dc/d26/d43/d49/c103 to d5/d16/c112 0 2024-09-12T22:11:30.231 INFO:tasks.workunit.client.0.smithi019.stdout:3/850: chown d18/d1d/d8b/cf8 51196 1 2024-09-12T22:11:30.231 INFO:tasks.workunit.client.0.smithi019.stdout:4/840: fdatasync d9/d14/d57/fb9 0 2024-09-12T22:11:30.232 INFO:tasks.workunit.client.0.smithi019.stdout:5/849: rename d0/d4e/d50/f85 to d0/d1d/d4f/d96/f11d 0 2024-09-12T22:11:30.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/762: write d0/d3/d11/d77/d78/d2c/d30/d32/f4a [2554935,23227] 0 2024-09-12T22:11:30.232 INFO:tasks.workunit.client.0.smithi019.stdout:3/851: stat d18/d1d/c57 0 2024-09-12T22:11:30.232 INFO:tasks.workunit.client.0.smithi019.stdout:0/807: truncate d5/d7/d2c/d81/dcb/deb/ff4 571489 0 2024-09-12T22:11:30.233 INFO:tasks.workunit.client.0.smithi019.stdout:4/841: write d9/d14/fa5 [962815,43948] 0 2024-09-12T22:11:30.233 INFO:tasks.workunit.client.0.smithi019.stdout:5/850: mkdir d0/d1d/d6d/d11e 0 2024-09-12T22:11:30.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/763: write d0/d3/df/d7b/d44/de9/ffe [650815,30899] 0 2024-09-12T22:11:30.234 INFO:tasks.workunit.client.0.smithi019.stdout:0/808: chown d5/d7/d10/d26/f3e 1 1 2024-09-12T22:11:30.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/795: dwrite da/d19/d25/d39/d51/f75 [4194304,4194304] 0 2024-09-12T22:11:30.235 INFO:tasks.workunit.client.0.smithi019.stdout:4/842: symlink d9/d87/l113 0 2024-09-12T22:11:30.235 INFO:tasks.workunit.client.0.smithi019.stdout:5/851: truncate d0/d1d/d4f/ff7 216585 0 2024-09-12T22:11:30.235 INFO:tasks.workunit.client.0.smithi019.stdout:0/809: stat d5/d7/d2c/ddc/ff2 0 2024-09-12T22:11:30.236 INFO:tasks.workunit.client.0.smithi019.stdout:7/796: stat da/d24/d28/d1c/d32/d99/dc8/de2 0 2024-09-12T22:11:30.237 INFO:tasks.workunit.client.0.smithi019.stdout:0/810: chown d5/d7/d10/f5e 98238 1 2024-09-12T22:11:30.237 INFO:tasks.workunit.client.0.smithi019.stdout:5/852: rmdir d0/d26/d6f 39 2024-09-12T22:11:30.237 INFO:tasks.workunit.client.0.smithi019.stdout:6/963: dwrite d9/dc/d20/d30/d5b/f6d [0,4194304] 0 2024-09-12T22:11:30.238 INFO:tasks.workunit.client.0.smithi019.stdout:7/797: creat da/d19/d25/f10d x:0 0 0 2024-09-12T22:11:30.238 INFO:tasks.workunit.client.0.smithi019.stdout:9/848: dread d12/d1b/d20/d59/d5b/d9a/fa7 [0,4194304] 0 2024-09-12T22:11:30.238 INFO:tasks.workunit.client.0.smithi019.stdout:2/764: chown d0/d3/d11/d77/d78/d2c/d2d/de4/cf7 12 1 2024-09-12T22:11:30.238 INFO:tasks.workunit.client.0.smithi019.stdout:5/853: unlink d0/f1b 0 2024-09-12T22:11:30.240 INFO:tasks.workunit.client.0.smithi019.stdout:6/964: mkdir d9/dc/df7/d78/da1/d140 0 2024-09-12T22:11:30.241 INFO:tasks.workunit.client.0.smithi019.stdout:7/798: fsync da/d24/d28/d1c/d32/f3c 0 2024-09-12T22:11:30.242 INFO:tasks.workunit.client.0.smithi019.stdout:0/811: read d5/d7/d2c/ff1 [3199273,32387] 0 2024-09-12T22:11:30.242 INFO:tasks.workunit.client.0.smithi019.stdout:2/765: symlink d0/d31/d12/d15/dae/l100 0 2024-09-12T22:11:30.243 INFO:tasks.workunit.client.0.smithi019.stdout:6/965: mkdir d9/dc/df7/d7d/da7/d11d/d141 0 2024-09-12T22:11:30.243 INFO:tasks.workunit.client.0.smithi019.stdout:8/825: read d5/dc/d17/f72 [271201,112133] 0 2024-09-12T22:11:30.243 INFO:tasks.workunit.client.0.smithi019.stdout:4/843: dwrite d9/d14/fa2 [0,4194304] 0 2024-09-12T22:11:30.245 INFO:tasks.workunit.client.0.smithi019.stdout:8/826: dread - d5/dc/d26/d43/d7d/ffe zero size 2024-09-12T22:11:30.245 INFO:tasks.workunit.client.0.smithi019.stdout:9/849: dread d12/dd7/dc7/d74/de3/ff6 [0,4194304] 0 2024-09-12T22:11:30.245 INFO:tasks.workunit.client.0.smithi019.stdout:6/966: write d9/dc/df7/d78/da1/ff9 [127302,2390] 0 2024-09-12T22:11:30.245 INFO:tasks.workunit.client.0.smithi019.stdout:7/799: rename da/d19/d25/d39/fa3 to da/d24/d28/d1c/d32/d99/f10e 0 2024-09-12T22:11:30.245 INFO:tasks.workunit.client.0.smithi019.stdout:2/766: creat d0/d3/df/d7b/d80/f101 x:0 0 0 2024-09-12T22:11:30.246 INFO:tasks.workunit.client.0.smithi019.stdout:8/827: chown d5/d16/d19/c54 2 1 2024-09-12T22:11:30.246 INFO:tasks.workunit.client.0.smithi019.stdout:4/844: rename d9/d4c/d76/dc9/df0/d8f/d93/fe1 to d9/d4c/d76/dc9/df0/de2/f114 0 2024-09-12T22:11:30.247 INFO:tasks.workunit.client.0.smithi019.stdout:2/767: write d0/fd7 [542315,88101] 0 2024-09-12T22:11:30.247 INFO:tasks.workunit.client.0.smithi019.stdout:9/850: creat d12/d1b/d20/da0/f120 x:0 0 0 2024-09-12T22:11:30.247 INFO:tasks.workunit.client.0.smithi019.stdout:6/967: unlink d9/dc/d20/d4b/d6c/cb5 0 2024-09-12T22:11:30.248 INFO:tasks.workunit.client.0.smithi019.stdout:2/768: stat d0/d3/d11/d2e 0 2024-09-12T22:11:30.248 INFO:tasks.workunit.client.0.smithi019.stdout:8/828: creat d5/dc/d26/d5c/f113 x:0 0 0 2024-09-12T22:11:30.249 INFO:tasks.workunit.client.0.smithi019.stdout:9/851: symlink d12/d1b/d20/l121 0 2024-09-12T22:11:30.250 INFO:tasks.workunit.client.0.smithi019.stdout:1/843: dread d1/d2/d18/d35/d84/d98/fc2 [0,4194304] 0 2024-09-12T22:11:30.251 INFO:tasks.workunit.client.0.smithi019.stdout:8/829: creat d5/dc/d8d/f114 x:0 0 0 2024-09-12T22:11:30.251 INFO:tasks.workunit.client.0.smithi019.stdout:0/812: dwrite d5/d7/de/f7f [0,4194304] 0 2024-09-12T22:11:30.251 INFO:tasks.workunit.client.0.smithi019.stdout:6/968: truncate d9/dc/df7/d7d/fa9 589083 0 2024-09-12T22:11:30.255 INFO:tasks.workunit.client.0.smithi019.stdout:3/852: write d18/d26/d30/d4e/f59 [3744867,17747] 0 2024-09-12T22:11:30.256 INFO:tasks.workunit.client.0.smithi019.stdout:7/800: dwrite da/f7c [0,4194304] 0 2024-09-12T22:11:30.256 INFO:tasks.workunit.client.0.smithi019.stdout:0/813: chown d5/d7/d2c/d44/d6a/d46/f60 430328 1 2024-09-12T22:11:30.256 INFO:tasks.workunit.client.0.smithi019.stdout:6/969: dread - d9/dc/df7/d78/d10d/f134 zero size 2024-09-12T22:11:30.256 INFO:tasks.workunit.client.0.smithi019.stdout:4/845: dread d9/db/d2b/dc7/dd3/f106 [0,4194304] 0 2024-09-12T22:11:30.256 INFO:tasks.workunit.client.0.smithi019.stdout:2/769: dread d0/d31/d12/d15/fa0 [0,4194304] 0 2024-09-12T22:11:30.257 INFO:tasks.workunit.client.0.smithi019.stdout:8/830: fdatasync d5/dc/d17/f67 0 2024-09-12T22:11:30.257 INFO:tasks.workunit.client.0.smithi019.stdout:3/853: fdatasync d18/d1d/d8b/dc5/dbb/fe4 0 2024-09-12T22:11:30.258 INFO:tasks.workunit.client.0.smithi019.stdout:6/970: creat d9/dc/df7/d78/da1/f142 x:0 0 0 2024-09-12T22:11:30.258 INFO:tasks.workunit.client.0.smithi019.stdout:1/844: mkdir d1/d2/d18/d35/d84/dc/df/d2c/d116 0 2024-09-12T22:11:30.258 INFO:tasks.workunit.client.0.smithi019.stdout:7/801: symlink da/d24/d28/d1c/d32/d99/dc8/df4/l10f 0 2024-09-12T22:11:30.259 INFO:tasks.workunit.client.0.smithi019.stdout:9/852: creat d12/d1b/d20/d59/f122 x:0 0 0 2024-09-12T22:11:30.259 INFO:tasks.workunit.client.0.smithi019.stdout:4/846: rename d9/d4c/d76/dc9/df0/d8f/l111 to d9/d4c/l115 0 2024-09-12T22:11:30.260 INFO:tasks.workunit.client.0.smithi019.stdout:7/802: fdatasync da/d8f/fd6 0 2024-09-12T22:11:30.260 INFO:tasks.workunit.client.0.smithi019.stdout:6/971: chown d9/dc/d20/d30/f34 19 1 2024-09-12T22:11:30.261 INFO:tasks.workunit.client.0.smithi019.stdout:3/854: mknod d18/d1d/d8b/dc5/dbb/df1/dfd/c104 0 2024-09-12T22:11:30.262 INFO:tasks.workunit.client.0.smithi019.stdout:5/854: dwrite d0/f9c [0,4194304] 0 2024-09-12T22:11:30.262 INFO:tasks.workunit.client.0.smithi019.stdout:1/845: rename d1/d2/d18/d29/d27/fd9 to d1/d2/d18/d35/d84/d98/dbc/f117 0 2024-09-12T22:11:30.262 INFO:tasks.workunit.client.0.smithi019.stdout:0/814: truncate d5/d7/d10/f5e 4065967 0 2024-09-12T22:11:30.264 INFO:tasks.workunit.client.0.smithi019.stdout:5/855: creat d0/d24/d58/f11f x:0 0 0 2024-09-12T22:11:30.264 INFO:tasks.workunit.client.0.smithi019.stdout:4/847: truncate d9/d14/d33/f6e 751454 0 2024-09-12T22:11:30.264 INFO:tasks.workunit.client.0.smithi019.stdout:0/815: write d5/d7/d10/d26/d8a/fe9 [681666,69767] 0 2024-09-12T22:11:30.266 INFO:tasks.workunit.client.0.smithi019.stdout:1/846: creat d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/f118 x:0 0 0 2024-09-12T22:11:30.266 INFO:tasks.workunit.client.0.smithi019.stdout:5/856: fdatasync d0/d1d/f95 0 2024-09-12T22:11:30.266 INFO:tasks.workunit.client.0.smithi019.stdout:7/803: link da/d19/d25/d39/d51/c8c da/d19/d25/d39/d51/dd7/db1/db5/db6/df5/c110 0 2024-09-12T22:11:30.266 INFO:tasks.workunit.client.0.smithi019.stdout:9/853: dwrite d12/dd7/dc7/d56/f79 [0,4194304] 0 2024-09-12T22:11:30.268 INFO:tasks.workunit.client.0.smithi019.stdout:1/847: readlink d1/d2/d18/d29/d27/ld0 0 2024-09-12T22:11:30.268 INFO:tasks.workunit.client.0.smithi019.stdout:0/816: creat d5/d7/d2c/d44/d6a/d46/f10f x:0 0 0 2024-09-12T22:11:30.269 INFO:tasks.workunit.client.0.smithi019.stdout:9/854: symlink d12/dd7/dc7/d56/df5/l123 0 2024-09-12T22:11:30.271 INFO:tasks.workunit.client.0.smithi019.stdout:7/804: write da/d19/d25/d39/d51/dd7/db1/db5/db6/db8/fe5 [2964,125596] 0 2024-09-12T22:11:30.271 INFO:tasks.workunit.client.0.smithi019.stdout:0/817: write d5/d7/de/fda [328697,29943] 0 2024-09-12T22:11:30.271 INFO:tasks.workunit.client.0.smithi019.stdout:3/855: dwrite d18/d26/d30/d4a/f62 [0,4194304] 0 2024-09-12T22:11:30.273 INFO:tasks.workunit.client.0.smithi019.stdout:4/848: dwrite d9/d17/fac [0,4194304] 0 2024-09-12T22:11:30.274 INFO:tasks.workunit.client.0.smithi019.stdout:8/831: sync 2024-09-12T22:11:30.274 INFO:tasks.workunit.client.0.smithi019.stdout:6/972: sync 2024-09-12T22:11:30.274 INFO:tasks.workunit.client.0.smithi019.stdout:0/818: fsync d5/d7/d2c/f47 0 2024-09-12T22:11:30.275 INFO:tasks.workunit.client.0.smithi019.stdout:5/857: dwrite d0/d24/d7a/f8f [0,4194304] 0 2024-09-12T22:11:30.276 INFO:tasks.workunit.client.0.smithi019.stdout:3/856: rmdir d18/d26/d30/d4e/d9a/dae 39 2024-09-12T22:11:30.277 INFO:tasks.workunit.client.0.smithi019.stdout:0/819: rmdir d5/d88 39 2024-09-12T22:11:30.277 INFO:tasks.workunit.client.0.smithi019.stdout:4/849: creat d9/db/d2b/dc7/f116 x:0 0 0 2024-09-12T22:11:30.277 INFO:tasks.workunit.client.0.smithi019.stdout:7/805: creat da/d19/f111 x:0 0 0 2024-09-12T22:11:30.277 INFO:tasks.workunit.client.0.smithi019.stdout:8/832: creat d5/dc/d26/d43/d49/d92/f115 x:0 0 0 2024-09-12T22:11:30.277 INFO:tasks.workunit.client.0.smithi019.stdout:5/858: unlink d0/d1d/d4f/d96/cd4 0 2024-09-12T22:11:30.278 INFO:tasks.workunit.client.0.smithi019.stdout:1/848: dwrite d1/d2/d18/d29/d51/f85 [0,4194304] 0 2024-09-12T22:11:30.278 INFO:tasks.workunit.client.0.smithi019.stdout:4/850: fsync d9/db/d2b/d6a/f81 0 2024-09-12T22:11:30.279 INFO:tasks.workunit.client.0.smithi019.stdout:3/857: write d18/f56 [1659490,73798] 0 2024-09-12T22:11:30.280 INFO:tasks.workunit.client.0.smithi019.stdout:0/820: truncate d5/d7/fe8 573728 0 2024-09-12T22:11:30.281 INFO:tasks.workunit.client.0.smithi019.stdout:5/859: write d0/f9 [922961,103610] 0 2024-09-12T22:11:30.281 INFO:tasks.workunit.client.0.smithi019.stdout:0/821: fsync d5/d7/dac/fd4 0 2024-09-12T22:11:30.282 INFO:tasks.workunit.client.0.smithi019.stdout:9/855: dwrite d12/dd7/dc7/d74/d77/fe9 [0,4194304] 0 2024-09-12T22:11:30.282 INFO:tasks.workunit.client.0.smithi019.stdout:1/849: rename d1/d2/d18/d35/d84/dc/df/l46 to d1/d2/d18/d35/d84/d98/d105/l119 0 2024-09-12T22:11:30.282 INFO:tasks.workunit.client.0.smithi019.stdout:8/833: sync 2024-09-12T22:11:30.283 INFO:tasks.workunit.client.0.smithi019.stdout:0/822: chown d5/d7/d2c/d44/d6a 309 1 2024-09-12T22:11:30.283 INFO:tasks.workunit.client.0.smithi019.stdout:4/851: write d9/d4c/d76/dc9/df0/de2/f114 [557207,33628] 0 2024-09-12T22:11:30.284 INFO:tasks.workunit.client.0.smithi019.stdout:5/860: truncate d0/d24/d97/fdc 4411495 0 2024-09-12T22:11:30.284 INFO:tasks.workunit.client.0.smithi019.stdout:1/850: readlink d1/d2/d18/d59/lbf 0 2024-09-12T22:11:30.285 INFO:tasks.workunit.client.0.smithi019.stdout:0/823: write d5/d7/d10/f68 [753395,35939] 0 2024-09-12T22:11:30.285 INFO:tasks.workunit.client.0.smithi019.stdout:3/858: truncate d18/f3e 2743530 0 2024-09-12T22:11:30.285 INFO:tasks.workunit.client.0.smithi019.stdout:8/834: creat d5/dc/d8d/dcb/f116 x:0 0 0 2024-09-12T22:11:30.285 INFO:tasks.workunit.client.0.smithi019.stdout:9/856: link d12/dd7/dc7/c63 d12/dd7/dc7/d56/d60/c124 0 2024-09-12T22:11:30.286 INFO:tasks.workunit.client.0.smithi019.stdout:1/851: fsync d1/d2/f24 0 2024-09-12T22:11:30.286 INFO:tasks.workunit.client.0.smithi019.stdout:9/857: mknod d12/d1b/d40/c125 0 2024-09-12T22:11:30.287 INFO:tasks.workunit.client.0.smithi019.stdout:9/858: sync 2024-09-12T22:11:30.287 INFO:tasks.workunit.client.0.smithi019.stdout:4/852: rename d9/d14/d57/d95/dbe/dc6/ffb to d9/d4c/d76/dc9/df0/d8f/f117 0 2024-09-12T22:11:30.288 INFO:tasks.workunit.client.0.smithi019.stdout:0/824: creat d5/d7/d10/f110 x:0 0 0 2024-09-12T22:11:30.289 INFO:tasks.workunit.client.0.smithi019.stdout:9/859: mkdir d12/d1b/d126 0 2024-09-12T22:11:30.289 INFO:tasks.workunit.client.0.smithi019.stdout:8/835: dread - d5/dc/d8d/d96/da7/fdd zero size 2024-09-12T22:11:30.291 INFO:tasks.workunit.client.0.smithi019.stdout:4/853: mkdir d9/d4c/d76/df2/d118 0 2024-09-12T22:11:30.291 INFO:tasks.workunit.client.0.smithi019.stdout:0/825: mkdir d5/d7/dac/d111 0 2024-09-12T22:11:30.291 INFO:tasks.workunit.client.0.smithi019.stdout:5/861: dwrite d0/ff9 [0,4194304] 0 2024-09-12T22:11:30.291 INFO:tasks.workunit.client.0.smithi019.stdout:4/854: truncate d9/d58/fb0 327076 0 2024-09-12T22:11:30.292 INFO:tasks.workunit.client.0.smithi019.stdout:5/862: readlink d0/d26/ldf 0 2024-09-12T22:11:30.292 INFO:tasks.workunit.client.0.smithi019.stdout:0/826: chown d5/d7/d10/d26/d8a/ff7 56839092 1 2024-09-12T22:11:30.293 INFO:tasks.workunit.client.0.smithi019.stdout:9/860: rename d12/d1b/d20/c4d to d12/d1b/d20/d59/d5b/d9a/c127 0 2024-09-12T22:11:30.293 INFO:tasks.workunit.client.0.smithi019.stdout:4/855: truncate d9/d14/d33/d4e/f103 845691 0 2024-09-12T22:11:30.294 INFO:tasks.workunit.client.0.smithi019.stdout:5/863: truncate d0/d24/d7a/f113 202356 0 2024-09-12T22:11:30.295 INFO:tasks.workunit.client.0.smithi019.stdout:4/856: mknod d9/d14/d57/d95/d96/ddd/dc5/dd5/c119 0 2024-09-12T22:11:30.295 INFO:tasks.workunit.client.0.smithi019.stdout:5/864: chown d0/d1d/d4f/d47/d57/dba/df6/c10b 13795 1 2024-09-12T22:11:30.295 INFO:tasks.workunit.client.0.smithi019.stdout:8/836: truncate d5/dc/d26/f3a 3161768 0 2024-09-12T22:11:30.297 INFO:tasks.workunit.client.0.smithi019.stdout:8/837: creat d5/dc/d8a/d98/f117 x:0 0 0 2024-09-12T22:11:30.297 INFO:tasks.workunit.client.0.smithi019.stdout:5/865: rename d0/d24/d97/fdc to d0/f120 0 2024-09-12T22:11:30.298 INFO:tasks.workunit.client.0.smithi019.stdout:8/838: chown d5/dc/d26/d43/d7d 11221064 1 2024-09-12T22:11:30.299 INFO:tasks.workunit.client.0.smithi019.stdout:0/827: dwrite d5/d7/d2c/dc1/fd2 [0,4194304] 0 2024-09-12T22:11:30.299 INFO:tasks.workunit.client.0.smithi019.stdout:8/839: truncate d5/d53/d66/f99 702398 0 2024-09-12T22:11:30.303 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:30.302+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:30.303 INFO:tasks.workunit.client.0.smithi019.stdout:1/852: dread d1/d2/d18/d35/d84/dc/df/d2c/d5d/f8e [0,4194304] 0 2024-09-12T22:11:30.305 INFO:tasks.workunit.client.0.smithi019.stdout:2/770: dread d0/d3/d11/d77/fa2 [0,4194304] 0 2024-09-12T22:11:30.308 INFO:tasks.workunit.client.0.smithi019.stdout:5/866: dwrite d0/d24/d58/fc4 [0,4194304] 0 2024-09-12T22:11:30.308 INFO:tasks.workunit.client.0.smithi019.stdout:8/840: getdents d5/dc/d26/dc8 0 2024-09-12T22:11:30.309 INFO:tasks.workunit.client.0.smithi019.stdout:5/867: dread - d0/d1d/d4f/d96/fc9 zero size 2024-09-12T22:11:30.309 INFO:tasks.workunit.client.0.smithi019.stdout:2/771: creat d0/d3/d11/d77/d78/d2c/d56/f102 x:0 0 0 2024-09-12T22:11:30.309 INFO:tasks.workunit.client.0.smithi019.stdout:1/853: dread - d1/d2/d18/d35/d84/df8/d66/f101 zero size 2024-09-12T22:11:30.309 INFO:tasks.workunit.client.0.smithi019.stdout:0/828: dwrite d5/d7/d10/d26/d8a/ff7 [0,4194304] 0 2024-09-12T22:11:30.310 INFO:tasks.workunit.client.0.smithi019.stdout:1/854: readlink d1/l3c 0 2024-09-12T22:11:30.310 INFO:tasks.workunit.client.0.smithi019.stdout:4/857: dwrite d9/db/d2b/f37 [0,4194304] 0 2024-09-12T22:11:30.310 INFO:tasks.workunit.client.0.smithi019.stdout:5/868: chown d0/d24/f7d 770 1 2024-09-12T22:11:30.312 INFO:tasks.workunit.client.0.smithi019.stdout:1/855: truncate d1/d2/d18/d35/f3a 8963775 0 2024-09-12T22:11:30.312 INFO:tasks.workunit.client.0.smithi019.stdout:6/973: dread d9/dc/d20/fba [0,4194304] 0 2024-09-12T22:11:30.313 INFO:tasks.workunit.client.0.smithi019.stdout:8/841: mknod d5/dc/d26/d43/d7d/c118 0 2024-09-12T22:11:30.315 INFO:tasks.workunit.client.0.smithi019.stdout:4/858: creat d9/d14/d57/d95/d96/f11a x:0 0 0 2024-09-12T22:11:30.315 INFO:tasks.workunit.client.0.smithi019.stdout:6/974: fdatasync d9/d3d/d4f/d8d/fa6 0 2024-09-12T22:11:30.315 INFO:tasks.workunit.client.0.smithi019.stdout:2/772: chown d0/d31/d4/cf4 4494561 1 2024-09-12T22:11:30.315 INFO:tasks.workunit.client.0.smithi019.stdout:3/859: dread d18/f1b [0,4194304] 0 2024-09-12T22:11:30.315 INFO:tasks.workunit.client.0.smithi019.stdout:6/975: readlink d9/d3d/d4f/d59/lf6 0 2024-09-12T22:11:30.316 INFO:tasks.workunit.client.0.smithi019.stdout:2/773: stat d0/d3/d11/d2e/d64/dce/ff9 0 2024-09-12T22:11:30.317 INFO:tasks.workunit.client.0.smithi019.stdout:4/859: mknod d9/d14/d57/d95/d96/ddd/dfc/c11b 0 2024-09-12T22:11:30.317 INFO:tasks.workunit.client.0.smithi019.stdout:3/860: rmdir d18/d26/d30/d4e/d9a 39 2024-09-12T22:11:30.318 INFO:tasks.workunit.client.0.smithi019.stdout:2/774: write d0/d3/d11/d2e/d64/fb1 [4619869,31156] 0 2024-09-12T22:11:30.319 INFO:tasks.workunit.client.0.smithi019.stdout:3/861: fsync d18/f34 0 2024-09-12T22:11:30.319 INFO:tasks.workunit.client.0.smithi019.stdout:5/869: read d0/d1d/d6d/f94 [86920,71635] 0 2024-09-12T22:11:30.319 INFO:tasks.workunit.client.0.smithi019.stdout:1/856: dwrite d1/d2/d18/d35/d84/df8/d66/f8b [0,4194304] 0 2024-09-12T22:11:30.320 INFO:tasks.workunit.client.0.smithi019.stdout:4/860: mkdir d9/db/d2b/dc7/dd3/d11c 0 2024-09-12T22:11:30.320 INFO:tasks.workunit.client.0.smithi019.stdout:8/842: read d5/d16/d19/d29/f38 [1025139,93500] 0 2024-09-12T22:11:30.322 INFO:tasks.workunit.client.0.smithi019.stdout:3/862: unlink d18/d1d/d8b/dc5/cb2 0 2024-09-12T22:11:30.322 INFO:tasks.workunit.client.0.smithi019.stdout:9/861: dread d12/d1b/d20/f2a [0,4194304] 0 2024-09-12T22:11:30.324 INFO:tasks.workunit.client.0.smithi019.stdout:5/870: chown d0/d26/d6f/ce6 27448716 1 2024-09-12T22:11:30.324 INFO:tasks.workunit.client.0.smithi019.stdout:6/976: dwrite d9/dc/d20/d30/d5b/fe3 [0,4194304] 0 2024-09-12T22:11:30.324 INFO:tasks.workunit.client.0.smithi019.stdout:0/829: dwrite d5/d7/d2c/d44/f97 [0,4194304] 0 2024-09-12T22:11:30.325 INFO:tasks.workunit.client.0.smithi019.stdout:3/863: fdatasync d18/d26/d30/d4e/f52 0 2024-09-12T22:11:30.326 INFO:tasks.workunit.client.0.smithi019.stdout:5/871: readlink d0/d26/d5f/l80 0 2024-09-12T22:11:30.327 INFO:tasks.workunit.client.0.smithi019.stdout:7/806: dread da/d19/d25/d39/fa0 [0,4194304] 0 2024-09-12T22:11:30.327 INFO:tasks.workunit.client.0.smithi019.stdout:1/857: truncate d1/d2/d18/d35/d84/dc/df/d2c/fd2 4925791 0 2024-09-12T22:11:30.328 INFO:tasks.workunit.client.0.smithi019.stdout:0/830: symlink d5/d7/de/l112 0 2024-09-12T22:11:30.328 INFO:tasks.workunit.client.0.smithi019.stdout:3/864: mkdir d18/d1d/d8b/dc5/d105 0 2024-09-12T22:11:30.330 INFO:tasks.workunit.client.0.smithi019.stdout:7/807: mknod da/d19/d79/c112 0 2024-09-12T22:11:30.330 INFO:tasks.workunit.client.0.smithi019.stdout:0/831: symlink d5/d7/d2c/l113 0 2024-09-12T22:11:30.331 INFO:tasks.workunit.client.0.smithi019.stdout:1/858: write d1/d37/ff4 [880203,18239] 0 2024-09-12T22:11:30.331 INFO:tasks.workunit.client.0.smithi019.stdout:6/977: truncate d9/f22 1924799 0 2024-09-12T22:11:30.332 INFO:tasks.workunit.client.0.smithi019.stdout:3/865: mknod d18/d26/dce/c106 0 2024-09-12T22:11:30.333 INFO:tasks.workunit.client.0.smithi019.stdout:7/808: fdatasync da/d19/f88 0 2024-09-12T22:11:30.335 INFO:tasks.workunit.client.0.smithi019.stdout:1/859: chown d1/f14 23158 1 2024-09-12T22:11:30.337 INFO:tasks.workunit.client.0.smithi019.stdout:0/832: mknod d5/d7/d10/d26/d2a/d94/de6/c114 0 2024-09-12T22:11:30.337 INFO:tasks.workunit.client.0.smithi019.stdout:4/861: dwrite d9/d4c/d76/dc9/df0/fd0 [0,4194304] 0 2024-09-12T22:11:30.337 INFO:tasks.workunit.client.0.smithi019.stdout:9/862: dwrite d12/d1b/d40/f6f [0,4194304] 0 2024-09-12T22:11:30.337 INFO:tasks.workunit.client.0.smithi019.stdout:6/978: creat d9/d3d/d4f/d59/d79/dfc/f143 x:0 0 0 2024-09-12T22:11:30.338 INFO:tasks.workunit.client.0.smithi019.stdout:1/860: unlink d1/d37/leb 0 2024-09-12T22:11:30.338 INFO:tasks.workunit.client.0.smithi019.stdout:5/872: dwrite d0/d1d/d3d/f55 [0,4194304] 0 2024-09-12T22:11:30.338 INFO:tasks.workunit.client.0.smithi019.stdout:8/843: dwrite d5/dc/d26/d4b/d101/f108 [0,4194304] 0 2024-09-12T22:11:30.339 INFO:tasks.workunit.client.0.smithi019.stdout:7/809: fdatasync da/d19/d25/d39/d51/dd7/db1/db5/db6/db8/fe5 0 2024-09-12T22:11:30.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/863: stat d12/dd7/dc7/d74/d77/d86/dbd/lc4 0 2024-09-12T22:11:30.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/864: chown d12/d1b/d20/d64/d83/faf 1502 1 2024-09-12T22:11:30.342 INFO:tasks.workunit.client.0.smithi019.stdout:3/866: symlink d18/d26/da5/dbd/l107 0 2024-09-12T22:11:30.342 INFO:tasks.workunit.client.0.smithi019.stdout:8/844: creat d5/dc/d26/d4b/df5/f119 x:0 0 0 2024-09-12T22:11:30.342 INFO:tasks.workunit.client.0.smithi019.stdout:6/979: rename d9/dc/d20/d4b/d7a to d9/dc/d122/d144 0 2024-09-12T22:11:30.342 INFO:tasks.workunit.client.0.smithi019.stdout:7/810: dread - da/f76 zero size 2024-09-12T22:11:30.343 INFO:tasks.workunit.client.0.smithi019.stdout:0/833: mkdir d5/d7/d2c/d44/d6a/d115 0 2024-09-12T22:11:30.344 INFO:tasks.workunit.client.0.smithi019.stdout:8/845: write d5/dc/d26/d4b/f91 [5168892,128083] 0 2024-09-12T22:11:30.345 INFO:tasks.workunit.client.0.smithi019.stdout:1/861: symlink d1/da1/l11a 0 2024-09-12T22:11:30.345 INFO:tasks.workunit.client.0.smithi019.stdout:3/867: creat d18/d1d/d8b/dc5/dbb/df1/f108 x:0 0 0 2024-09-12T22:11:30.345 INFO:tasks.workunit.client.0.smithi019.stdout:4/862: getdents d9/d14/d33 0 2024-09-12T22:11:30.345 INFO:tasks.workunit.client.0.smithi019.stdout:6/980: mkdir d9/d145 0 2024-09-12T22:11:30.346 INFO:tasks.workunit.client.0.smithi019.stdout:7/811: symlink da/d24/d28/d1c/d32/d99/dc8/df4/l113 0 2024-09-12T22:11:30.346 INFO:tasks.workunit.client.0.smithi019.stdout:0/834: mkdir d5/d7/d10/d116 0 2024-09-12T22:11:30.346 INFO:tasks.workunit.client.0.smithi019.stdout:5/873: dwrite d0/d26/d42/f11a [0,4194304] 0 2024-09-12T22:11:30.347 INFO:tasks.workunit.client.0.smithi019.stdout:7/812: mknod da/c114 0 2024-09-12T22:11:30.347 INFO:tasks.workunit.client.0.smithi019.stdout:8/846: write d5/dc/d8d/d96/fed [304763,12729] 0 2024-09-12T22:11:30.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/981: creat d9/d3d/d4f/d59/d79/dfc/f146 x:0 0 0 2024-09-12T22:11:30.350 INFO:tasks.workunit.client.0.smithi019.stdout:9/865: read d12/dd7/dc7/fc2 [1651984,79910] 0 2024-09-12T22:11:30.351 INFO:tasks.workunit.client.0.smithi019.stdout:3/868: truncate d18/d26/d30/d4a/f92 850602 0 2024-09-12T22:11:30.351 INFO:tasks.workunit.client.0.smithi019.stdout:7/813: stat da/d19/d25/d39/d51/l93 0 2024-09-12T22:11:30.351 INFO:tasks.workunit.client.0.smithi019.stdout:4/863: getdents d9/d14/d57/d95/d96 0 2024-09-12T22:11:30.351 INFO:tasks.workunit.client.0.smithi019.stdout:8/847: symlink d5/d16/d19/d29/l11a 0 2024-09-12T22:11:30.352 INFO:tasks.workunit.client.0.smithi019.stdout:5/874: truncate d0/d1d/d4f/d47/d57/fc0 812512 0 2024-09-12T22:11:30.352 INFO:tasks.workunit.client.0.smithi019.stdout:3/869: fsync d18/d1d/d35/f49 0 2024-09-12T22:11:30.353 INFO:tasks.workunit.client.0.smithi019.stdout:4/864: truncate f7 756988 0 2024-09-12T22:11:30.353 INFO:tasks.workunit.client.0.smithi019.stdout:1/862: write d1/d2/d18/d35/d84/dc/fc9 [2163851,46115] 0 2024-09-12T22:11:30.354 INFO:tasks.workunit.client.0.smithi019.stdout:7/814: creat da/d19/d25/d39/d51/df8/f115 x:0 0 0 2024-09-12T22:11:30.354 INFO:tasks.workunit.client.0.smithi019.stdout:9/866: fdatasync d12/d1b/d40/d52/fb8 0 2024-09-12T22:11:30.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/982: getdents d9/dc/d20/d30/d5b 0 2024-09-12T22:11:30.355 INFO:tasks.workunit.client.0.smithi019.stdout:5/875: rmdir d0/d26/d6f/d107/d10a 39 2024-09-12T22:11:30.355 INFO:tasks.workunit.client.0.smithi019.stdout:3/870: creat d18/d26/d30/d71/d86/f109 x:0 0 0 2024-09-12T22:11:30.355 INFO:tasks.workunit.client.0.smithi019.stdout:7/815: mkdir da/d24/dff/d116 0 2024-09-12T22:11:30.356 INFO:tasks.workunit.client.0.smithi019.stdout:9/867: mknod d12/d1b/c128 0 2024-09-12T22:11:30.357 INFO:tasks.workunit.client.0.smithi019.stdout:1/863: write d1/d2/d18/d35/d84/dc/f69 [1709187,85918] 0 2024-09-12T22:11:30.357 INFO:tasks.workunit.client.0.smithi019.stdout:5/876: readlink d0/d24/d97/l106 0 2024-09-12T22:11:30.357 INFO:tasks.workunit.client.0.smithi019.stdout:3/871: dread - d18/d26/d30/d71/fd1 zero size 2024-09-12T22:11:30.358 INFO:tasks.workunit.client.0.smithi019.stdout:9/868: readlink d12/d1b/l27 0 2024-09-12T22:11:30.358 INFO:tasks.workunit.client.0.smithi019.stdout:7/816: write da/d30/da5/fec [700962,17974] 0 2024-09-12T22:11:30.359 INFO:tasks.workunit.client.0.smithi019.stdout:0/835: dread d5/d7/d10/d26/f9e [0,4194304] 0 2024-09-12T22:11:30.359 INFO:tasks.workunit.client.0.smithi019.stdout:8/848: dwrite d5/fe8 [0,4194304] 0 2024-09-12T22:11:30.361 INFO:tasks.workunit.client.0.smithi019.stdout:2/775: dread d0/d31/fa3 [0,4194304] 0 2024-09-12T22:11:30.361 INFO:tasks.workunit.client.0.smithi019.stdout:1/864: dread - d1/d2/d18/d35/d84/dc/df/f107 zero size 2024-09-12T22:11:30.361 INFO:tasks.workunit.client.0.smithi019.stdout:5/877: dread - d0/d1d/d4f/d47/d57/d98/dd6/d111/f11b zero size 2024-09-12T22:11:30.361 INFO:tasks.workunit.client.0.smithi019.stdout:3/872: write d18/d1d/d8b/dc5/fec [161059,102493] 0 2024-09-12T22:11:30.364 INFO:tasks.workunit.client.0.smithi019.stdout:5/878: chown d0/f4 529270716 1 2024-09-12T22:11:30.364 INFO:tasks.workunit.client.0.smithi019.stdout:6/983: rename d9/dc/d20/d30/d5b/f5d to d9/d3d/d4f/d59/d79/dfc/f147 0 2024-09-12T22:11:30.364 INFO:tasks.workunit.client.0.smithi019.stdout:0/836: rmdir d5/d7/dac 39 2024-09-12T22:11:30.364 INFO:tasks.workunit.client.0.smithi019.stdout:4/865: dwrite d9/d58/f68 [0,4194304] 0 2024-09-12T22:11:30.364 INFO:tasks.workunit.client.0.smithi019.stdout:7/817: read da/d24/f2c [3593702,78491] 0 2024-09-12T22:11:30.365 INFO:tasks.workunit.client.0.smithi019.stdout:9/869: write d12/d1b/d20/f36 [6291791,91021] 0 2024-09-12T22:11:30.367 INFO:tasks.workunit.client.0.smithi019.stdout:5/879: creat d0/d26/d3a/f121 x:0 0 0 2024-09-12T22:11:30.367 INFO:tasks.workunit.client.0.smithi019.stdout:3/873: symlink d18/d26/d30/d4e/l10a 0 2024-09-12T22:11:30.368 INFO:tasks.workunit.client.0.smithi019.stdout:8/849: dwrite d5/f6 [0,4194304] 0 2024-09-12T22:11:30.368 INFO:tasks.workunit.client.0.smithi019.stdout:6/984: mknod d9/dc/d20/d4b/d6c/c148 0 2024-09-12T22:11:30.369 INFO:tasks.workunit.client.0.smithi019.stdout:5/880: write d0/d26/d42/fd0 [627669,14598] 0 2024-09-12T22:11:30.369 INFO:tasks.workunit.client.0.smithi019.stdout:9/870: creat d12/dd7/dc7/d92/dac/f129 x:0 0 0 2024-09-12T22:11:30.369 INFO:tasks.workunit.client.0.smithi019.stdout:2/776: dwrite d0/d31/d12/f17 [4194304,4194304] 0 2024-09-12T22:11:30.370 INFO:tasks.workunit.client.0.smithi019.stdout:7/818: link da/d19/d25/d39/d51/f75 da/d30/f117 0 2024-09-12T22:11:30.370 INFO:tasks.workunit.client.0.smithi019.stdout:1/865: write d1/d2/d18/d35/d84/dc/f32 [1910536,29221] 0 2024-09-12T22:11:30.370 INFO:tasks.workunit.client.0.smithi019.stdout:4/866: dread d9/db/d2b/f37 [0,4194304] 0 2024-09-12T22:11:30.371 INFO:tasks.workunit.client.0.smithi019.stdout:5/881: dread - d0/d24/d58/f8d zero size 2024-09-12T22:11:30.371 INFO:tasks.workunit.client.0.smithi019.stdout:7/819: sync 2024-09-12T22:11:30.371 INFO:tasks.workunit.client.0.smithi019.stdout:6/985: stat d9/d3d/d4f/d59/l92 0 2024-09-12T22:11:30.372 INFO:tasks.workunit.client.0.smithi019.stdout:0/837: symlink d5/d7/d2c/dc1/l117 0 2024-09-12T22:11:30.372 INFO:tasks.workunit.client.0.smithi019.stdout:3/874: rename d18/d1d/dad/ffe to d18/d26/da5/dbd/f10b 0 2024-09-12T22:11:30.372 INFO:tasks.workunit.client.0.smithi019.stdout:9/871: creat d12/d1b/d20/db0/f12a x:0 0 0 2024-09-12T22:11:30.374 INFO:tasks.workunit.client.0.smithi019.stdout:3/875: write d18/d1d/d8b/fc0 [898132,90061] 0 2024-09-12T22:11:30.375 INFO:tasks.workunit.client.0.smithi019.stdout:9/872: rmdir d12/d1b/d20/d59 39 2024-09-12T22:11:30.376 INFO:tasks.workunit.client.0.smithi019.stdout:7/820: creat da/d24/d28/f118 x:0 0 0 2024-09-12T22:11:30.376 INFO:tasks.workunit.client.0.smithi019.stdout:6/986: chown d9/d3d/db8/f107 0 1 2024-09-12T22:11:30.376 INFO:tasks.workunit.client.0.smithi019.stdout:3/876: chown d18/d26/d30/d4e/c55 271231 1 2024-09-12T22:11:30.376 INFO:tasks.workunit.client.0.smithi019.stdout:1/866: rmdir d1/d2/d18/d35/d84/dc/df/d2c/d5d 39 2024-09-12T22:11:30.377 INFO:tasks.workunit.client.0.smithi019.stdout:4/867: getdents d9/d14/d57/d95/dbe/dc6 0 2024-09-12T22:11:30.380 INFO:tasks.workunit.client.0.smithi019.stdout:5/882: dwrite d0/d1d/d4f/ff7 [0,4194304] 0 2024-09-12T22:11:30.380 INFO:tasks.workunit.client.0.smithi019.stdout:0/838: dwrite d5/d7/d2c/d44/d6a/d52/fe1 [0,4194304] 0 2024-09-12T22:11:30.382 INFO:tasks.workunit.client.0.smithi019.stdout:4/868: chown d9/d14/d57/d95/dbe/dc6/deb/lf6 216459 1 2024-09-12T22:11:30.384 INFO:tasks.workunit.client.0.smithi019.stdout:0/839: mkdir d5/d7/d10/d116/d118 0 2024-09-12T22:11:30.385 INFO:tasks.workunit.client.0.smithi019.stdout:7/821: dwrite da/f11 [0,4194304] 0 2024-09-12T22:11:30.385 INFO:tasks.workunit.client.0.smithi019.stdout:6/987: dwrite d9/dc/d20/f2e [0,4194304] 0 2024-09-12T22:11:30.385 INFO:tasks.workunit.client.0.smithi019.stdout:3/877: truncate d18/d1d/d8b/fa3 405883 0 2024-09-12T22:11:30.385 INFO:tasks.workunit.client.0.smithi019.stdout:5/883: write d0/d1d/d4f/d47/d57/dba/f10c [97539,111854] 0 2024-09-12T22:11:30.386 INFO:tasks.workunit.client.0.smithi019.stdout:4/869: chown d9/d14/d57/d95/dbe/dc6/c41 129116731 1 2024-09-12T22:11:30.387 INFO:tasks.workunit.client.0.smithi019.stdout:3/878: read d18/d26/d30/d4a/f62 [3495864,110651] 0 2024-09-12T22:11:30.387 INFO:tasks.workunit.client.0.smithi019.stdout:5/884: chown d0/d1d/d4f/d47/d57/dba/cf4 3 1 2024-09-12T22:11:30.389 INFO:tasks.workunit.client.0.smithi019.stdout:4/870: creat d9/d14/d33/d4e/d66/f11d x:0 0 0 2024-09-12T22:11:30.390 INFO:tasks.workunit.client.0.smithi019.stdout:7/822: getdents da/d24/d28/d1c/dda 0 2024-09-12T22:11:30.390 INFO:tasks.workunit.client.0.smithi019.stdout:0/840: rmdir d5/d88/dea 39 2024-09-12T22:11:30.390 INFO:tasks.workunit.client.0.smithi019.stdout:5/885: stat d0/d1d/d4f/d96/fa9 0 2024-09-12T22:11:30.390 INFO:tasks.workunit.client.0.smithi019.stdout:3/879: chown d18/d26/d30/d4e/d80/la9 0 1 2024-09-12T22:11:30.390 INFO:tasks.workunit.client.0.smithi019.stdout:4/871: write d9/d14/d57/d95/d96/ddd/fea [585933,59335] 0 2024-09-12T22:11:30.391 INFO:tasks.workunit.client.0.smithi019.stdout:6/988: creat d9/dc/d20/d4b/d6c/dfe/f149 x:0 0 0 2024-09-12T22:11:30.391 INFO:tasks.workunit.client.0.smithi019.stdout:7/823: fdatasync da/d24/f2c 0 2024-09-12T22:11:30.392 INFO:tasks.workunit.client.0.smithi019.stdout:5/886: creat d0/d26/d5f/d117/f122 x:0 0 0 2024-09-12T22:11:30.392 INFO:tasks.workunit.client.0.smithi019.stdout:3/880: chown d18/c40 2590 1 2024-09-12T22:11:30.393 INFO:tasks.workunit.client.0.smithi019.stdout:7/824: creat da/d19/d25/d39/d51/f119 x:0 0 0 2024-09-12T22:11:30.394 INFO:tasks.workunit.client.0.smithi019.stdout:4/872: mknod d9/db/d2b/d6a/c11e 0 2024-09-12T22:11:30.394 INFO:tasks.workunit.client.0.smithi019.stdout:6/989: rename d9/dc/df7/d78/da1 to d9/d3d/d4f/d59/d79/de4/d125/d14a 0 2024-09-12T22:11:30.395 INFO:tasks.workunit.client.0.smithi019.stdout:5/887: creat d0/d26/d6f/d107/d100/f123 x:0 0 0 2024-09-12T22:11:30.395 INFO:tasks.workunit.client.0.smithi019.stdout:3/881: mknod d18/d26/dce/df6/c10c 0 2024-09-12T22:11:30.395 INFO:tasks.workunit.client.0.smithi019.stdout:7/825: mkdir da/d24/d28/d1c/d32/d99/d9f/d11a 0 2024-09-12T22:11:30.395 INFO:tasks.workunit.client.0.smithi019.stdout:4/873: rmdir d9/d14/d57/d95/d96 39 2024-09-12T22:11:30.395 INFO:tasks.workunit.client.0.smithi019.stdout:0/841: write d5/d7/d2c/d44/d6a/d46/f60 [2018916,110580] 0 2024-09-12T22:11:30.395 INFO:tasks.workunit.client.0.smithi019.stdout:6/990: creat d9/d3d/d4f/d59/d79/f14b x:0 0 0 2024-09-12T22:11:30.395 INFO:tasks.workunit.client.0.smithi019.stdout:5/888: mknod d0/d26/d5f/c124 0 2024-09-12T22:11:30.396 INFO:tasks.workunit.client.0.smithi019.stdout:7/826: unlink da/d19/d25/cc6 0 2024-09-12T22:11:30.397 INFO:tasks.workunit.client.0.smithi019.stdout:5/889: mkdir d0/d26/d6f/d107/d100/d125 0 2024-09-12T22:11:30.397 INFO:tasks.workunit.client.0.smithi019.stdout:4/874: getdents d9/d4c/d76/dc9 0 2024-09-12T22:11:30.397 INFO:tasks.workunit.client.0.smithi019.stdout:6/991: rename d9/dc/d20/d4b/fb3 to d9/d3d/d4f/d59/f14c 0 2024-09-12T22:11:30.397 INFO:tasks.workunit.client.0.smithi019.stdout:7/827: write da/d19/d79/f90 [1500922,5337] 0 2024-09-12T22:11:30.398 INFO:tasks.workunit.client.0.smithi019.stdout:5/890: unlink d0/d24/f116 0 2024-09-12T22:11:30.398 INFO:tasks.workunit.client.0.smithi019.stdout:5/891: sync 2024-09-12T22:11:30.398 INFO:tasks.workunit.client.0.smithi019.stdout:4/875: creat d9/d58/f11f x:0 0 0 2024-09-12T22:11:30.399 INFO:tasks.workunit.client.0.smithi019.stdout:5/892: readlink d0/d1d/d4f/lc8 0 2024-09-12T22:11:30.399 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:30.398+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:30.402 INFO:tasks.workunit.client.0.smithi019.stdout:7/828: symlink da/d19/d25/deb/l11b 0 2024-09-12T22:11:30.402 INFO:tasks.workunit.client.0.smithi019.stdout:5/893: fdatasync d0/d24/d58/f8d 0 2024-09-12T22:11:30.403 INFO:tasks.workunit.client.0.smithi019.stdout:9/873: dread d12/d1b/d20/d25/f4c [0,4194304] 0 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.681033116, 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.404 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:30.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:30.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:30.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:30.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:30.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:30.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:30.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:30.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:30.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:30.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:30.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:30.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:30.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:30.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:30.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:30.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.416 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:30.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:30.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.417 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.417 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:30.417 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:30.417 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.418 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.418 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.418 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:30.418 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:30.419 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.668970518, 2024-09-12T22:11:30.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:30.419 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.419 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.419 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.420 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.420 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.420 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.420 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:30.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.421 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.421 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.421 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:30.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.422 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.422 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:30.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:30.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:30.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.424 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:30.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:30.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.425 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.425 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:30.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:30.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:30.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:30.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:30.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:30.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:30.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:30.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:30.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:30.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:30.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:30.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:30.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:30.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:30.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:30.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:30.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:30.433 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.433 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.433 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.434 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5102 4.1b 4:d8bd0ea8:::100000017cc.00000000:head [write 0~1672] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:30.434 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:30.434 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.661065833, 2024-09-12T22:11:30.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024115083999999998, 2024-09-12T22:11:30.435 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.435 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.435 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.435 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.435 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.435 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.436 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5102 2024-09-12T22:11:30.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.436 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:30.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738916+0000", 2024-09-12T22:11:30.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738917+0000", 2024-09-12T22:11:30.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4099999999999997e-07 2024-09-12T22:11:30.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738922+0000", 2024-09-12T22:11:30.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1139999999999997e-06 2024-09-12T22:11:30.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738935+0000", 2024-09-12T22:11:30.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2700999999999999e-05 2024-09-12T22:11:30.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738944+0000", 2024-09-12T22:11:30.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6379999999999993e-06 2024-09-12T22:11:30.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.738994+0000", 2024-09-12T22:11:30.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0522000000000002e-05 2024-09-12T22:11:30.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.443 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.443 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739117+0000", 2024-09-12T22:11:30.443 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012277699999999999 2024-09-12T22:11:30.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.443 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.444 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.739243+0000", 2024-09-12T22:11:30.444 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012553999999999999 2024-09-12T22:11:30.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.741532+0000", 2024-09-12T22:11:30.445 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022895739999999999 2024-09-12T22:11:30.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.445 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762948+0000", 2024-09-12T22:11:30.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021415500000000001 2024-09-12T22:11:30.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762994+0000", 2024-09-12T22:11:30.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:11:30.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.763032+0000", 2024-09-12T22:11:30.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7469000000000003e-05 2024-09-12T22:11:30.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.448 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.449 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11071 4.c 4:3257e780:::1000000321f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.449 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:30.449 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1945009329999996, 2024-09-12T22:11:30.449 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024562179, 2024-09-12T22:11:30.449 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.450 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.450 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.450 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.450 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.450 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.451 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11071 2024-09-12T22:11:30.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.451 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.452 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:30.452 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:30.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.454 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.454 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205482+0000", 2024-09-12T22:11:30.454 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:11:30.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211316+0000", 2024-09-12T22:11:30.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058333539999999998 2024-09-12T22:11:30.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211327+0000", 2024-09-12T22:11:30.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1756000000000001e-05 2024-09-12T22:11:30.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.457 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211335+0000", 2024-09-12T22:11:30.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:11:30.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.457 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.458 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211385+0000", 2024-09-12T22:11:30.458 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0507999999999998e-05 2024-09-12T22:11:30.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.458 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.458 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211500+0000", 2024-09-12T22:11:30.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114472 2024-09-12T22:11:30.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211586+0000", 2024-09-12T22:11:30.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5820000000000002e-05 2024-09-12T22:11:30.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.460 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.460 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.215264+0000", 2024-09-12T22:11:30.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036782809999999998 2024-09-12T22:11:30.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.229982+0000", 2024-09-12T22:11:30.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014718498 2024-09-12T22:11:30.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230017+0000", 2024-09-12T22:11:30.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4430000000000001e-05 2024-09-12T22:11:30.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230044+0000", 2024-09-12T22:11:30.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6653999999999999e-05 2024-09-12T22:11:30.463 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.463 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.463 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.464 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11111 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304 [3@848846]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.464 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:30.464 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1279139120000004, 2024-09-12T22:11:30.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034033252999999999, 2024-09-12T22:11:30.465 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.465 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.465 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.465 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.465 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.465 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.466 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11111 2024-09-12T22:11:30.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.466 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:30.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:30.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272069+0000", 2024-09-12T22:11:30.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:11:30.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278159+0000", 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060894690000000001 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278172+0000", 2024-09-12T22:11:30.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3237999999999999e-05 2024-09-12T22:11:30.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278179+0000", 2024-09-12T22:11:30.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0450000000000003e-06 2024-09-12T22:11:30.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278240+0000", 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1273999999999996e-05 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278306+0000", 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6315000000000005e-05 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278428+0000", 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000121364 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.282607+0000", 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041791090000000003 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.305959+0000", 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023352435000000001 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306015+0000", 2024-09-12T22:11:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5794000000000001e-05 2024-09-12T22:11:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306102+0000", 2024-09-12T22:11:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6508999999999995e-05 2024-09-12T22:11:30.475 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.475 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.475 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.475 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11122 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304 [2@1285126]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.476 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:30.476 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1106476320000001, 2024-09-12T22:11:30.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026237979000000002, 2024-09-12T22:11:30.476 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.476 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.476 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.477 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.477 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.477 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.477 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11122 2024-09-12T22:11:30.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.477 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:30.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:30.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289336+0000", 2024-09-12T22:11:30.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:11:30.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296646+0000", 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073105109999999996 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296658+0000", 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1525000000000001e-05 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296663+0000", 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4210000000000003e-06 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296738+0000", 2024-09-12T22:11:30.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4574999999999997e-05 2024-09-12T22:11:30.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296806+0000", 2024-09-12T22:11:30.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8424999999999996e-05 2024-09-12T22:11:30.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296901+0000", 2024-09-12T22:11:30.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4530999999999993e-05 2024-09-12T22:11:30.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.300955+0000", 2024-09-12T22:11:30.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040546649999999998 2024-09-12T22:11:30.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315478+0000", 2024-09-12T22:11:30.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014523213 2024-09-12T22:11:30.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315532+0000", 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3928000000000003e-05 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315573+0000", 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0250000000000003e-05 2024-09-12T22:11:30.486 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11421 4.1b 4:db3ef485:::100000031c2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.717539119, 2024-09-12T22:11:30.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024994136, 2024-09-12T22:11:30.488 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.488 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.488 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.488 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.488 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.488 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.488 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11421 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:30.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682444+0000", 2024-09-12T22:11:30.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:11:30.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690408+0000", 2024-09-12T22:11:30.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079646000000000005 2024-09-12T22:11:30.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690418+0000", 2024-09-12T22:11:30.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3889999999999994e-06 2024-09-12T22:11:30.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690423+0000", 2024-09-12T22:11:30.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5430000000000001e-06 2024-09-12T22:11:30.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690480+0000", 2024-09-12T22:11:30.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6477999999999997e-05 2024-09-12T22:11:30.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690565+0000", 2024-09-12T22:11:30.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690686+0000", 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012097899999999999 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.698289+0000", 2024-09-12T22:11:30.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076032239999999996 2024-09-12T22:11:30.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707338+0000", 2024-09-12T22:11:30.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090485210000000003 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707398+0000", 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9670000000000003e-05 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707437+0000", 2024-09-12T22:11:30.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9780000000000002e-05 2024-09-12T22:11:30.498 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.498 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.498 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.499 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11476 4.20 4:073157f6:::10000003181.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.499 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:30.499 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.6431447459999999, 2024-09-12T22:11:30.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024885865, 2024-09-12T22:11:30.499 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.499 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.500 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.500 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.500 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.500 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.500 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11476 2024-09-12T22:11:30.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756839+0000", 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.147e-06 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762627+0000", 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057881499999999997 2024-09-12T22:11:30.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762655+0000", 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8581999999999998e-05 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762668+0000", 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2829e-05 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762764+0000", 2024-09-12T22:11:30.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5867999999999998e-05 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762841+0000", 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7348999999999994e-05 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762936+0000", 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4968000000000003e-05 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.771619+0000", 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0086823079999999997 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781553+0000", 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099340929999999997 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781615+0000", 2024-09-12T22:11:30.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1680999999999994e-05 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781723+0000", 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010889 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:30.506 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.439378531, 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:30.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11632 4.18 4:1bddbeb1:::1000000315c.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.4277909919999998, 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035921586999999998, 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:30.515 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11632 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972192+0000", 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.012e-06 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972197+0000", 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:11:30.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972209+0000", 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1968e-05 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972217+0000", 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972263+0000", 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6477000000000002e-05 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972320+0000", 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7003999999999998e-05 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008113+0000", 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035792455000000001 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.519 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11633 4.1b 4:db3ef485:::100000031c2.00000000:head [read 131072~131072 [2@2632009]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.4262856949999998, 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034773432, 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.520 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11633 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7400000000000002e-07 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973701+0000", 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007401+0000", 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033700059999999997 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5108000000000001e-05 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007507+0000", 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0133e-05 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000102818 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008470+0000", 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086063800000000005 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.422854767, 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:30.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:30.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:30.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:30.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:30.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:30.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:30.530 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.531 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.531 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.531 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11636 4.38 4:1f03a657:::10000003181.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:30.531 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.3923657440000001, 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026771987000000001, 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.532 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11636 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017190+0000", 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095727360000000001 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017205+0000", 2024-09-12T22:11:30.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4758e-05 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017213+0000", 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6549999999999993e-06 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022810+0000", 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055969770000000004 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022856+0000", 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5136999999999998e-05 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022927+0000", 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1118999999999995e-05 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034260+0000", 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011333009999999999 2024-09-12T22:11:30.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034309+0000", 2024-09-12T22:11:30.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9605999999999999e-05 2024-09-12T22:11:30.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034349+0000", 2024-09-12T22:11:30.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9742e-05 2024-09-12T22:11:30.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034389+0000", 2024-09-12T22:11:30.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9505000000000002e-05 2024-09-12T22:11:30.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.539 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.540 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13875 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.540 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:30.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.0668951719999999, 2024-09-12T22:11:30.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027048843999999999, 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13875 2024-09-12T22:11:30.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333088+0000", 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.16e-07 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338344+0000", 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052561609999999996 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338362+0000", 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8306000000000001e-05 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338377+0000", 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4154e-05 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338464+0000", 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7410000000000005e-05 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338582+0000", 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000117928 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338690+0000", 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010781 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.342821+0000", 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041308919999999997 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360022+0000", 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017201675999999999 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360059+0000", 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6777999999999999e-05 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360136+0000", 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6812999999999998e-05 2024-09-12T22:11:30.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13961 4.30 4:0c2552b5:::10000003501.00000000:head [write 0~4194304 [2@434191]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.96265403199999999, 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030398076999999999, 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.547 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13961 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437329+0000", 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443713+0000", 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063844100000000001 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443726+0000", 2024-09-12T22:11:30.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2371000000000001e-05 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443731+0000", 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.271e-06 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443812+0000", 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1036000000000001e-05 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443881+0000", 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8749000000000002e-05 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.444133+0000", 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00025271700000000001 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.450353+0000", 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062195430000000001 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467617+0000", 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017263849000000001 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467678+0000", 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0714999999999997e-05 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467726+0000", 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8749999999999999e-05 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13999 4.18 4:18e6495a:::1000000353a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.92266725999999999, 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027586513999999999, 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.553 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13999 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477316+0000", 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.33e-06 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482742+0000", 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054256349999999998 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482752+0000", 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0071999999999999e-05 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482758+0000", 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482803+0000", 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5229999999999999e-05 2024-09-12T22:11:30.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482932+0000", 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012920799999999999 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.483074+0000", 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014124100000000001 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.487006+0000", 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039324210000000002 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504821+0000", 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017814673999999999 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504861+0000", 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0822000000000003e-05 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504902+0000", 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0113e-05 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14158 4.3c 4:3f94d4c3:::100000034d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.72986131600000004, 2024-09-12T22:11:30.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030683077, 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14158 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:30.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670122+0000", 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.677995+0000", 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078731040000000006 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678008+0000", 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3736e-05 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678018+0000", 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1749999999999994e-06 2024-09-12T22:11:30.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678127+0000", 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010953100000000001 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678196+0000", 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8594000000000001e-05 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678331+0000", 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013488700000000001 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.682561+0000", 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042304839999999996 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700726+0000", 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018165369000000001 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700770+0000", 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3373e-05 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700804+0000", 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4199999999999998e-05 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.565 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14223 4.2b 4:d78f40a6:::100000033bb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.66462566899999997, 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030308063999999999, 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14223 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.566 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741431+0000", 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060735420000000004 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741440+0000", 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2050000000000008e-06 2024-09-12T22:11:30.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741445+0000", 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.476e-06 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741529+0000", 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4608e-05 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741582+0000", 2024-09-12T22:11:30.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3211999999999998e-05 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741662+0000", 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9062999999999998e-05 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.745183+0000", 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035216850000000001 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765556+0000", 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020372946999999999 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765622+0000", 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5905e-05 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765665+0000", 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2583999999999998e-05 2024-09-12T22:11:30.571 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14413 4.2b 4:d6419bd1:::10000003797.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.956812+0000", 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.443170334, 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024322597000000001, 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.572 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14413 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.956812+0000", 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.956812+0000", 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.956813+0000", 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.297e-06 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.963144+0000", 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063303439999999999 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.963166+0000", 2024-09-12T22:11:30.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2595e-05 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.963178+0000", 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1829e-05 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.963245+0000", 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6520999999999995e-05 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.963365+0000", 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000120389 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.963478+0000", 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113084 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.970198+0000", 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067197680000000001 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.981046+0000", 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010848576 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.981100+0000", 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3755000000000003e-05 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.981135+0000", 2024-09-12T22:11:30.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4439e-05 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14709 4.5 4:a18ffc61:::10000003599.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.228614+0000", 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.171368674, 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024165942999999999, 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:30.578 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14709 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.228614+0000", 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.228614+0000", 2024-09-12T22:11:30.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.228614+0000", 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2099999999999995e-07 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.236860+0000", 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0082451550000000005 2024-09-12T22:11:30.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.236873+0000", 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3276e-05 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.236889+0000", 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6294999999999999e-05 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:30.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.236941+0000", 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2123000000000002e-05 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.237007+0000", 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5242999999999999e-05 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.252690+0000", 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015683936999999998 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.252727+0000", 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6600999999999997e-05 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.252780+0000", 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2491999999999998e-05 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:30.584 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:30.584 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:30.584 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:11:30.586 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:30.584+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:30.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:7/829: creat da/d19/d25/d39/d51/dd7/db1/db5/db6/db8/f11c x:0 0 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:0/842: dread d5/d7/d10/d26/d2a/d94/fab [0,4194304] 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:9/874: link d12/d1b/c33 d12/c12b 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:6/992: dwrite d9/d3d/d6f/fbd [0,4194304] 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:0/843: chown d5/d7/d10/d26/d2a/c6c 156498 1 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:9/875: write ff [1960402,73986] 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:4/876: dwrite d9/d4c/d76/dc9/fe8 [0,4194304] 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:1/867: dread d1/d2/d18/d35/d84/dc/df/f74 [0,4194304] 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:5/894: truncate d0/d26/d3a/f68 512924 0 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:5/895: chown d0/d24/l93 2044340 1 2024-09-12T22:11:30.619 INFO:tasks.workunit.client.0.smithi019.stdout:7/830: dwrite da/d8f/fb4 [0,4194304] 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:8/850: dread d5/dc/d26/f36 [0,4194304] 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:0/844: unlink d5/d7/d2c/d44/cc6 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:9/876: chown d12/dd7/ce0 651 1 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:7/831: chown da/d24/l81 36618224 1 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:4/877: symlink d9/d14/d57/l120 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:2/777: dread d0/d3/d11/d2e/d64/fb1 [0,4194304] 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:6/993: dwrite d9/dc/df7/f104 [0,4194304] 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:1/868: symlink d1/d2/d18/d35/d84/df8/d55/l11b 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:5/896: rename d0/d26/d5f/dc3/leb to d0/d1d/d4f/d47/d57/d98/l126 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:9/877: mknod d12/d1b/d20/da0/c12c 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:0/845: mknod d5/d88/dea/c119 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:1/869: write d1/ddb/ff0 [636052,14376] 0 2024-09-12T22:11:30.620 INFO:tasks.workunit.client.0.smithi019.stdout:4/878: symlink d9/d4c/d76/l121 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:8/851: rename d5/dc/d8d/dcb to d5/dc/d26/d76/d10e/d11b 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:7/832: unlink da/d24/l4f 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:6/994: mkdir d9/dc/d20/d4b/d6c/dfe/d14d 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:0/846: write d5/d7/d10/fee [731124,100676] 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:1/870: fsync d1/d2/d18/d35/fda 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:2/778: write d0/d3/d11/d77/d78/d2c/d30/d32/de5/f90 [556008,54257] 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:8/852: mknod d5/dc/d26/d76/d10e/c11c 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:4/879: creat d9/db/d2b/dc7/dd3/f122 x:0 0 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:9/878: getdents d12/dd7/dc7/d92/d9d/da5 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:0/847: mknod d5/d7/d10/d116/d118/c11a 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:8/853: mkdir d5/dc/d26/d43/d49/d7a/df8/d11d 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:2/779: getdents d0/d3/d21 0 2024-09-12T22:11:30.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/897: dwrite d0/f17 [0,4194304] 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:1/871: read d1/d2/d18/d29/f112 [1375370,117053] 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:4/880: getdents d9/d14/d57/d95 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:9/879: truncate d12/d1b/d40/d52/d62/de7/f117 241101 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/854: write d5/dc/d26/d76/d10e/d11b/fe1 [189171,95681] 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:5/898: chown d0/d26/d42/df0 10 1 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:3/882: dread d18/d1d/f3f [0,4194304] 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:6/995: dwrite d9/dc/f15 [0,4194304] 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:4/881: symlink d9/d14/d57/d95/d96/ddd/l123 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:1/872: chown d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/f118 2052456186 1 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:9/880: creat d12/dd7/dc7/d74/d77/d86/ddf/f12d x:0 0 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:4/882: stat d9/d14/d57/d95/d96/ddd/cde 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:1/873: mknod d1/d2/d18/d35/d84/d98/dbc/c11c 0 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:4/883: sync 2024-09-12T22:11:30.622 INFO:tasks.workunit.client.0.smithi019.stdout:9/881: write d12/fe1 [910459,24416] 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:1/874: mkdir d1/d2/d18/d35/d84/dc/df/d11d 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:8/855: dread d5/dc/d26/d4b/fb8 [0,4194304] 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:6/996: dwrite d9/d3d/d4f/fad [0,4194304] 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:2/780: dwrite d0/d3/df/d7b/fa1 [0,4194304] 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:9/882: symlink d12/dd7/dc7/d56/df5/l12e 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:7/833: dread da/d24/d28/fe4 [0,4194304] 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:3/883: dwrite d18/d1d/d8b/dc5/dbb/fd7 [0,4194304] 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:8/856: chown d5/dc/d26/d4b/c5d 1608 1 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:4/884: getdents d9/db/d2b/de0 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:1/875: chown d1/d2/d18/d35/d84/df8/d55/faa 775215 1 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:6/997: chown d9/d3d/d4f/c13a 4027 1 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:8/857: fsync d5/dc/d8a/d98/f117 0 2024-09-12T22:11:30.623 INFO:tasks.workunit.client.0.smithi019.stdout:3/884: write d18/d26/fd3 [741088,101600] 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:2/781: mknod d0/d3/d11/d2e/c103 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:7/834: mknod da/d24/d28/d1c/d32/df0/dfc/c11d 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:4/885: write d9/db/d2b/f37 [839102,72792] 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:8/858: chown d5/dc/d26/d43/d49/d92/fb6 982 1 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:2/782: write d0/d31/d4/fef [1028754,71593] 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:9/883: link d12/d1b/d20/d59/d5b/d9a/cd6 d12/d1b/d40/d85/de8/c12f 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:9/884: sync 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:3/885: rename d18/d26/d30/d64/f7f to d18/d26/d30/d71/d86/f10d 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:4/886: creat d9/d4c/d76/df2/d110/f124 x:0 0 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:7/835: getdents da/d24/d28/d1c/d32/d99/dc8/df4 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:6/998: truncate d9/dc/dd9/fee 3063602 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:3/886: mknod d18/d1d/d8b/dc5/c10e 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:7/836: mkdir da/d24/dff/d11e 0 2024-09-12T22:11:30.624 INFO:tasks.workunit.client.0.smithi019.stdout:3/887: rename d18/l77 to d18/d1d/d35/ded/l10f 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:7/837: symlink da/d24/dff/d11e/l11f 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:2/783: truncate d0/d3/d11/f8a 1249301 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:3/888: stat d18/d26/d30/d4e/fdd 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:6/999: rename d9/d3d/d4f/d59/d79/de4/d125/d14a to d9/dc/d20/d30/d14e 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:3/889: dread - d18/d26/d30/d4e/fc7 zero size 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:0/848: dread d5/d7/d10/d26/d2a/f2b [4194304,4194304] 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:1/876: dread d1/d2/d18/d35/d84/dc/df/f9e [0,4194304] 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:2/784: rename d0/d3/d11/d2e/d64/f79 to d0/d3/df/d7b/d44/de9/f104 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:1/877: stat d1/c73 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:0/849: creat d5/d7/d2c/f11b x:0 0 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:3/890: rmdir d18/d26/dce/df6/dfc 0 2024-09-12T22:11:30.625 INFO:tasks.workunit.client.0.smithi019.stdout:4/887: dread d9/d14/d57/d95/d96/ddd/fea [0,4194304] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:8/859: dread d5/d16/d19/d29/f38 [0,4194304] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:2/785: mknod d0/d3/d11/d2e/d70/c105 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:9/885: dread d12/d1b/d40/d85/d10f/f11a [0,4194304] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:3/891: write d18/f97 [2074587,87997] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:0/850: stat d5/d7/d10/d116/d118/c11a 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:7/838: dwrite da/d24/d28/f57 [0,4194304] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:1/878: mkdir d1/d2/d18/d35/d84/df8/d11e 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:5/899: dread d0/d26/d42/fb2 [0,4194304] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:2/786: chown d0/d3/d11/d77/d78/d2c/d56/dec 2923 1 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:8/860: read d5/dc/d26/d43/f4c [674824,54318] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:4/888: write d9/d4c/d76/dc9/df0/de2/f114 [5100237,36420] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:7/839: mkdir da/d19/d79/d120 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:9/886: write d12/dd7/dc7/d74/d77/fcc [5141070,30995] 0 2024-09-12T22:11:30.626 INFO:tasks.workunit.client.0.smithi019.stdout:3/892: write d18/d1d/d35/f49 [2907119,16081] 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:0/851: creat d5/d7/dac/db6/f11c x:0 0 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:5/900: creat d0/d26/d42/f127 x:0 0 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:4/889: chown d9/d4c/d76/dc9/fe8 17375 1 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:2/787: write d0/d3/d11/d2e/d64/dce/d51/f89 [317747,94853] 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:9/887: symlink d12/d1b/d40/d52/d62/l130 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:7/840: creat da/d24/d28/d1c/d32/df0/f121 x:0 0 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:1/879: getdents d1/d2/d18/d29 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:2/788: mkdir d0/d3/d11/d106 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:0/852: write d5/d7/de/d9a/fa5 [7806392,80966] 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:3/893: creat d18/d26/d30/d4e/d9a/dd5/f110 x:0 0 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:4/890: dread d9/db/d2b/de0/fab [0,4194304] 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:9/888: symlink d12/dd7/dc7/d74/d77/l131 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:8/861: dwrite d5/dc/f5f [0,4194304] 0 2024-09-12T22:11:30.627 INFO:tasks.workunit.client.0.smithi019.stdout:1/880: creat d1/d2/d18/f11f x:0 0 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:5/901: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:8/862: write d5/d16/ffd [362065,35908] 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:7/841: getdents da/d19/d25/deb 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:2/789: truncate d0/d3/d11/d77/d78/d2c/d30/fdb 665995 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:4/891: rename d9/db/d2b/d6a/l9f to d9/d17/l125 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:0/853: truncate d5/d7/d2c/d44/d6a/d76/fc2 913893 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/881: creat d1/d83/f120 x:0 0 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:7/842: fsync da/d30/f117 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:9/889: rename d12/d1b/f32 to d12/d1b/d20/d64/d83/dd1/f132 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:0/854: dread - d5/d7/d2c/f11b zero size 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:4/892: creat d9/db/d2b/dc7/f126 x:0 0 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:3/894: dwrite d18/f1b [0,4194304] 0 2024-09-12T22:11:30.628 INFO:tasks.workunit.client.0.smithi019.stdout:9/890: stat d12/d1b/d40/c73 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:1/882: fdatasync d1/d2/d18/d35/d84/fb3 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:0/855: rmdir d5/d7 39 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:1/883: rmdir d1/d2/d18/d59 39 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:9/891: chown d12/dd7/dc7/d74/d77/l9b 9 1 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:5/902: dwrite d0/d1d/d3d/ff1 [0,4194304] 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:2/790: dwrite d0/d3/df/d7b/d44/de9/ffe [0,4194304] 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:8/863: dwrite d5/dc/d26/d43/d7d/ffe [0,4194304] 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:4/893: rename d9/d14/d33/d4e/c52 to d9/d14/d57/d95/c127 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:1/884: write d1/d2/d18/f11f [679881,70019] 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:5/903: mkdir d0/d1d/d3d/d128 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:0/856: write d5/d7/d10/d26/d2a/d94/fab [965101,76077] 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:4/894: mkdir d9/db/d2b/dc7/d128 0 2024-09-12T22:11:30.629 INFO:tasks.workunit.client.0.smithi019.stdout:8/864: fdatasync d5/dc/d26/d4b/f111 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/843: dwrite da/d19/d25/d39/d51/f6c [0,4194304] 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:4/895: truncate f7 1306675 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:1/885: mkdir d1/d2/d18/d35/d84/d121 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:0/857: rename d5/d7/d2c/d44/d6a/d52/f7c to d5/d7/d2c/d44/d6a/d46/f11d 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:9/892: dwrite d12/dd7/dc7/d88/f89 [0,4194304] 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:0/858: symlink d5/d7/d2c/l11e 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:9/893: readlink d12/d1b/d40/d52/l5f 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:0/859: read d5/d7/de/fda [356287,77139] 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:1/886: link d1/d2/d18/d35/d84/lbe d1/d2/d18/d35/d84/dc/df/d61/d10a/l122 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:8/865: dwrite d5/dc/d26/d43/f57 [0,4194304] 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:9/894: unlink d12/dd7/dc7/d92/d9d/lfc 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/844: dwrite da/d19/d25/d39/d51/dd7/f64 [0,4194304] 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:5/904: read d0/d1d/d3d/f103 [351624,64880] 0 2024-09-12T22:11:30.630 INFO:tasks.workunit.client.0.smithi019.stdout:8/866: write d5/dc/f5f [409439,82367] 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:1/887: getdents d1/d2/d18 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/845: write da/d24/dff/dd9/fe1 [805893,26573] 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:5/905: getdents d0/d1d/d4f/d47/d57/d98/dd6/d111 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/846: truncate da/d19/d25/d39/f49 1210859 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:1/888: link d1/d2/d18/d35/d84/dc/df/d2c/lcb d1/d2/d18/d35/d84/d98/dbc/l123 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:8/867: write d5/d16/d19/d29/f38 [275422,131059] 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:5/906: read d0/d26/d42/f7f [704523,125837] 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:8/868: mknod d5/dc/d8d/d96/da7/c11e 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:1/889: read d1/f11 [165461,45124] 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:5/907: getdents d0/d1d/d4f/d47/d57/d98 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:8/869: symlink d5/d53/d66/d69/l11f 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:4/896: dread d9/d17/fac [0,4194304] 0 2024-09-12T22:11:30.631 INFO:tasks.workunit.client.0.smithi019.stdout:9/895: dwrite d12/d1b/d40/d52/ff4 [4194304,4194304] 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:5/908: chown d0/d26/d42/df0 0 1 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:1/890: truncate d1/d2/d18/d35/d84/d98/fc2 3342911 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:7/847: sync 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:5/909: fsync d0/f5 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:9/896: creat d12/d1b/d40/d52/d62/de7/f133 x:0 0 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:4/897: creat d9/d17/ddb/f129 x:0 0 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:8/870: link d5/dc/d17/l1b d5/dc/d26/d4b/d101/l120 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:8/871: creat d5/d53/f121 x:0 0 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:1/891: rename d1/d2/d18/d35/d84/df8/d55/f109 to d1/d2/d18/d35/d84/dc/df/d61/d10a/d110/f124 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:5/910: creat d0/d26/d6f/d107/d100/f129 x:0 0 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:9/897: mkdir d12/d1b/d20/d25/d134 0 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:5/911: chown d0/d24/fd7 37 1 2024-09-12T22:11:30.632 INFO:tasks.workunit.client.0.smithi019.stdout:7/848: truncate da/d24/d28/d1c/d32/d99/fa1 1406072 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/872: symlink d5/d16/d19/d29/l122 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:1/892: chown d1/d2/d18/d35/d84/dc/lf7 0 1 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:9/898: readlink d12/d1b/d20/d64/d83/la2 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:0/860: dread d5/d7/d10/f4d [0,4194304] 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:7/849: stat da/d19/f50 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:5/912: mknod d0/d1d/d6d/dca/c12a 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/873: creat d5/dc/d26/d76/d10e/d11b/f123 x:0 0 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:7/850: mknod da/d24/d28/d1c/d32/d5e/c122 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:9/899: write d12/d1b/d40/d52/d62/de6/fee [1606119,12200] 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:0/861: creat d5/d7/d2c/d44/d6a/d115/f11f x:0 0 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:5/913: dread - d0/d1d/d4f/d47/d57/dba/ddb/f115 zero size 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:7/851: symlink da/d30/da5/l123 0 2024-09-12T22:11:30.633 INFO:tasks.workunit.client.0.smithi019.stdout:9/900: creat d12/dd7/dc7/d88/d114/f135 x:0 0 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/914: creat d0/d26/d5f/dc3/f12b x:0 0 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:7/852: chown da/d19/d25/d39/d51/f75 1010 1 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:0/862: dread d5/d7/fe8 [0,4194304] 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/915: mkdir d0/d26/d6f/d107/d12c 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:0/863: stat d5/d7/d2c/d44/d6a/d46/db2/lbb 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:7/853: truncate da/d19/d25/d39/d51/f75 738604 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/916: mkdir d0/d1d/d4f/d47/d57/dba/df6/d12d 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/917: write d0/f9 [1481477,45686] 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:9/901: dwrite d12/d1b/d20/d59/d5b/d9e/f76 [0,4194304] 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:0/864: dwrite d5/d7/d2c/f11b [0,4194304] 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:4/898: dread d9/d14/d57/d95/dbe/dc6/d3f/f91 [0,4194304] 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/918: truncate d0/f17 1522263 0 2024-09-12T22:11:30.634 INFO:tasks.workunit.client.0.smithi019.stdout:7/854: dwrite da/d24/d28/d1c/d32/f60 [0,4194304] 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/865: unlink d5/de2/cb1 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:1/893: dread d1/d37/ff4 [0,4194304] 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:9/902: mknod d12/d1b/d20/d25/d134/c136 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:7/855: mkdir da/d24/dff/d124 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:1/894: symlink d1/d2/l125 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:5/919: write d0/f18 [1960846,10387] 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/866: getdents d5/d7/dac/db6 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:7/856: stat da/d19/d25 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:1/895: chown d1/d37/f4c 0 1 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/867: sync 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:4/899: dread d9/d14/d57/d95/dbe/dc6/d3f/f91 [0,4194304] 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:5/920: creat d0/d1d/d6d/d11e/f12e x:0 0 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/868: getdents d5/d7/d2c/dc1 0 2024-09-12T22:11:30.635 INFO:tasks.workunit.client.0.smithi019.stdout:4/900: symlink d9/db/d2b/dc7/l12a 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/869: mkdir d5/d7/d120 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:4/901: read d9/d58/f68 [1282289,97309] 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:7/857: truncate da/d24/d28/d1c/d32/f5c 1074708 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/870: creat d5/d7/dac/db6/f121 x:0 0 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/871: unlink d5/f6 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:9/903: dwrite d12/d1b/d20/d25/f78 [0,4194304] 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:7/858: creat da/d8f/f125 x:0 0 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:4/902: write d9/d4c/d76/dc9/fe9 [732191,63115] 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/872: chown d5/d7/d10 209748544 1 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:9/904: write d12/dd7/dc7/d74/d77/f84 [844370,1706] 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:5/921: dwrite d0/d1d/d4f/d47/d57/dba/ff2 [0,4194304] 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/873: creat d5/d7/de/f122 x:0 0 0 2024-09-12T22:11:30.636 INFO:tasks.workunit.client.0.smithi019.stdout:9/905: rmdir d12/d1b/d20 39 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:5/922: read d0/f34 [301231,7533] 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:0/874: fsync d5/d7/f93 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:5/923: chown d0/d24 13 1 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:4/903: truncate d9/d17/ff9 2000182 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:7/859: truncate da/d30/d9c/fb2 872968 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:7/860: rmdir da/d24/d28 39 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:0/875: fsync d5/d7/d2c/d44/d6a/d76/f80 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:5/924: write d0/f19 [1261306,60632] 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:9/906: dwrite d12/fe1 [0,4194304] 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:4/904: creat d9/d14/d57/d95/dbe/dc6/deb/f12b x:0 0 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:3/895: dread d18/d26/f36 [0,4194304] 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:5/925: mknod d0/d24/d7a/c12f 0 2024-09-12T22:11:30.637 INFO:tasks.workunit.client.0.smithi019.stdout:7/861: mknod da/d19/d25/d39/d51/dd7/c126 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:4/905: fsync d9/d87/f10a 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:9/907: rmdir d12/d1b/d40/d52/d62/de7 39 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:7/862: rmdir da/d19 39 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:5/926: write d0/d1d/d3d/f48 [1663088,37588] 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:1/896: dread d1/f11 [0,4194304] 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:4/906: creat d9/d14/d33/d4e/f12c x:0 0 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:7/863: truncate da/d8f/fd6 784363 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:3/896: creat d18/d26/d30/d4e/d9a/f111 x:0 0 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:4/907: unlink d9/d14/d33/d4e/d66/f11d 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:2/791: dread d0/d3/d11/d77/d78/d2c/d56/d60/fc9 [0,4194304] 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:0/876: dwrite d5/d7/d10/f68 [0,4194304] 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:3/897: mknod d18/d26/d30/d71/c112 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:1/897: creat d1/d2/d18/d35/d84/d6e/f126 x:0 0 0 2024-09-12T22:11:30.638 INFO:tasks.workunit.client.0.smithi019.stdout:7/864: creat da/d24/d28/d1c/d32/d99/dc8/f127 x:0 0 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:3/898: unlink d18/d1d/d8b/cf8 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:9/908: dwrite d12/dd7/dc7/d74/d77/fa8 [0,4194304] 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/927: dwrite d0/d26/d5f/f8e [0,4194304] 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:2/792: creat d0/d3/d11/d106/f107 x:0 0 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:0/877: unlink d5/d7/d2c/d44/d6a/d46/db2/fce 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/928: truncate d0/d24/f7d 202287 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:7/865: dread da/f11 [0,4194304] 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/929: mkdir d0/d4e/d50/d130 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:9/909: write d12/d1b/d20/da0/f120 [601705,111763] 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:3/899: dwrite d18/d1d/f3f [4194304,4194304] 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:0/878: dread d5/d7/d10/d26/d2a/d94/fab [0,4194304] 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/930: creat d0/d26/d3a/f131 x:0 0 0 2024-09-12T22:11:30.639 INFO:tasks.workunit.client.0.smithi019.stdout:9/910: mkdir d12/d48/d137 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:3/900: rmdir d18/d1d/d35/ded 39 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:2/793: read d0/d31/d12/d15/fa0 [2801305,114691] 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:8/874: dread d5/d16/d19/f40 [0,4194304] 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:5/931: readlink d0/d24/lcd 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:2/794: chown d0/l3d 246958 1 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:0/879: rename d5/d7/d2c/d44/d6a/c29 to d5/d7/c123 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:3/901: getdents d18/d26 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:9/911: rename d12/dd7/dc7/f113 to d12/d1b/d40/f138 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:0/880: dread - d5/d7/d10/d26/f10a zero size 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:5/932: rename d0/d24/d58/f8d to d0/d1d/d4f/d47/d57/dba/ddb/f132 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:9/912: mknod d12/d1b/d20/da0/c139 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:3/902: link f8 d18/d26/d30/d4e/d9a/dae/f113 0 2024-09-12T22:11:30.640 INFO:tasks.workunit.client.0.smithi019.stdout:7/866: dread da/d24/f74 [0,4194304] 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:0/881: creat d5/d7/dac/db6/f124 x:0 0 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:5/933: write d0/d4e/d50/f7c [4263192,104069] 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:9/913: chown d12/d1b/l66 94 1 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:8/875: truncate d5/dc/d17/f2b 1197209 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:3/903: write d18/d26/d30/d4e/fc7 [113960,109670] 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:7/867: creat da/d19/d79/d120/f128 x:0 0 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:5/934: creat d0/d24/d7a/f133 x:0 0 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:9/914: write d12/d1b/d20/da0/fb7 [11637,73669] 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:7/868: creat da/d30/f129 x:0 0 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:3/904: creat d18/d26/dce/df6/f114 x:0 0 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:3/905: mkdir d18/d1d/d8b/dc5/d115 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:3/906: rmdir d18/d26/da5/dbd 39 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:7/869: getdents da/d24/d28/d1c/d32/d99 0 2024-09-12T22:11:30.641 INFO:tasks.workunit.client.0.smithi019.stdout:7/870: mkdir da/d19/d79/d12a 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:3/907: readlink d18/d26/d30/d4e/d80/le1 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:7/871: symlink da/d30/da5/l12b 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:3/908: unlink d18/d26/d30/d4e/d9a/dae/f113 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:0/882: dread d5/d7/dac/fd4 [0,4194304] 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:9/915: dwrite d12/dd7/dc7/d56/f81 [0,4194304] 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:7/872: chown da/d24/d28/l7b 0 1 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/898: dread d1/d37/f4c [0,4194304] 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:0/883: dread - d5/d7/d10/f110 zero size 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/899: chown d1/d2/d18/d35/d84/f5a 6520253 1 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:0/884: write d5/d7/d10/f55 [552792,83550] 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:7/873: mknod da/d19/d25/d39/d51/c12c 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:7/874: dread - da/d30/fed zero size 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:3/909: rename d18/d26/d30/d4a/f68 to d18/d1d/d35/ded/f116 0 2024-09-12T22:11:30.642 INFO:tasks.workunit.client.0.smithi019.stdout:4/908: dread d9/d17/f10f [0,4194304] 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:7/875: chown da/d24/f2c 816432 1 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:4/909: dread - d9/d58/f11f zero size 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:3/910: mkdir d18/d26/d30/d4e/d80/df2/d117 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:7/876: chown da/d19/d25/d39/d51/df8/f115 351 1 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:4/910: creat d9/d4c/f12d x:0 0 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:1/900: write d1/d2/d18/d35/fda [1650781,56039] 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:7/877: stat da/d19/d79/d12a 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:3/911: rename d18/d26/d30/f67 to d18/d26/d30/d4a/f118 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:5/935: dread d0/f19 [0,4194304] 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:4/911: symlink d9/d14/d57/d95/dbe/l12e 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:0/885: dwrite d5/d7/d10/d26/d2a/f65 [0,4194304] 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:7/878: unlink da/d24/d28/d1c/d32/d5e/lee 0 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:4/912: chown d9/db 11 1 2024-09-12T22:11:30.643 INFO:tasks.workunit.client.0.smithi019.stdout:5/936: fsync d0/d1d/d6d/d11e/f12e 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:7/879: unlink da/d8f/fd6 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:7/880: write da/d8f/fc1 [140703,29683] 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:4/913: rename d9/d14/d57/d95/dbe/d6f/dfe to d9/d14/d12f 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:0/886: read d5/d7/d2c/d44/d6a/d76/f7e [283457,66905] 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:5/937: rename d0/d26/d5f/fe7 to d0/d24/d97/f134 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:4/914: mkdir d9/d4c/d76/df2/d110/d130 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:5/938: mknod d0/c135 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:0/887: rename d5/d7/dac/db6/f121 to d5/d7/d10/d26/d8a/f125 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:3/912: dwrite d18/f3e [0,4194304] 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:5/939: creat d0/d26/d6f/d107/d100/f136 x:0 0 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:0/888: rename d5/d7/d2c/d44/d6a/d46/f60 to d5/d7/d10/d26/d8a/f126 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:5/940: symlink d0/d1d/l137 0 2024-09-12T22:11:30.644 INFO:tasks.workunit.client.0.smithi019.stdout:3/913: chown d18/d26/da5/laa 16868475 1 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:4/915: dread d9/d17/fac [0,4194304] 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/889: write d5/d7/d2c/fe0 [680460,9897] 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:4/916: mknod d9/db/dcd/dc1/c131 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:5/941: read - d0/d1d/d4f/d47/d57/dba/ddb/f115 zero size 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/890: readlink d5/d7/d2c/d44/d6a/d52/l72 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:5/942: creat d0/d26/d42/df0/f138 x:0 0 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/891: fsync d5/d7/fe8 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:5/943: fdatasync d0/d26/d42/df0/f109 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/892: mknod d5/d7/dac/db6/c127 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:5/944: mknod d0/d26/d42/df0/c139 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/893: creat d5/d7/d2c/d81/de4/f128 x:0 0 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:3/914: dread d18/d58/f8e [0,4194304] 0 2024-09-12T22:11:30.645 INFO:tasks.workunit.client.0.smithi019.stdout:7/881: dread da/d24/fbb [0,4194304] 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:0/894: dread d5/fd7 [0,4194304] 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:5/945: dwrite d0/d24/d58/fc4 [4194304,4194304] 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:7/882: write da/d24/d28/f8b [911454,75385] 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:3/915: dwrite d18/d26/d30/d4e/f6c [0,4194304] 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:5/946: write d0/d24/d7a/f133 [247188,129627] 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:0/895: mkdir d5/d7/d2c/d44/d6a/d46/db2/d10c/d129 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:7/883: fdatasync da/d19/d25/d39/f6b 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:3/916: write d18/d26/fb0 [5429746,47832] 0 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:5/947: chown d0/d1d/f33 49136 1 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:3/917: chown d18/f1b 37800742 1 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:7/884: chown da/d24/dff/dd9 29716018 1 2024-09-12T22:11:30.646 INFO:tasks.workunit.client.0.smithi019.stdout:0/896: unlink d5/d7/d10/d26/d2a/f37 0 2024-09-12T22:11:30.651 INFO:tasks.workunit.client.0.smithi019.stdout:7/885: dread - da/d30/fed zero size 2024-09-12T22:11:30.651 INFO:tasks.workunit.client.0.smithi019.stdout:3/918: creat d18/d26/dce/df6/f119 x:0 0 0 2024-09-12T22:11:30.651 INFO:tasks.workunit.client.0.smithi019.stdout:5/948: link d0/d1d/d3d/ff1 d0/d1d/d3d/f13a 0 2024-09-12T22:11:30.651 INFO:tasks.workunit.client.0.smithi019.stdout:0/897: write d5/d7/d2c/d44/d6a/d52/f84 [955638,74360] 0 2024-09-12T22:11:30.651 INFO:tasks.workunit.client.0.smithi019.stdout:5/949: chown d0/d24/d7a/laa 6128 1 2024-09-12T22:11:30.651 INFO:tasks.workunit.client.0.smithi019.stdout:0/898: chown d5/d7/d10/c15 1 1 2024-09-12T22:11:30.651 INFO:tasks.workunit.client.0.smithi019.stdout:5/950: chown d0/d26/d5f/d117/f122 41373494 1 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/899: write d5/d88/fca [693856,117989] 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/900: chown d5/fae 180060234 1 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:7/886: dwrite da/d8f/fc1 [0,4194304] 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:3/919: dwrite d18/d26/d30/d4e/f59 [0,4194304] 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:3/920: creat d18/d1d/d8b/dc5/dbb/f11a x:0 0 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:5/951: dwrite d0/d26/f2d [0,4194304] 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/901: write d5/d7/f11 [2538419,88438] 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:2/795: sync 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:9/916: sync 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:2/796: creat d0/d3/d11/d106/f108 x:0 0 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/902: rmdir d5/d7/dac 39 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:9/917: symlink d12/dd7/dc7/d88/d114/l13a 0 2024-09-12T22:11:30.652 INFO:tasks.workunit.client.0.smithi019.stdout:5/952: creat d0/d4e/d50/d130/f13b x:0 0 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:3/921: getdents d18/d26/d30/d4e/d9a/dae 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:9/918: fdatasync d12/d1b/f7d 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:5/953: dread - d0/d26/d42/df0/f108 zero size 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:0/903: truncate d5/de2/fdb 2678987 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:7/887: dwrite da/d8f/f7f [0,4194304] 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:0/904: read d5/d7/fe8 [182696,39997] 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:9/919: rename d12/d1b/d20/fea to d12/f13b 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:9/920: write d12/d1b/d40/d52/fb8 [2266767,101493] 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:0/905: creat d5/d7/d2c/d81/dcb/deb/f12a x:0 0 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:7/888: creat da/d19/d25/d39/d51/dd7/f12d x:0 0 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:3/922: dwrite d18/f3e [0,4194304] 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:0/906: symlink d5/d7/l12b 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:7/889: dread da/d8f/f7f [0,4194304] 0 2024-09-12T22:11:30.653 INFO:tasks.workunit.client.0.smithi019.stdout:3/923: dwrite d18/d26/dce/df6/ff7 [0,4194304] 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/907: truncate d5/d7/f30 929633 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/908: chown d5/d7/d10/d26/d2a/f2b 0 1 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:3/924: rename d18/d58 to d18/d26/d30/d4e/d80/d11b 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:7/890: dwrite da/d24/d28/d1c/d32/f3c [0,4194304] 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:3/925: mkdir d18/d1d/d8b/dc5/dbb/df1/dfd/d11c 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:1/901: dread d1/d2/d18/d35/d84/dc/df/d2c/f63 [0,4194304] 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/909: getdents d5/d7/d10/d26/d2a 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:1/902: fsync d1/fb1 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/910: mknod d5/d7/de/d8d/c12c 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/911: stat c3 0 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:0/912: rmdir d5/d7/de 39 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:1/903: dread - d1/d2/d18/d35/d84/df8/d66/f101 zero size 2024-09-12T22:11:30.654 INFO:tasks.workunit.client.0.smithi019.stdout:1/904: stat d1/d2/d18/d35/d84/dc/df/f107 0 2024-09-12T22:11:30.655 INFO:tasks.workunit.client.0.smithi019.stdout:1/905: write d1/d2/d18/d35/d84/dc/f50 [5470203,65228] 0 2024-09-12T22:11:30.655 INFO:tasks.workunit.client.0.smithi019.stdout:1/906: chown d1/ddb/cf9 2370 1 2024-09-12T22:11:30.655 INFO:tasks.workunit.client.0.smithi019.stdout:3/926: dwrite d18/d1d/d35/ded/f116 [0,4194304] 0 2024-09-12T22:11:30.655 INFO:tasks.workunit.client.0.smithi019.stdout:7/891: dwrite da/d19/d25/d39/d51/dd7/f66 [0,4194304] 0 2024-09-12T22:11:30.655 INFO:tasks.workunit.client.0.smithi019.stdout:0/913: dwrite d5/d7/d10/fee [0,4194304] 0 2024-09-12T22:11:30.656 INFO:tasks.workunit.client.0.smithi019.stdout:3/927: write d18/d26/d30/d71/fb4 [1393669,16202] 0 2024-09-12T22:11:30.656 INFO:tasks.workunit.client.0.smithi019.stdout:7/892: write da/d30/da5/fac [876775,62374] 0 2024-09-12T22:11:30.660 INFO:tasks.workunit.client.0.smithi019.stdout:3/928: fdatasync d18/d26/d30/d4e/f73 0 2024-09-12T22:11:30.660 INFO:tasks.workunit.client.0.smithi019.stdout:0/914: rmdir d5/d87 39 2024-09-12T22:11:30.660 INFO:tasks.workunit.client.0.smithi019.stdout:8/876: sync 2024-09-12T22:11:30.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/893: chown da/d24/d28/d1c/d32/d99/dc8/df4/l113 7434 1 2024-09-12T22:11:30.660 INFO:tasks.workunit.client.0.smithi019.stdout:3/929: unlink d18/d1d/d35/ded/fee 0 2024-09-12T22:11:30.660 INFO:tasks.workunit.client.0.smithi019.stdout:8/877: creat d5/dc/d26/dc8/f124 x:0 0 0 2024-09-12T22:11:30.661 INFO:tasks.workunit.client.0.smithi019.stdout:0/915: symlink d5/d7/d2c/d44/d6a/d46/db2/l12d 0 2024-09-12T22:11:30.661 INFO:tasks.workunit.client.0.smithi019.stdout:1/907: truncate d1/d83/fc8 974291 0 2024-09-12T22:11:30.662 INFO:tasks.workunit.client.0.smithi019.stdout:4/917: dread d9/d4c/d76/dc9/df0/de2/f114 [0,4194304] 0 2024-09-12T22:11:30.662 INFO:tasks.workunit.client.0.smithi019.stdout:0/916: rename d5/f16 to d5/d7/d2c/d44/d6a/f12e 0 2024-09-12T22:11:30.662 INFO:tasks.workunit.client.0.smithi019.stdout:8/878: getdents d5/dc/d8a 0 2024-09-12T22:11:30.662 INFO:tasks.workunit.client.0.smithi019.stdout:7/894: getdents da/d19/d25/d39 0 2024-09-12T22:11:30.662 INFO:tasks.workunit.client.0.smithi019.stdout:4/918: write d9/db/f99 [1659318,67785] 0 2024-09-12T22:11:30.664 INFO:tasks.workunit.client.0.smithi019.stdout:8/879: mkdir d5/dc/d26/d76/d10e/d11b/d125 0 2024-09-12T22:11:30.666 INFO:tasks.workunit.client.0.smithi019.stdout:7/895: truncate da/d8f/f7f 4767239 0 2024-09-12T22:11:30.666 INFO:tasks.workunit.client.0.smithi019.stdout:1/908: rename d1/ddb/cf9 to d1/d2/d18/d35/d84/dc/df/d11d/c127 0 2024-09-12T22:11:30.666 INFO:tasks.workunit.client.0.smithi019.stdout:0/917: creat d5/d7/d2c/d44/d6a/d46/db2/f12f x:0 0 0 2024-09-12T22:11:30.666 INFO:tasks.workunit.client.0.smithi019.stdout:3/930: dwrite d18/d1d/f2a [0,4194304] 0 2024-09-12T22:11:30.671 INFO:tasks.workunit.client.0.smithi019.stdout:1/909: creat d1/d2/d18/d35/d84/dc/df/d11d/f128 x:0 0 0 2024-09-12T22:11:30.671 INFO:tasks.workunit.client.0.smithi019.stdout:4/919: dwrite d9/d14/d33/d4e/f85 [0,4194304] 0 2024-09-12T22:11:30.671 INFO:tasks.workunit.client.0.smithi019.stdout:7/896: write da/d30/d9c/fb2 [275888,34839] 0 2024-09-12T22:11:30.672 INFO:tasks.workunit.client.0.smithi019.stdout:3/931: mknod d18/d1d/d8b/dc5/dbb/df1/dfd/d11c/c11d 0 2024-09-12T22:11:30.673 INFO:tasks.workunit.client.0.smithi019.stdout:3/932: fsync f9 0 2024-09-12T22:11:30.674 INFO:tasks.workunit.client.0.smithi019.stdout:4/920: creat d9/db/d2b/dc7/d107/f132 x:0 0 0 2024-09-12T22:11:30.675 INFO:tasks.workunit.client.0.smithi019.stdout:8/880: dwrite d5/dc/d26/d43/d49/d92/fb6 [0,4194304] 0 2024-09-12T22:11:30.676 INFO:tasks.workunit.client.0.smithi019.stdout:0/918: dwrite d5/d7/d10/fee [0,4194304] 0 2024-09-12T22:11:30.677 INFO:tasks.workunit.client.0.smithi019.stdout:2/797: dread d0/d31/d12/d15/f9f [0,4194304] 0 2024-09-12T22:11:30.678 INFO:tasks.workunit.client.0.smithi019.stdout:8/881: chown d5/dc/d26/d4b/f111 14 1 2024-09-12T22:11:30.678 INFO:tasks.workunit.client.0.smithi019.stdout:5/954: dread d0/d1d/d4f/d96/fa9 [0,4194304] 0 2024-09-12T22:11:30.679 INFO:tasks.workunit.client.0.smithi019.stdout:3/933: rename d18/d26/d30/d71/d86/ce2 to d18/d26/dce/df6/c11e 0 2024-09-12T22:11:30.680 INFO:tasks.workunit.client.0.smithi019.stdout:0/919: creat d5/d88/f130 x:0 0 0 2024-09-12T22:11:30.680 INFO:tasks.workunit.client.0.smithi019.stdout:2/798: fdatasync d0/d3/df/f2a 0 2024-09-12T22:11:30.680 INFO:tasks.workunit.client.0.smithi019.stdout:1/910: getdents d1/d2/d18/d35/d84/dc/df/d61/d10a/d110 0 2024-09-12T22:11:30.682 INFO:tasks.workunit.client.0.smithi019.stdout:9/921: sync 2024-09-12T22:11:30.682 INFO:tasks.workunit.client.0.smithi019.stdout:5/955: mkdir d0/d1d/d4f/d47/d57/d98/dd6/d111/d13c 0 2024-09-12T22:11:30.684 INFO:tasks.workunit.client.0.smithi019.stdout:0/920: write d5/d7/d10/d26/f71 [2762551,62168] 0 2024-09-12T22:11:30.685 INFO:tasks.workunit.client.0.smithi019.stdout:1/911: dread - d1/d2/d18/d35/d84/dc/df/d61/d10a/d110/f115 zero size 2024-09-12T22:11:30.685 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:30.683+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:30.687 INFO:tasks.workunit.client.0.smithi019.stdout:8/882: dwrite d5/d53/f121 [0,4194304] 0 2024-09-12T22:11:30.687 INFO:tasks.workunit.client.0.smithi019.stdout:4/921: dwrite d9/d14/d57/d95/dbe/dc6/fb6 [4194304,4194304] 0 2024-09-12T22:11:30.689 INFO:tasks.workunit.client.0.smithi019.stdout:5/956: fdatasync d0/d1d/d4f/d47/d57/d98/dd6/f110 0 2024-09-12T22:11:30.689 INFO:tasks.workunit.client.0.smithi019.stdout:9/922: fdatasync d12/dd7/dc7/d74/d77/d86/ddf/df2/f112 0 2024-09-12T22:11:30.689 INFO:tasks.workunit.client.0.smithi019.stdout:1/912: mkdir d1/d129 0 2024-09-12T22:11:30.689 INFO:tasks.workunit.client.0.smithi019.stdout:0/921: creat d5/d7/dac/f131 x:0 0 0 2024-09-12T22:11:30.691 INFO:tasks.workunit.client.0.smithi019.stdout:5/957: chown d0/d1d/ffd 418 1 2024-09-12T22:11:30.692 INFO:tasks.workunit.client.0.smithi019.stdout:2/799: dwrite d0/d31/d12/f17 [4194304,4194304] 0 2024-09-12T22:11:30.692 INFO:tasks.workunit.client.0.smithi019.stdout:3/934: dwrite d18/d26/dce/df6/f114 [0,4194304] 0 2024-09-12T22:11:30.693 INFO:tasks.workunit.client.0.smithi019.stdout:4/922: creat d9/d4c/d76/dc9/df0/de2/f133 x:0 0 0 2024-09-12T22:11:30.693 INFO:tasks.workunit.client.0.smithi019.stdout:1/913: creat d1/d2/d18/d35/d84/df8/d11e/f12a x:0 0 0 2024-09-12T22:11:30.693 INFO:tasks.workunit.client.0.smithi019.stdout:5/958: stat d0/d26/d5f/dc3/f12b 0 2024-09-12T22:11:30.694 INFO:tasks.workunit.client.0.smithi019.stdout:4/923: chown d9/db/d2b/de0/lf1 8590044 1 2024-09-12T22:11:30.695 INFO:tasks.workunit.client.0.smithi019.stdout:9/923: mkdir d12/d1b/d40/d52/d62/de6/d13c 0 2024-09-12T22:11:30.695 INFO:tasks.workunit.client.0.smithi019.stdout:3/935: mknod d18/d1d/dad/c11f 0 2024-09-12T22:11:30.696 INFO:tasks.workunit.client.0.smithi019.stdout:4/924: rmdir d9/d17 39 2024-09-12T22:11:30.696 INFO:tasks.workunit.client.0.smithi019.stdout:2/800: write d0/f42 [437115,53919] 0 2024-09-12T22:11:30.696 INFO:tasks.workunit.client.0.smithi019.stdout:5/959: rename d0/d4e/d50/f6c to d0/dbf/f13d 0 2024-09-12T22:11:30.697 INFO:tasks.workunit.client.0.smithi019.stdout:0/922: read d5/d7/d2c/d44/d6a/d76/f80 [591254,13031] 0 2024-09-12T22:11:30.697 INFO:tasks.workunit.client.0.smithi019.stdout:8/883: dwrite d5/dc/f6d [0,4194304] 0 2024-09-12T22:11:30.698 INFO:tasks.workunit.client.0.smithi019.stdout:7/897: dread da/d24/dff/dd9/fe1 [0,4194304] 0 2024-09-12T22:11:30.698 INFO:tasks.workunit.client.0.smithi019.stdout:5/960: rmdir d0/d1d/d3d 39 2024-09-12T22:11:30.699 INFO:tasks.workunit.client.0.smithi019.stdout:4/925: stat d9/d4c/d76/dc9/df0/fd0 0 2024-09-12T22:11:30.699 INFO:tasks.workunit.client.0.smithi019.stdout:2/801: symlink d0/d3/d11/da9/l109 0 2024-09-12T22:11:30.699 INFO:tasks.workunit.client.0.smithi019.stdout:9/924: write d12/d1b/d40/f138 [117996,48443] 0 2024-09-12T22:11:30.701 INFO:tasks.workunit.client.0.smithi019.stdout:8/884: symlink d5/dc/d26/d5c/l126 0 2024-09-12T22:11:30.701 INFO:tasks.workunit.client.0.smithi019.stdout:7/898: symlink da/d24/d28/d1c/dda/l12e 0 2024-09-12T22:11:30.702 INFO:tasks.workunit.client.0.smithi019.stdout:1/914: dwrite d1/d2/d18/d35/d84/d98/dbc/fc1 [0,4194304] 0 2024-09-12T22:11:30.702 INFO:tasks.workunit.client.0.smithi019.stdout:3/936: getdents d18/d26/d30/d71/d86 0 2024-09-12T22:11:30.702 INFO:tasks.workunit.client.0.smithi019.stdout:2/802: fdatasync d0/d3/d11/d77/d78/d2c/d30/d32/f4a 0 2024-09-12T22:11:30.703 INFO:tasks.workunit.client.0.smithi019.stdout:0/923: chown d5/d7/d2c/d44/d6a/d76/fa1 1524290 1 2024-09-12T22:11:30.703 INFO:tasks.workunit.client.0.smithi019.stdout:8/885: write d5/d16/ffb [822273,7030] 0 2024-09-12T22:11:30.703 INFO:tasks.workunit.client.0.smithi019.stdout:1/915: stat d1/c73 0 2024-09-12T22:11:30.704 INFO:tasks.workunit.client.0.smithi019.stdout:4/926: creat d9/d4c/d76/dc9/df0/d8f/d93/f134 x:0 0 0 2024-09-12T22:11:30.705 INFO:tasks.workunit.client.0.smithi019.stdout:1/916: creat d1/d129/f12b x:0 0 0 2024-09-12T22:11:30.705 INFO:tasks.workunit.client.0.smithi019.stdout:2/803: fsync d0/d3/d11/d77/d78/d2c/d30/d32/f4a 0 2024-09-12T22:11:30.706 INFO:tasks.workunit.client.0.smithi019.stdout:7/899: creat da/d19/d25/d39/f12f x:0 0 0 2024-09-12T22:11:30.709 INFO:tasks.workunit.client.0.smithi019.stdout:9/925: truncate d12/d1b/d40/d52/ff4 1179454 0 2024-09-12T22:11:30.710 INFO:tasks.workunit.client.0.smithi019.stdout:4/927: creat d9/db/d2b/d6a/f135 x:0 0 0 2024-09-12T22:11:30.711 INFO:tasks.workunit.client.0.smithi019.stdout:5/961: dwrite d0/d1d/d3d/fe9 [0,4194304] 0 2024-09-12T22:11:30.711 INFO:tasks.workunit.client.0.smithi019.stdout:0/924: mknod d5/d7/d2c/d44/d6a/d46/db2/d10c/d129/c132 0 2024-09-12T22:11:30.711 INFO:tasks.workunit.client.0.smithi019.stdout:8/886: dread d5/dc/d8a/fbc [0,4194304] 0 2024-09-12T22:11:30.711 INFO:tasks.workunit.client.0.smithi019.stdout:1/917: creat d1/d2/d18/d35/d84/df8/d11e/f12c x:0 0 0 2024-09-12T22:11:30.712 INFO:tasks.workunit.client.0.smithi019.stdout:5/962: chown d0/d26/cbe 4 1 2024-09-12T22:11:30.712 INFO:tasks.workunit.client.0.smithi019.stdout:4/928: stat d9/db/d2b/dc7/f126 0 2024-09-12T22:11:30.713 INFO:tasks.workunit.client.0.smithi019.stdout:8/887: unlink d5/d53/ff1 0 2024-09-12T22:11:30.716 INFO:tasks.workunit.client.0.smithi019.stdout:0/925: chown d5/d7/d2c/dc1/f103 2753194 1 2024-09-12T22:11:30.717 INFO:tasks.workunit.client.0.smithi019.stdout:9/926: read - d12/dd7/dc7/d74/d77/d86/fff zero size 2024-09-12T22:11:30.717 INFO:tasks.workunit.client.0.smithi019.stdout:7/900: mkdir da/d19/d25/d39/d51/dd7/db1/db5/d130 0 2024-09-12T22:11:30.717 INFO:tasks.workunit.client.0.smithi019.stdout:1/918: fsync d1/d2/d18/d35/d84/dc/df/d61/f34 0 2024-09-12T22:11:30.717 INFO:tasks.workunit.client.0.smithi019.stdout:5/963: creat d0/d26/d42/f13e x:0 0 0 2024-09-12T22:11:30.717 INFO:tasks.workunit.client.0.smithi019.stdout:0/926: creat d5/d7/d2c/dc1/f133 x:0 0 0 2024-09-12T22:11:30.717 INFO:tasks.workunit.client.0.smithi019.stdout:8/888: chown d5/dc/d26/d76/d10e/c11c 11044528 1 2024-09-12T22:11:30.718 INFO:tasks.workunit.client.0.smithi019.stdout:3/937: dwrite d18/d1d/d35/f49 [0,4194304] 0 2024-09-12T22:11:30.719 INFO:tasks.workunit.client.0.smithi019.stdout:1/919: chown d1/d2/d18/d35/d84/dc/lf7 5423632 1 2024-09-12T22:11:30.719 INFO:tasks.workunit.client.0.smithi019.stdout:7/901: mkdir da/d24/dff/d116/d131 0 2024-09-12T22:11:30.720 INFO:tasks.workunit.client.0.smithi019.stdout:5/964: fsync d0/d1d/d3d/f103 0 2024-09-12T22:11:30.720 INFO:tasks.workunit.client.0.smithi019.stdout:8/889: mkdir d5/dc/d26/d4b/df5/d127 0 2024-09-12T22:11:30.721 INFO:tasks.workunit.client.0.smithi019.stdout:0/927: truncate d5/d7/d2c/d81/dcb/deb/ff4 1164078 0 2024-09-12T22:11:30.721 INFO:tasks.workunit.client.0.smithi019.stdout:1/920: mknod d1/d37/c12d 0 2024-09-12T22:11:30.721 INFO:tasks.workunit.client.0.smithi019.stdout:9/927: rename d12/dd7/dc7/d74/d77/f90 to d12/d1b/d40/d85/de8/def/f13d 0 2024-09-12T22:11:30.721 INFO:tasks.workunit.client.0.smithi019.stdout:7/902: write da/d19/f41 [9277960,46801] 0 2024-09-12T22:11:30.722 INFO:tasks.workunit.client.0.smithi019.stdout:5/965: dread - d0/d26/d42/df0/f138 zero size 2024-09-12T22:11:30.724 INFO:tasks.workunit.client.0.smithi019.stdout:4/929: dwrite d9/d14/d57/d95/dbe/dc6/deb/f12b [0,4194304] 0 2024-09-12T22:11:30.724 INFO:tasks.workunit.client.0.smithi019.stdout:0/928: rmdir d5/d7/de/d8d 39 2024-09-12T22:11:30.724 INFO:tasks.workunit.client.0.smithi019.stdout:8/890: truncate d5/dc/d8d/f114 816594 0 2024-09-12T22:11:30.724 INFO:tasks.workunit.client.0.smithi019.stdout:1/921: creat d1/d37/d10e/f12e x:0 0 0 2024-09-12T22:11:30.725 INFO:tasks.workunit.client.0.smithi019.stdout:3/938: dread d18/d26/dce/df6/ff7 [0,4194304] 0 2024-09-12T22:11:30.725 INFO:tasks.workunit.client.0.smithi019.stdout:9/928: creat d12/d1b/d20/d59/d5b/d9e/f13e x:0 0 0 2024-09-12T22:11:30.725 INFO:tasks.workunit.client.0.smithi019.stdout:7/903: mknod da/d24/dff/d124/c132 0 2024-09-12T22:11:30.726 INFO:tasks.workunit.client.0.smithi019.stdout:0/929: dread - d5/d7/de/d9a/fff zero size 2024-09-12T22:11:30.726 INFO:tasks.workunit.client.0.smithi019.stdout:7/904: chown da/d8f 468 1 2024-09-12T22:11:30.727 INFO:tasks.workunit.client.0.smithi019.stdout:1/922: creat d1/d2/f12f x:0 0 0 2024-09-12T22:11:30.727 INFO:tasks.workunit.client.0.smithi019.stdout:4/930: symlink d9/d14/d33/d4e/d66/l136 0 2024-09-12T22:11:30.727 INFO:tasks.workunit.client.0.smithi019.stdout:8/891: chown d5/d16/d19/c54 51441593 1 2024-09-12T22:11:30.728 INFO:tasks.workunit.client.0.smithi019.stdout:0/930: fsync d5/d7/d10/d26/f10a 0 2024-09-12T22:11:30.728 INFO:tasks.workunit.client.0.smithi019.stdout:1/923: chown d1/d2/d18/d29/d27 62 1 2024-09-12T22:11:30.728 INFO:tasks.workunit.client.0.smithi019.stdout:8/892: mknod d5/dc/d26/d76/d10e/c128 0 2024-09-12T22:11:30.729 INFO:tasks.workunit.client.0.smithi019.stdout:4/931: write d9/db/f99 [1624047,56990] 0 2024-09-12T22:11:30.730 INFO:tasks.workunit.client.0.smithi019.stdout:3/939: link d18/d1d/c1e d18/c120 0 2024-09-12T22:11:30.730 INFO:tasks.workunit.client.0.smithi019.stdout:9/929: link d12/d1b/c2c d12/d1b/d40/d85/d10f/c13f 0 2024-09-12T22:11:30.731 INFO:tasks.workunit.client.0.smithi019.stdout:0/931: write d5/d7/d2c/d44/d6a/d46/fb0 [5144447,102856] 0 2024-09-12T22:11:30.731 INFO:tasks.workunit.client.0.smithi019.stdout:5/966: dread d0/d4e/f5a [0,4194304] 0 2024-09-12T22:11:30.731 INFO:tasks.workunit.client.0.smithi019.stdout:8/893: symlink d5/dc/d17/l129 0 2024-09-12T22:11:30.731 INFO:tasks.workunit.client.0.smithi019.stdout:7/905: creat da/d24/d28/d1c/d32/d99/d9f/d11a/f133 x:0 0 0 2024-09-12T22:11:30.731 INFO:tasks.workunit.client.0.smithi019.stdout:4/932: mkdir d9/d4c/d76/dc9/d137 0 2024-09-12T22:11:30.731 INFO:tasks.workunit.client.0.smithi019.stdout:3/940: creat d18/d26/d30/d64/f121 x:0 0 0 2024-09-12T22:11:30.731 INFO:tasks.workunit.client.0.smithi019.stdout:8/894: stat d5/dc/d26/d43/lb1 0 2024-09-12T22:11:30.732 INFO:tasks.workunit.client.0.smithi019.stdout:5/967: mknod d0/d26/d5f/c13f 0 2024-09-12T22:11:30.732 INFO:tasks.workunit.client.0.smithi019.stdout:3/941: fsync d18/d26/d30/d4e/f73 0 2024-09-12T22:11:30.733 INFO:tasks.workunit.client.0.smithi019.stdout:0/932: symlink d5/d7/dac/d111/l134 0 2024-09-12T22:11:30.733 INFO:tasks.workunit.client.0.smithi019.stdout:8/895: write d5/d16/d19/f5b [932884,77694] 0 2024-09-12T22:11:30.734 INFO:tasks.workunit.client.0.smithi019.stdout:9/930: chown d12/d1b/d40/d52/d62/de6/cf7 2 1 2024-09-12T22:11:30.735 INFO:tasks.workunit.client.0.smithi019.stdout:3/942: write d18/d26/d30/d4e/fc7 [478016,70053] 0 2024-09-12T22:11:30.736 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:30.736 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:30.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.736 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:15163 4.a e53/17 4:53de697f:::10000003989.00000000:head v 53'213, mlcod=53'211)", 2024-09-12T22:11:30.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.729937+0000", 2024-09-12T22:11:30.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0055927559999999999, 2024-09-12T22:11:30.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056085579999999996, 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.729937+0000", 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.729937+0000", 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.729938+0000", 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0100000000000004e-07 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.733772+0000", 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003834811 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.733780+0000", 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1389999999999995e-06 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.733786+0000", 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0429999999999998e-06 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.733836+0000", 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0266000000000003e-05 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.733860+0000", 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3961e-05 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:15176 4.12 4:487bc519:::1000000366a.00000000:head [read 262144~262144 [2@974291] out=262144b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.734914+0000", 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00061576100000000004, 2024-09-12T22:11:30.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000673552, 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15176 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.734914+0000", 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.734914+0000", 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.734915+0000", 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0410000000000001e-06 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.734920+0000", 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.989e-06 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.734930+0000", 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0362e-05 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.734939+0000", 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3950000000000001e-06 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.734994+0000", 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5664000000000001e-05 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.735077+0000", 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3300999999999994e-05 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:30.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:30.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:30.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:30.747 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:30.747 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 2 2024-09-12T22:11:30.747 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:30.749 INFO:tasks.workunit.client.0.smithi019.stdout:0/933: unlink d5/d7/de/l3d 0 2024-09-12T22:11:30.749 INFO:tasks.workunit.client.0.smithi019.stdout:2/804: dread d0/d3/d11/d77/d78/d2c/d56/d60/feb [0,4194304] 0 2024-09-12T22:11:30.749 INFO:tasks.workunit.client.0.smithi019.stdout:9/931: symlink d12/d1b/l140 0 2024-09-12T22:11:30.749 INFO:tasks.workunit.client.0.smithi019.stdout:1/924: dread d1/d83/fc8 [0,4194304] 0 2024-09-12T22:11:30.749 INFO:tasks.workunit.client.0.smithi019.stdout:7/906: dwrite da/d19/f111 [0,4194304] 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:3/943: readlink d18/d26/d30/d4e/d80/la2 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:4/933: truncate d9/d14/d33/d4e/f85 3044980 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:5/968: dwrite d0/d1d/d4f/d47/f4a [0,4194304] 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:2/805: rename d0/d3/d11/d2e/d64/daf to d0/d3/d11/d2e/d70/d10a 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:3/944: creat d18/d1d/d8b/dc5/dbb/df1/dfd/d11c/f122 x:0 0 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:4/934: symlink d9/d14/d57/d95/dbe/dc6/l138 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:7/907: getdents da/d24/d28 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:1/925: rename d1/d2/d18/d35/d84/d6e/l7d to d1/d2/d18/d35/d84/df8/d66/l130 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:5/969: link d0/d1d/d4f/d47/f99 d0/d26/d42/f140 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:1/926: chown d1/d2/fe2 8336 1 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:9/932: dwrite d12/d48/f93 [0,4194304] 0 2024-09-12T22:11:30.750 INFO:tasks.workunit.client.0.smithi019.stdout:7/908: mkdir da/d19/d25/d39/d134 0 2024-09-12T22:11:30.751 INFO:tasks.workunit.client.0.smithi019.stdout:0/934: dwrite d5/d7/d2c/d44/d6a/d46/fe3 [0,4194304] 0 2024-09-12T22:11:30.751 INFO:tasks.workunit.client.0.smithi019.stdout:8/896: dwrite d5/dc/d26/f3a [0,4194304] 0 2024-09-12T22:11:30.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:30.753 INFO:tasks.workunit.client.0.smithi019.stdout:8/897: truncate d5/ff4 18512 0 2024-09-12T22:11:30.753 INFO:tasks.workunit.client.0.smithi019.stdout:9/933: chown d12/dd7/dc7/d88/d114/f135 1487942 1 2024-09-12T22:11:30.753 INFO:tasks.workunit.client.0.smithi019.stdout:2/806: rename d0/d3/d11/d2e/c53 to d0/d3/d11/d77/d82/dc0/c10b 0 2024-09-12T22:11:30.753 INFO:tasks.workunit.client.0.smithi019.stdout:7/909: creat da/d19/d25/d39/d51/dd7/db1/db5/db6/f135 x:0 0 0 2024-09-12T22:11:30.753 INFO:tasks.workunit.client.0.smithi019.stdout:0/935: readlink d5/d88/ld1 0 2024-09-12T22:11:30.753 INFO:tasks.workunit.client.0.smithi019.stdout:4/935: rename d9/d4c/d9c/f9e to d9/db/d2b/dc7/dd3/f139 0 2024-09-12T22:11:30.754 INFO:tasks.workunit.client.0.smithi019.stdout:1/927: creat d1/d2/d18/d35/d84/dc/df/d2c/d116/f131 x:0 0 0 2024-09-12T22:11:30.754 INFO:tasks.workunit.client.0.smithi019.stdout:8/898: link d5/d53/d66/fb5 d5/d53/d66/f12a 0 2024-09-12T22:11:30.755 INFO:tasks.workunit.client.0.smithi019.stdout:1/928: mknod d1/d2/d18/d70/c132 0 2024-09-12T22:11:30.755 INFO:tasks.workunit.client.0.smithi019.stdout:4/936: getdents d9/db/d2b/df7 0 2024-09-12T22:11:30.756 INFO:tasks.workunit.client.0.smithi019.stdout:5/970: dwrite d0/d1d/d4f/d47/d57/dba/df6/fff [0,4194304] 0 2024-09-12T22:11:30.758 INFO:tasks.workunit.client.0.smithi019.stdout:0/936: truncate d5/d7/d10/f5e 4698584 0 2024-09-12T22:11:30.758 INFO:tasks.workunit.client.0.smithi019.stdout:9/934: write d12/d1b/d40/d52/ff4 [1683878,70084] 0 2024-09-12T22:11:30.759 INFO:tasks.workunit.client.0.smithi019.stdout:2/807: truncate d0/d3/d11/d77/d78/d2c/d30/d32/f4a 2748680 0 2024-09-12T22:11:30.760 INFO:tasks.workunit.client.0.smithi019.stdout:1/929: link d1/d2/d18/d70/fae d1/d2/d18/d70/f133 0 2024-09-12T22:11:30.763 INFO:tasks.workunit.client.0.smithi019.stdout:7/910: truncate da/d24/d28/d1c/d32/f3c 2708199 0 2024-09-12T22:11:30.763 INFO:tasks.workunit.client.0.smithi019.stdout:9/935: write d12/d1b/d40/d52/d62/de7/f117 [1052320,27355] 0 2024-09-12T22:11:30.764 INFO:tasks.workunit.client.0.smithi019.stdout:0/937: rename d5/d7/dac/db6/f11c to d5/d7/d2c/d44/d6a/d115/f135 0 2024-09-12T22:11:30.765 INFO:tasks.workunit.client.0.smithi019.stdout:5/971: dwrite d0/f63 [0,4194304] 0 2024-09-12T22:11:30.765 INFO:tasks.workunit.client.0.smithi019.stdout:8/899: dwrite d5/dc/d26/fcd [0,4194304] 0 2024-09-12T22:11:30.765 INFO:tasks.workunit.client.0.smithi019.stdout:7/911: chown da/d19/l44 0 1 2024-09-12T22:11:30.765 INFO:tasks.workunit.client.0.smithi019.stdout:8/900: chown d5/d16/d19/d29/cad 345435 1 2024-09-12T22:11:30.766 INFO:tasks.workunit.client.0.smithi019.stdout:5/972: sync 2024-09-12T22:11:30.766 INFO:tasks.workunit.client.0.smithi019.stdout:3/945: sync 2024-09-12T22:11:30.766 INFO:tasks.workunit.client.0.smithi019.stdout:3/946: stat d18/d1d/d8b/dc5/dbb/fd7 0 2024-09-12T22:11:30.767 INFO:tasks.workunit.client.0.smithi019.stdout:7/912: getdents da/d24/dff/dd9 0 2024-09-12T22:11:30.767 INFO:tasks.workunit.client.0.smithi019.stdout:5/973: write d0/f4 [239570,104191] 0 2024-09-12T22:11:30.769 INFO:tasks.workunit.client.0.smithi019.stdout:7/913: chown da/d24/d28/d1c/d32/d99/d9f/d11a 484 1 2024-09-12T22:11:30.770 INFO:tasks.workunit.client.0.smithi019.stdout:3/947: mkdir d18/d26/d30/d4e/d9a/dd5/d123 0 2024-09-12T22:11:30.770 INFO:tasks.workunit.client.0.smithi019.stdout:9/936: truncate d12/d1b/d40/d52/d62/f8c 3576940 0 2024-09-12T22:11:30.770 INFO:tasks.workunit.client.0.smithi019.stdout:8/901: truncate d5/d16/d19/f5b 3502930 0 2024-09-12T22:11:30.771 INFO:tasks.workunit.client.0.smithi019.stdout:1/930: sync 2024-09-12T22:11:30.771 INFO:tasks.workunit.client.0.smithi019.stdout:0/938: sync 2024-09-12T22:11:30.771 INFO:tasks.workunit.client.0.smithi019.stdout:7/914: sync 2024-09-12T22:11:30.772 INFO:tasks.workunit.client.0.smithi019.stdout:1/931: sync 2024-09-12T22:11:30.772 INFO:tasks.workunit.client.0.smithi019.stdout:9/937: symlink d12/d1b/d20/d64/l141 0 2024-09-12T22:11:30.772 INFO:tasks.workunit.client.0.smithi019.stdout:2/808: dwrite d0/d31/d12/d3b/f76 [0,4194304] 0 2024-09-12T22:11:30.772 INFO:tasks.workunit.client.0.smithi019.stdout:3/948: creat d18/d26/d30/f124 x:0 0 0 2024-09-12T22:11:30.772 INFO:tasks.workunit.client.0.smithi019.stdout:2/809: sync 2024-09-12T22:11:30.773 INFO:tasks.workunit.client.0.smithi019.stdout:0/939: dread - d5/d7/d2c/d81/de4/f128 zero size 2024-09-12T22:11:30.773 INFO:tasks.workunit.client.0.smithi019.stdout:5/974: write d0/d1d/d4f/d47/d57/d98/dd6/f110 [2042938,97044] 0 2024-09-12T22:11:30.774 INFO:tasks.workunit.client.0.smithi019.stdout:9/938: chown d12/d1b/d40/d52/l5f 8 1 2024-09-12T22:11:30.775 INFO:tasks.workunit.client.0.smithi019.stdout:7/915: rmdir da/d19/d79 39 2024-09-12T22:11:30.776 INFO:tasks.workunit.client.0.smithi019.stdout:3/949: write d18/d26/d30/d71/d86/f9e [2788955,118929] 0 2024-09-12T22:11:30.776 INFO:tasks.workunit.client.0.smithi019.stdout:5/975: dread d0/d1d/d3d/fe4 [0,4194304] 0 2024-09-12T22:11:30.776 INFO:tasks.workunit.client.0.smithi019.stdout:0/940: chown d5/d7/de/d8d 6261022 1 2024-09-12T22:11:30.777 INFO:tasks.workunit.client.0.smithi019.stdout:9/939: stat d12/dd7/dc7/d74/d77/d86/fff 0 2024-09-12T22:11:30.779 INFO:tasks.workunit.client.0.smithi019.stdout:3/950: write f17 [2515865,32345] 0 2024-09-12T22:11:30.780 INFO:tasks.workunit.client.0.smithi019.stdout:7/916: creat da/d24/d28/d1c/d32/dc2/dca/f136 x:0 0 0 2024-09-12T22:11:30.780 INFO:tasks.workunit.client.0.smithi019.stdout:0/941: fsync d5/d7/d2c/d44/d6a/d46/f11d 0 2024-09-12T22:11:30.780 INFO:tasks.workunit.client.0.smithi019.stdout:9/940: chown d12/dd7/dc7/d92/d9d/feb 22 1 2024-09-12T22:11:30.781 INFO:tasks.workunit.client.0.smithi019.stdout:8/902: dwrite d5/d16/f28 [4194304,4194304] 0 2024-09-12T22:11:30.781 INFO:tasks.workunit.client.0.smithi019.stdout:5/976: dread d0/d1d/d3d/fc6 [0,4194304] 0 2024-09-12T22:11:30.782 INFO:tasks.workunit.client.0.smithi019.stdout:1/932: dwrite d1/d2/d18/d35/fda [0,4194304] 0 2024-09-12T22:11:30.782 INFO:tasks.workunit.client.0.smithi019.stdout:4/937: dread d9/d14/d57/d95/dbe/dc6/f5c [0,4194304] 0 2024-09-12T22:11:30.782 INFO:tasks.workunit.client.0.smithi019.stdout:2/810: dread d0/d3/d11/d77/d78/d2c/d30/d32/f81 [0,4194304] 0 2024-09-12T22:11:30.783 INFO:tasks.workunit.client.0.smithi019.stdout:8/903: stat d5/dc/d17/c88 0 2024-09-12T22:11:30.783 INFO:tasks.workunit.client.0.smithi019.stdout:1/933: readlink d1/d2/d18/d29/d27/l80 0 2024-09-12T22:11:30.784 INFO:tasks.workunit.client.0.smithi019.stdout:4/938: chown d9/d14/d33 83733131 1 2024-09-12T22:11:30.785 INFO:tasks.workunit.client.0.smithi019.stdout:3/951: truncate f16 2029035 0 2024-09-12T22:11:30.785 INFO:tasks.workunit.client.0.smithi019.stdout:0/942: mkdir d5/d7/d10/d26/d8a/daf/d136 0 2024-09-12T22:11:30.785 INFO:tasks.workunit.client.0.smithi019.stdout:7/917: write da/d19/d25/f9e [866930,41345] 0 2024-09-12T22:11:30.786 INFO:tasks.workunit.client.0.smithi019.stdout:8/904: write d5/d16/d19/f40 [2352925,27513] 0 2024-09-12T22:11:30.788 INFO:tasks.workunit.client.0.smithi019.stdout:7/918: readlink da/d19/d25/d39/l6d 0 2024-09-12T22:11:30.788 INFO:tasks.workunit.client.0.smithi019.stdout:1/934: chown d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/cde 1777 1 2024-09-12T22:11:30.789 INFO:tasks.workunit.client.0.smithi019.stdout:4/939: rename d9/d4c/d76/dc9/df0/de2 to d9/d14/d57/d95/dbe/dc6/d3f/d13a 0 2024-09-12T22:11:30.789 INFO:tasks.workunit.client.0.smithi019.stdout:7/919: unlink da/d19/d25/l96 0 2024-09-12T22:11:30.790 INFO:tasks.workunit.client.0.smithi019.stdout:1/935: mkdir d1/d2/d18/d35/d84/df8/d55/d10b/d134 0 2024-09-12T22:11:30.790 INFO:tasks.workunit.client.0.smithi019.stdout:3/952: creat d18/d1d/d8b/db5/df5/f125 x:0 0 0 2024-09-12T22:11:30.791 INFO:tasks.workunit.client.0.smithi019.stdout:2/811: dwrite d0/d3/d11/d2e/d64/f6d [4194304,4194304] 0 2024-09-12T22:11:30.791 INFO:tasks.workunit.client.0.smithi019.stdout:5/977: write d0/f2 [4409014,69795] 0 2024-09-12T22:11:30.791 INFO:tasks.workunit.client.0.smithi019.stdout:0/943: rmdir d5/de2/dfe 0 2024-09-12T22:11:30.791 INFO:tasks.workunit.client.0.smithi019.stdout:8/905: write d5/dc/d8d/d96/f105 [163920,103074] 0 2024-09-12T22:11:30.792 INFO:tasks.workunit.client.0.smithi019.stdout:7/920: write da/d24/d28/f98 [1001821,98139] 0 2024-09-12T22:11:30.793 INFO:tasks.workunit.client.0.smithi019.stdout:0/944: mknod d5/de2/c137 0 2024-09-12T22:11:30.794 INFO:tasks.workunit.client.0.smithi019.stdout:8/906: creat d5/dc/d8d/d96/da7/f12b x:0 0 0 2024-09-12T22:11:30.795 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:30.793+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:30.796 INFO:tasks.workunit.client.0.smithi019.stdout:7/921: creat da/d24/dff/d116/f137 x:0 0 0 2024-09-12T22:11:30.796 INFO:tasks.workunit.client.0.smithi019.stdout:0/945: write d5/d7/d10/fee [1617391,22653] 0 2024-09-12T22:11:30.796 INFO:tasks.workunit.client.0.smithi019.stdout:2/812: rename d0/d31/d4/f22 to d0/d3/d11/d77/d82/f10c 0 2024-09-12T22:11:30.797 INFO:tasks.workunit.client.0.smithi019.stdout:8/907: mknod d5/dc/d26/d4b/c12c 0 2024-09-12T22:11:30.797 INFO:tasks.workunit.client.0.smithi019.stdout:5/978: read d0/d1d/d3d/ff1 [3242052,6235] 0 2024-09-12T22:11:30.800 INFO:tasks.workunit.client.0.smithi019.stdout:4/940: dwrite d9/d14/fa2 [4194304,4194304] 0 2024-09-12T22:11:30.800 INFO:tasks.workunit.client.0.smithi019.stdout:2/813: dread - d0/d3/d11/d77/d78/d2c/d56/f102 zero size 2024-09-12T22:11:30.801 INFO:tasks.workunit.client.0.smithi019.stdout:8/908: mknod d5/d53/d66/d69/c12d 0 2024-09-12T22:11:30.801 INFO:tasks.workunit.client.0.smithi019.stdout:0/946: chown d5/d7/d2c/d44/d6a/d46/db2/l12d 1 1 2024-09-12T22:11:30.801 INFO:tasks.workunit.client.0.smithi019.stdout:3/953: dwrite d18/fc8 [0,4194304] 0 2024-09-12T22:11:30.801 INFO:tasks.workunit.client.0.smithi019.stdout:0/947: stat d5/d7/de/la0 0 2024-09-12T22:11:30.801 INFO:tasks.workunit.client.0.smithi019.stdout:2/814: fsync d0/d3/d11/d77/d78/d2c/d30/d32/de5/f90 0 2024-09-12T22:11:30.803 INFO:tasks.workunit.client.0.smithi019.stdout:4/941: mkdir d9/de5/d13b 0 2024-09-12T22:11:30.804 INFO:tasks.workunit.client.0.smithi019.stdout:8/909: mknod d5/dc/d26/d4b/c12e 0 2024-09-12T22:11:30.804 INFO:tasks.workunit.client.0.smithi019.stdout:2/815: creat d0/d3/f10d x:0 0 0 2024-09-12T22:11:30.804 INFO:tasks.workunit.client.0.smithi019.stdout:0/948: readlink d5/d7/lc4 0 2024-09-12T22:11:30.804 INFO:tasks.workunit.client.0.smithi019.stdout:4/942: stat d9/d4c/d76/dc9/df0/d8f/d93/dad/fbc 0 2024-09-12T22:11:30.805 INFO:tasks.workunit.client.0.smithi019.stdout:8/910: link d5/f23 d5/dc/d26/d43/d49/d92/d10d/f12f 0 2024-09-12T22:11:30.806 INFO:tasks.workunit.client.0.smithi019.stdout:2/816: getdents d0/d3/df/d7b/d80/d9a 0 2024-09-12T22:11:30.807 INFO:tasks.workunit.client.0.smithi019.stdout:0/949: truncate d5/d7/d2c/d44/d6a/d46/db2/ff3 1018373 0 2024-09-12T22:11:30.807 INFO:tasks.workunit.client.0.smithi019.stdout:0/950: stat d5/d7/l2d 0 2024-09-12T22:11:30.808 INFO:tasks.workunit.client.0.smithi019.stdout:2/817: link d0/f42 d0/d31/d4/f10e 0 2024-09-12T22:11:30.808 INFO:tasks.workunit.client.0.smithi019.stdout:0/951: write d5/fd5 [613675,62935] 0 2024-09-12T22:11:30.809 INFO:tasks.workunit.client.0.smithi019.stdout:4/943: dread d9/d4c/fdf [0,4194304] 0 2024-09-12T22:11:30.811 INFO:tasks.workunit.client.0.smithi019.stdout:4/944: symlink d9/d14/l13c 0 2024-09-12T22:11:30.812 INFO:tasks.workunit.client.0.smithi019.stdout:8/911: dwrite d5/dc/d17/dce/fcf [0,4194304] 0 2024-09-12T22:11:30.813 INFO:tasks.workunit.client.0.smithi019.stdout:8/912: truncate d5/d53/f89 4632642 0 2024-09-12T22:11:30.814 INFO:tasks.workunit.client.0.smithi019.stdout:8/913: write d5/fe8 [2605027,75911] 0 2024-09-12T22:11:30.815 INFO:tasks.workunit.client.0.smithi019.stdout:8/914: readlink d5/d53/d66/ld3 0 2024-09-12T22:11:30.816 INFO:tasks.workunit.client.0.smithi019.stdout:9/941: dread d12/d1b/d40/fe4 [0,4194304] 0 2024-09-12T22:11:30.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/936: dread d1/d2/d18/d35/d84/dc/df/d2c/f49 [0,4194304] 0 2024-09-12T22:11:30.817 INFO:tasks.workunit.client.0.smithi019.stdout:0/952: dwrite d5/d7/d2c/dc1/f103 [0,4194304] 0 2024-09-12T22:11:30.817 INFO:tasks.workunit.client.0.smithi019.stdout:8/915: fdatasync d5/dc/d26/d5c/f113 0 2024-09-12T22:11:30.818 INFO:tasks.workunit.client.0.smithi019.stdout:8/916: chown d5/dc/d26/d43/d49/d92/ca0 359 1 2024-09-12T22:11:30.820 INFO:tasks.workunit.client.0.smithi019.stdout:9/942: symlink d12/dd7/dc7/d92/dac/l142 0 2024-09-12T22:11:30.820 INFO:tasks.workunit.client.0.smithi019.stdout:8/917: write d5/dc/f6d [687757,52072] 0 2024-09-12T22:11:30.820 INFO:tasks.workunit.client.0.smithi019.stdout:0/953: creat d5/d7/d10/d26/d8a/daf/d136/f138 x:0 0 0 2024-09-12T22:11:30.821 INFO:tasks.workunit.client.0.smithi019.stdout:1/937: getdents d1/d37 0 2024-09-12T22:11:30.821 INFO:tasks.workunit.client.0.smithi019.stdout:0/954: symlink d5/d88/dea/l139 0 2024-09-12T22:11:30.822 INFO:tasks.workunit.client.0.smithi019.stdout:9/943: creat d12/dd7/dc7/d92/dac/f143 x:0 0 0 2024-09-12T22:11:30.823 INFO:tasks.workunit.client.0.smithi019.stdout:1/938: creat d1/d2/d18/d35/d84/dc/df/d61/f135 x:0 0 0 2024-09-12T22:11:30.823 INFO:tasks.workunit.client.0.smithi019.stdout:0/955: chown d5/d7/d10/d26/d2a/c6c 238884 1 2024-09-12T22:11:30.825 INFO:tasks.workunit.client.0.smithi019.stdout:0/956: symlink d5/d7/d10/l13a 0 2024-09-12T22:11:30.825 INFO:tasks.workunit.client.0.smithi019.stdout:1/939: mkdir d1/d2/d18/d35/d84/d136 0 2024-09-12T22:11:30.826 INFO:tasks.workunit.client.0.smithi019.stdout:9/944: getdents d12/dd7/dc7/d88 0 2024-09-12T22:11:30.827 INFO:tasks.workunit.client.0.smithi019.stdout:8/918: dwrite d5/dc/d8a/fbc [0,4194304] 0 2024-09-12T22:11:30.828 INFO:tasks.workunit.client.0.smithi019.stdout:0/957: write d5/d7/dac/db6/f124 [197530,12192] 0 2024-09-12T22:11:30.829 INFO:tasks.workunit.client.0.smithi019.stdout:1/940: mkdir d1/d2/d18/d35/d84/df8/d11e/d137 0 2024-09-12T22:11:30.829 INFO:tasks.workunit.client.0.smithi019.stdout:8/919: write d5/dc/d26/d4b/f91 [9236496,9130] 0 2024-09-12T22:11:30.830 INFO:tasks.workunit.client.0.smithi019.stdout:0/958: rmdir d5/d7/dac 39 2024-09-12T22:11:30.830 INFO:tasks.workunit.client.0.smithi019.stdout:8/920: stat d5/c86 0 2024-09-12T22:11:30.830 INFO:tasks.workunit.client.0.smithi019.stdout:1/941: unlink d1/d83/fc8 0 2024-09-12T22:11:30.831 INFO:tasks.workunit.client.0.smithi019.stdout:1/942: creat d1/d2/d18/d35/d84/df8/d11e/f138 x:0 0 0 2024-09-12T22:11:30.832 INFO:tasks.workunit.client.0.smithi019.stdout:8/921: rename d5/dc/ff9 to d5/d16/d19/d29/f130 0 2024-09-12T22:11:30.832 INFO:tasks.workunit.client.0.smithi019.stdout:1/943: creat d1/d129/f139 x:0 0 0 2024-09-12T22:11:30.833 INFO:tasks.workunit.client.0.smithi019.stdout:3/954: dread d18/d26/d30/d4a/f62 [0,4194304] 0 2024-09-12T22:11:30.833 INFO:tasks.workunit.client.0.smithi019.stdout:5/979: dread d0/d24/d97/fce [0,4194304] 0 2024-09-12T22:11:30.834 INFO:tasks.workunit.client.0.smithi019.stdout:3/955: write d18/d1d/f3b [2788543,9385] 0 2024-09-12T22:11:30.834 INFO:tasks.workunit.client.0.smithi019.stdout:1/944: chown d1/d2/d18/d35/d84/fee 27316882 1 2024-09-12T22:11:30.834 INFO:tasks.workunit.client.0.smithi019.stdout:4/945: dread d9/d87/d109/f7e [0,4194304] 0 2024-09-12T22:11:30.835 INFO:tasks.workunit.client.0.smithi019.stdout:4/946: dread - d9/d58/f11f zero size 2024-09-12T22:11:30.836 INFO:tasks.workunit.client.0.smithi019.stdout:1/945: rename d1/d2/d18/d35/d84/fb3 to d1/d2/d18/f13a 0 2024-09-12T22:11:30.837 INFO:tasks.workunit.client.0.smithi019.stdout:4/947: dread - d9/d14/d33/fff zero size 2024-09-12T22:11:30.837 INFO:tasks.workunit.client.0.smithi019.stdout:0/959: dread d5/d7/de/d9a/f9b [0,4194304] 0 2024-09-12T22:11:30.838 INFO:tasks.workunit.client.0.smithi019.stdout:4/948: symlink d9/d4c/d9c/d112/l13d 0 2024-09-12T22:11:30.839 INFO:tasks.workunit.client.0.smithi019.stdout:0/960: write d5/d7/d2c/d44/d6a/d52/fe1 [2439613,123049] 0 2024-09-12T22:11:30.840 INFO:tasks.workunit.client.0.smithi019.stdout:1/946: dread - d1/d2/d18/d35/d84/dc/df/d11d/f128 zero size 2024-09-12T22:11:30.841 INFO:tasks.workunit.client.0.smithi019.stdout:4/949: mkdir d9/d14/d57/d95/dbe/d6f/d13e 0 2024-09-12T22:11:30.841 INFO:tasks.workunit.client.0.smithi019.stdout:3/956: dwrite d18/d26/d30/d71/d86/f90 [0,4194304] 0 2024-09-12T22:11:30.841 INFO:tasks.workunit.client.0.smithi019.stdout:7/922: sync 2024-09-12T22:11:30.841 INFO:tasks.workunit.client.0.smithi019.stdout:2/818: sync 2024-09-12T22:11:30.843 INFO:tasks.workunit.client.0.smithi019.stdout:1/947: fdatasync d1/d2/d18/d35/d84/dc/df/fb7 0 2024-09-12T22:11:30.843 INFO:tasks.workunit.client.0.smithi019.stdout:2/819: write d0/d3/df/d52/fd0 [220958,102419] 0 2024-09-12T22:11:30.845 INFO:tasks.workunit.client.0.smithi019.stdout:4/950: stat d9/d14/d57/d95/dbe/dc6/l59 0 2024-09-12T22:11:30.845 INFO:tasks.workunit.client.0.smithi019.stdout:1/948: dread - d1/d2/d18/d35/d84/dc/df/d11d/f128 zero size 2024-09-12T22:11:30.845 INFO:tasks.workunit.client.0.smithi019.stdout:7/923: stat da/d24/dff/le6 0 2024-09-12T22:11:30.846 INFO:tasks.workunit.client.0.smithi019.stdout:1/949: fdatasync d1/d2/fe2 0 2024-09-12T22:11:30.847 INFO:tasks.workunit.client.0.smithi019.stdout:1/950: fdatasync d1/d2/da2/f114 0 2024-09-12T22:11:30.848 INFO:tasks.workunit.client.0.smithi019.stdout:4/951: getdents d9/d4c/d76/df2/d110 0 2024-09-12T22:11:30.848 INFO:tasks.workunit.client.0.smithi019.stdout:2/820: truncate d0/d3/d11/d77/d78/d2c/d30/d32/de5/fb4 2641513 0 2024-09-12T22:11:30.848 INFO:tasks.workunit.client.0.smithi019.stdout:7/924: dread - da/d19/d25/d39/d51/dd7/db1/db5/db6/db8/f11c zero size 2024-09-12T22:11:30.849 INFO:tasks.workunit.client.0.smithi019.stdout:8/922: dread d5/dc/d26/d76/fef [0,4194304] 0 2024-09-12T22:11:30.850 INFO:tasks.workunit.client.0.smithi019.stdout:1/951: fdatasync d1/d2/d18/d29/d27/f6a 0 2024-09-12T22:11:30.851 INFO:tasks.workunit.client.0.smithi019.stdout:5/980: dread d0/d1d/d3d/ff1 [0,4194304] 0 2024-09-12T22:11:30.851 INFO:tasks.workunit.client.0.smithi019.stdout:7/925: symlink da/d24/d28/d1c/d32/d94/l138 0 2024-09-12T22:11:30.852 INFO:tasks.workunit.client.0.smithi019.stdout:8/923: read d5/dc/d26/d5c/f93 [2057026,107419] 0 2024-09-12T22:11:30.853 INFO:tasks.workunit.client.0.smithi019.stdout:5/981: fsync d0/d4e/f5a 0 2024-09-12T22:11:30.853 INFO:tasks.workunit.client.0.smithi019.stdout:4/952: write d9/d14/d57/d95/dbe/dc6/f5c [306880,19010] 0 2024-09-12T22:11:30.854 INFO:tasks.workunit.client.0.smithi019.stdout:9/945: dread d12/d1b/d40/d52/f65 [4194304,4194304] 0 2024-09-12T22:11:30.854 INFO:tasks.workunit.client.0.smithi019.stdout:8/924: creat d5/dc/d8a/f131 x:0 0 0 2024-09-12T22:11:30.854 INFO:tasks.workunit.client.0.smithi019.stdout:5/982: fdatasync d0/d24/d7a/f8f 0 2024-09-12T22:11:30.855 INFO:tasks.workunit.client.0.smithi019.stdout:4/953: symlink d9/d14/d12f/l13f 0 2024-09-12T22:11:30.856 INFO:tasks.workunit.client.0.smithi019.stdout:5/983: stat d0/d1d/d3d/d128 0 2024-09-12T22:11:30.857 INFO:tasks.workunit.client.0.smithi019.stdout:1/952: dread d1/d2/d18/d35/fda [0,4194304] 0 2024-09-12T22:11:30.858 INFO:tasks.workunit.client.0.smithi019.stdout:5/984: creat d0/d24/d97/f141 x:0 0 0 2024-09-12T22:11:30.858 INFO:tasks.workunit.client.0.smithi019.stdout:4/954: getdents d9/d14/d57/d9b 0 2024-09-12T22:11:30.858 INFO:tasks.workunit.client.0.smithi019.stdout:5/985: readlink d0/d26/d3a/l3c 0 2024-09-12T22:11:30.859 INFO:tasks.workunit.client.0.smithi019.stdout:4/955: mkdir d9/db/d2b/dc7/d140 0 2024-09-12T22:11:30.859 INFO:tasks.workunit.client.0.smithi019.stdout:5/986: creat d0/d1d/d6d/f142 x:0 0 0 2024-09-12T22:11:30.860 INFO:tasks.workunit.client.0.smithi019.stdout:1/953: creat d1/d2/d18/d35/f13b x:0 0 0 2024-09-12T22:11:30.860 INFO:tasks.workunit.client.0.smithi019.stdout:9/946: truncate d12/dd7/dc7/fc2 2233114 0 2024-09-12T22:11:30.861 INFO:tasks.workunit.client.0.smithi019.stdout:4/956: rename d9/d87/fcf to d9/d4c/d76/dc9/df0/d8f/f141 0 2024-09-12T22:11:30.862 INFO:tasks.workunit.client.0.smithi019.stdout:0/961: dread d5/d7/d10/d26/d2a/f92 [0,4194304] 0 2024-09-12T22:11:30.863 INFO:tasks.workunit.client.0.smithi019.stdout:1/954: symlink d1/d2/d18/d35/d84/df8/d55/d56/l13c 0 2024-09-12T22:11:30.864 INFO:tasks.workunit.client.0.smithi019.stdout:3/957: dread d18/f1b [4194304,4194304] 0 2024-09-12T22:11:30.865 INFO:tasks.workunit.client.0.smithi019.stdout:1/955: unlink d1/d2/d18/d35/f13b 0 2024-09-12T22:11:30.867 INFO:tasks.workunit.client.0.smithi019.stdout:0/962: mkdir d5/d7/d2c/d44/db7/d13b 0 2024-09-12T22:11:30.869 INFO:tasks.workunit.client.0.smithi019.stdout:2/821: dread d0/d3/d11/d2e/d64/fb1 [0,4194304] 0 2024-09-12T22:11:30.870 INFO:tasks.workunit.client.0.smithi019.stdout:5/987: dread d0/f19 [0,4194304] 0 2024-09-12T22:11:30.871 INFO:tasks.workunit.client.0.smithi019.stdout:9/947: dwrite d12/dd7/dc7/d56/df5/f109 [0,4194304] 0 2024-09-12T22:11:30.872 INFO:tasks.workunit.client.0.smithi019.stdout:4/957: dwrite d9/d14/d57/d95/dbe/dc6/d3f/d13a/f114 [0,4194304] 0 2024-09-12T22:11:30.873 INFO:tasks.workunit.client.0.smithi019.stdout:3/958: dwrite d18/f34 [0,4194304] 0 2024-09-12T22:11:30.873 INFO:tasks.workunit.client.0.smithi019.stdout:9/948: chown d12/d1b/d20/d64/d83/cd4 851015 1 2024-09-12T22:11:30.873 INFO:tasks.workunit.client.0.smithi019.stdout:2/822: chown d0/d3/d11/d2e/d70/d10a 119505617 1 2024-09-12T22:11:30.875 INFO:tasks.workunit.client.0.smithi019.stdout:4/958: write d9/d87/f10a [880593,32212] 0 2024-09-12T22:11:30.877 INFO:tasks.workunit.client.0.smithi019.stdout:9/949: rmdir d12/d1b/d40/d85/de8/def 39 2024-09-12T22:11:30.877 INFO:tasks.workunit.client.0.smithi019.stdout:4/959: rmdir d9/d4c/d9c/d112 39 2024-09-12T22:11:30.877 INFO:tasks.workunit.client.0.smithi019.stdout:1/956: dwrite d1/d2/d18/d35/d84/dc/f32 [0,4194304] 0 2024-09-12T22:11:30.878 INFO:tasks.workunit.client.0.smithi019.stdout:3/959: truncate d18/d26/d30/d4e/fdd 494354 0 2024-09-12T22:11:30.878 INFO:tasks.workunit.client.0.smithi019.stdout:5/988: dwrite d0/d26/d42/df0/f138 [0,4194304] 0 2024-09-12T22:11:30.879 INFO:tasks.workunit.client.0.smithi019.stdout:4/960: mkdir d9/db/d142 0 2024-09-12T22:11:30.881 INFO:tasks.workunit.client.0.smithi019.stdout:5/989: chown d0/d26/d6f/lb0 46994509 1 2024-09-12T22:11:30.881 INFO:tasks.workunit.client.0.smithi019.stdout:1/957: creat d1/d2/d18/d35/d84/df8/d55/d10b/f13d x:0 0 0 2024-09-12T22:11:30.882 INFO:tasks.workunit.client.0.smithi019.stdout:4/961: creat d9/de5/d13b/f143 x:0 0 0 2024-09-12T22:11:30.882 INFO:tasks.workunit.client.0.smithi019.stdout:8/925: dread d5/dc/d26/d43/d7d/ffe [0,4194304] 0 2024-09-12T22:11:30.883 INFO:tasks.workunit.client.0.smithi019.stdout:4/962: chown f5 21667 1 2024-09-12T22:11:30.886 INFO:tasks.workunit.client.0.smithi019.stdout:8/926: mkdir d5/dc/d8d/d96/da7/d132 0 2024-09-12T22:11:30.886 INFO:tasks.workunit.client.0.smithi019.stdout:2/823: dwrite d0/d3/d11/d77/d78/d2c/d30/d32/f81 [0,4194304] 0 2024-09-12T22:11:30.886 INFO:tasks.workunit.client.0.smithi019.stdout:9/950: dwrite d12/d1b/d20/d59/d5b/fdc [0,4194304] 0 2024-09-12T22:11:30.887 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:30.884+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:30.887 INFO:tasks.workunit.client.0.smithi019.stdout:9/951: write d12/d1b/d20/d25/f5d [36064,63691] 0 2024-09-12T22:11:30.890 INFO:tasks.workunit.client.0.smithi019.stdout:8/927: truncate d5/dc/d8d/d96/fe7 898442 0 2024-09-12T22:11:30.891 INFO:tasks.workunit.client.0.smithi019.stdout:1/958: dwrite d1/d2/f12f [0,4194304] 0 2024-09-12T22:11:30.891 INFO:tasks.workunit.client.0.smithi019.stdout:9/952: truncate d12/d1b/d40/f58 317987 0 2024-09-12T22:11:30.891 INFO:tasks.workunit.client.0.smithi019.stdout:8/928: readlink d5/dc/d26/d43/lb1 0 2024-09-12T22:11:30.892 INFO:tasks.workunit.client.0.smithi019.stdout:7/926: dread da/d19/f41 [0,4194304] 0 2024-09-12T22:11:30.892 INFO:tasks.workunit.client.0.smithi019.stdout:9/953: write d12/d1b/d40/f70 [5836172,70652] 0 2024-09-12T22:11:30.893 INFO:tasks.workunit.client.0.smithi019.stdout:1/959: write d1/d2/d18/d35/d84/dc/df/d61/f52 [1031834,64446] 0 2024-09-12T22:11:30.893 INFO:tasks.workunit.client.0.smithi019.stdout:4/963: getdents d9/d14/d57/d95/dbe/dc6/deb 0 2024-09-12T22:11:30.894 INFO:tasks.workunit.client.0.smithi019.stdout:7/927: write da/d8f/f7f [1287237,52660] 0 2024-09-12T22:11:30.895 INFO:tasks.workunit.client.0.smithi019.stdout:9/954: getdents d12/d1b/d40/d52 0 2024-09-12T22:11:30.896 INFO:tasks.workunit.client.0.smithi019.stdout:1/960: getdents d1/d2/d18/d35/d84/d121 0 2024-09-12T22:11:30.896 INFO:tasks.workunit.client.0.smithi019.stdout:4/964: unlink d9/d4c/d76/dc9/df0/d8f/fbb 0 2024-09-12T22:11:30.896 INFO:tasks.workunit.client.0.smithi019.stdout:2/824: dwrite d0/d31/d12/f83 [0,4194304] 0 2024-09-12T22:11:30.897 INFO:tasks.workunit.client.0.smithi019.stdout:2/825: write d0/d31/d4/fef [1000563,91054] 0 2024-09-12T22:11:30.898 INFO:tasks.workunit.client.0.smithi019.stdout:1/961: stat d1/d2/d18/d35/d84/dc/df/d2c/d5d/ddd/cfa 0 2024-09-12T22:11:30.898 INFO:tasks.workunit.client.0.smithi019.stdout:4/965: mknod d9/d4c/d76/df2/d110/d130/c144 0 2024-09-12T22:11:30.898 INFO:tasks.workunit.client.0.smithi019.stdout:7/928: rename da/d19/d25/d39/f6b to da/d19/d25/d39/d51/dd7/db1/db5/db6/db8/f139 0 2024-09-12T22:11:30.901 INFO:tasks.workunit.client.0.smithi019.stdout:4/966: stat d9/d4c/c56 0 2024-09-12T22:11:30.901 INFO:tasks.workunit.client.0.smithi019.stdout:1/962: fdatasync d1/d2/d18/d35/d84/dc/df/f74 0 2024-09-12T22:11:30.901 INFO:tasks.workunit.client.0.smithi019.stdout:4/967: stat d9/d4c 0 2024-09-12T22:11:30.901 INFO:tasks.workunit.client.0.smithi019.stdout:2/826: creat d0/d3/d11/d77/d78/d2c/f10f x:0 0 0 2024-09-12T22:11:30.903 INFO:tasks.workunit.client.0.smithi019.stdout:4/968: rmdir d9/d14/d57/d95/d96/ddd/dfc 39 2024-09-12T22:11:30.903 INFO:tasks.workunit.client.0.smithi019.stdout:2/827: write d0/d31/fa3 [2468997,34691] 0 2024-09-12T22:11:30.904 INFO:tasks.workunit.client.0.smithi019.stdout:4/969: truncate d9/db/d2b/f37 4502527 0 2024-09-12T22:11:30.905 INFO:tasks.workunit.client.0.smithi019.stdout:4/970: fdatasync d9/db/f24 0 2024-09-12T22:11:30.905 INFO:tasks.workunit.client.0.smithi019.stdout:9/955: dwrite d12/dd7/dc7/f2d [0,4194304] 0 2024-09-12T22:11:30.906 INFO:tasks.workunit.client.0.smithi019.stdout:9/956: fsync d12/d1b/d20/d25/ffb 0 2024-09-12T22:11:30.907 INFO:tasks.workunit.client.0.smithi019.stdout:2/828: truncate d0/d3/d11/d77/d78/fdf 2231957 0 2024-09-12T22:11:30.907 INFO:tasks.workunit.client.0.smithi019.stdout:9/957: mknod d12/d1b/d20/d64/d83/c144 0 2024-09-12T22:11:30.907 INFO:tasks.workunit.client.0.smithi019.stdout:4/971: getdents d9/d58 0 2024-09-12T22:11:30.908 INFO:tasks.workunit.client.0.smithi019.stdout:1/963: dwrite d1/fb1 [0,4194304] 0 2024-09-12T22:11:30.908 INFO:tasks.workunit.client.0.smithi019.stdout:9/958: creat d12/d1b/d20/d25/f145 x:0 0 0 2024-09-12T22:11:30.909 INFO:tasks.workunit.client.0.smithi019.stdout:2/829: creat d0/d3/df/d7b/d44/de9/f110 x:0 0 0 2024-09-12T22:11:30.909 INFO:tasks.workunit.client.0.smithi019.stdout:9/959: fsync d12/fe1 0 2024-09-12T22:11:30.909 INFO:tasks.workunit.client.0.smithi019.stdout:4/972: creat d9/d17/f145 x:0 0 0 2024-09-12T22:11:30.910 INFO:tasks.workunit.client.0.smithi019.stdout:0/963: sync 2024-09-12T22:11:30.910 INFO:tasks.workunit.client.0.smithi019.stdout:3/960: sync 2024-09-12T22:11:30.910 INFO:tasks.workunit.client.0.smithi019.stdout:1/964: mkdir d1/d2/d18/d35/d84/d136/d13e 0 2024-09-12T22:11:30.911 INFO:tasks.workunit.client.0.smithi019.stdout:2/830: fdatasync d0/d3/d11/d77/d78/d2c/d30/d32/f4a 0 2024-09-12T22:11:30.913 INFO:tasks.workunit.client.0.smithi019.stdout:3/961: write f17 [3230066,33503] 0 2024-09-12T22:11:30.914 INFO:tasks.workunit.client.0.smithi019.stdout:4/973: rename d9/d14/d57/d95/dbe/dc6 to d9/d58/d146 0 2024-09-12T22:11:30.914 INFO:tasks.workunit.client.0.smithi019.stdout:1/965: truncate d1/d2/d18/d35/d84/dc/df/f107 695342 0 2024-09-12T22:11:30.916 INFO:tasks.workunit.client.0.smithi019.stdout:4/974: mkdir d9/db/d2b/dc7/d140/d147 0 2024-09-12T22:11:30.916 INFO:tasks.workunit.client.0.smithi019.stdout:2/831: chown d0/d3/d11/d77/d78/d2c/d30/d32/c75 1563124 1 2024-09-12T22:11:30.917 INFO:tasks.workunit.client.0.smithi019.stdout:3/962: rename d18/d26/d30/d71/d86/f90 to d18/d26/d30/d91/f126 0 2024-09-12T22:11:30.917 INFO:tasks.workunit.client.0.smithi019.stdout:4/975: chown d9/db/d2b/df7 133118 1 2024-09-12T22:11:30.918 INFO:tasks.workunit.client.0.smithi019.stdout:9/960: dwrite d12/d1b/fbf [0,4194304] 0 2024-09-12T22:11:30.918 INFO:tasks.workunit.client.0.smithi019.stdout:1/966: write d1/d2/d18/d70/fb6 [1525829,97283] 0 2024-09-12T22:11:30.918 INFO:tasks.workunit.client.0.smithi019.stdout:2/832: fsync d0/d3/d11/d77/fa2 0 2024-09-12T22:11:30.919 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:30.919 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:30.919 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:30.919 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:30.919 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:30.919 INFO:tasks.workunit.client.0.smithi019.stdout:4/976: symlink d9/d4c/d9c/l148 0 2024-09-12T22:11:30.920 INFO:tasks.workunit.client.0.smithi019.stdout:3/963: creat d18/d26/d30/d4e/d9a/dd5/f127 x:0 0 0 2024-09-12T22:11:30.924 INFO:tasks.workunit.client.0.smithi019.stdout:4/977: rmdir d9/d14/d57/d95 39 2024-09-12T22:11:30.925 INFO:tasks.workunit.client.0.smithi019.stdout:4/978: chown d9/db/d2b/dc7/d128 1687370 1 2024-09-12T22:11:30.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/961: rename d12/d48/l8b to d12/d1b/d40/d85/de8/l146 0 2024-09-12T22:11:30.925 INFO:tasks.workunit.client.0.smithi019.stdout:4/979: readlink d9/d58/d146/l138 0 2024-09-12T22:11:30.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/962: mknod d12/d1b/d20/d64/d83/dd1/c147 0 2024-09-12T22:11:30.925 INFO:tasks.workunit.client.0.smithi019.stdout:3/964: dread d18/d26/d30/d91/f126 [0,4194304] 0 2024-09-12T22:11:30.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/963: dread - d12/d1b/d20/d64/d83/faf zero size 2024-09-12T22:11:30.925 INFO:tasks.workunit.client.0.smithi019.stdout:2/833: truncate d0/d3/d11/d77/d82/f10c 212170 0 2024-09-12T22:11:30.926 INFO:tasks.workunit.client.0.smithi019.stdout:3/965: write d18/d1d/d8b/dc5/dbb/f11a [583303,108247] 0 2024-09-12T22:11:30.926 INFO:tasks.workunit.client.0.smithi019.stdout:9/964: unlink d12/f15 0 2024-09-12T22:11:30.927 INFO:tasks.workunit.client.0.smithi019.stdout:3/966: write d18/d26/d30/d4e/d9a/dd5/f110 [528930,122644] 0 2024-09-12T22:11:30.928 INFO:tasks.workunit.client.0.smithi019.stdout:9/965: unlink d12/dd7/dc7/d74/d77/l131 0 2024-09-12T22:11:30.932 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:30.933 INFO:tasks.workunit.client.0.smithi019.stdout:2/834: write d0/d3/d11/d77/d78/d2c/d2d/fe6 [2967179,781] 0 2024-09-12T22:11:30.933 INFO:tasks.workunit.client.0.smithi019.stdout:3/967: read d18/d1d/d35/fea [589901,4021] 0 2024-09-12T22:11:30.934 INFO:tasks.workunit.client.0.smithi019.stdout:0/964: dread d5/d7/d2c/d44/d6a/d46/f5c [0,4194304] 0 2024-09-12T22:11:30.934 INFO:tasks.workunit.client.0.smithi019.stdout:4/980: dread d9/d17/f84 [0,4194304] 0 2024-09-12T22:11:30.935 INFO:tasks.workunit.client.0.smithi019.stdout:2/835: chown d0/d3/df/d7b/d80/d9a 11 1 2024-09-12T22:11:30.936 INFO:tasks.workunit.client.0.smithi019.stdout:9/966: dwrite d12/d1b/d20/d59/d5b/d9e/fc1 [0,4194304] 0 2024-09-12T22:11:30.936 INFO:tasks.workunit.client.0.smithi019.stdout:4/981: symlink d9/d58/d146/d3f/l149 0 2024-09-12T22:11:30.937 INFO:tasks.workunit.client.0.smithi019.stdout:2/836: dread - d0/d3/d11/d77/d78/d2c/d56/f102 zero size 2024-09-12T22:11:30.938 INFO:tasks.workunit.client.0.smithi019.stdout:5/990: dread d0/d26/d3a/f5c [0,4194304] 0 2024-09-12T22:11:30.938 INFO:tasks.workunit.client.0.smithi019.stdout:3/968: read d18/d26/d30/d4e/d9a/dae/fb7 [4062225,78117] 0 2024-09-12T22:11:30.939 INFO:tasks.workunit.client.0.smithi019.stdout:7/929: dread da/d24/d28/d1c/d32/f3c [0,4194304] 0 2024-09-12T22:11:30.940 INFO:tasks.workunit.client.0.smithi019.stdout:5/991: rename d0/d24/d97 to d0/d26/d42/d143 0 2024-09-12T22:11:30.940 INFO:tasks.workunit.client.0.smithi019.stdout:9/967: fsync d12/d48/f61 0 2024-09-12T22:11:30.941 INFO:tasks.workunit.client.0.smithi019.stdout:5/992: dread - d0/d24/d58/f11f zero size 2024-09-12T22:11:30.941 INFO:tasks.workunit.client.0.smithi019.stdout:7/930: fdatasync da/d19/d25/d39/d51/dd7/ff9 0 2024-09-12T22:11:30.942 INFO:tasks.workunit.client.0.smithi019.stdout:4/982: getdents d9/d58/d146/d3f/d13a 0 2024-09-12T22:11:30.943 INFO:tasks.workunit.client.0.smithi019.stdout:8/929: dread d5/dc/d26/d4b/d101/f108 [0,4194304] 0 2024-09-12T22:11:30.943 INFO:tasks.workunit.client.0.smithi019.stdout:1/967: dread d1/d2/d18/d35/d84/d98/fc2 [0,4194304] 0 2024-09-12T22:11:30.943 INFO:tasks.workunit.client.0.smithi019.stdout:7/931: chown da/d24/d28/ffe 7257124 1 2024-09-12T22:11:30.944 INFO:tasks.workunit.client.0.smithi019.stdout:5/993: rename d0/d4e/d50/cbd to d0/d26/d5f/dc3/c144 0 2024-09-12T22:11:30.944 INFO:tasks.workunit.client.0.smithi019.stdout:2/837: truncate d0/d3/df/d7b/dbe/fda 2005374 0 2024-09-12T22:11:30.944 INFO:tasks.workunit.client.0.smithi019.stdout:3/969: write d18/d1d/d8b/fa3 [504138,33722] 0 2024-09-12T22:11:30.945 INFO:tasks.workunit.client.0.smithi019.stdout:4/983: getdents d9/d17/ddb 0 2024-09-12T22:11:30.946 INFO:tasks.workunit.client.0.smithi019.stdout:7/932: truncate da/d24/d28/d1c/d32/f89 1198362 0 2024-09-12T22:11:30.946 INFO:tasks.workunit.client.0.smithi019.stdout:1/968: link d1/d2/d18/d29/d27/l80 d1/d2/d18/d35/d84/d6e/l13f 0 2024-09-12T22:11:30.946 INFO:tasks.workunit.client.0.smithi019.stdout:5/994: write d0/d24/d7a/f8f [1549286,93786] 0 2024-09-12T22:11:30.947 INFO:tasks.workunit.client.0.smithi019.stdout:3/970: truncate d18/d1d/d8b/db5/df5/f125 902200 0 2024-09-12T22:11:30.948 INFO:tasks.workunit.client.0.smithi019.stdout:9/968: dwrite d12/dd7/dc7/d56/d60/f67 [0,4194304] 0 2024-09-12T22:11:30.948 INFO:tasks.workunit.client.0.smithi019.stdout:5/995: dread - d0/d1d/d4f/d47/fb4 zero size 2024-09-12T22:11:30.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/969: write d1/d2/d18/f1c [2551853,111016] 0 2024-09-12T22:11:30.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/970: chown d1/d2/f24 1384 1 2024-09-12T22:11:30.949 INFO:tasks.workunit.client.0.smithi019.stdout:4/984: creat d9/d4c/d76/dc9/df0/d8f/d93/dad/f14a x:0 0 0 2024-09-12T22:11:30.950 INFO:tasks.workunit.client.0.smithi019.stdout:5/996: mkdir d0/d1d/d6d/d11e/d145 0 2024-09-12T22:11:30.951 INFO:tasks.workunit.client.0.smithi019.stdout:9/969: creat d12/d1b/d40/d10e/f148 x:0 0 0 2024-09-12T22:11:30.951 INFO:tasks.workunit.client.0.smithi019.stdout:2/838: truncate d0/d31/d4/f16 3917784 0 2024-09-12T22:11:30.951 INFO:tasks.workunit.client.0.smithi019.stdout:1/971: write d1/d2/d18/d35/d84/fee [2072335,40285] 0 2024-09-12T22:11:30.951 INFO:tasks.workunit.client.0.smithi019.stdout:5/997: chown d0/c21 10408 1 2024-09-12T22:11:30.953 INFO:tasks.workunit.client.0.smithi019.stdout:9/970: creat d12/d1b/d20/d59/d5b/d9a/f149 x:0 0 0 2024-09-12T22:11:30.953 INFO:tasks.workunit.client.0.smithi019.stdout:4/985: read d9/d58/f68 [8231279,1994] 0 2024-09-12T22:11:30.953 INFO:tasks.workunit.client.0.smithi019.stdout:1/972: chown d1/d2/d18/d35/d84/df8/d55 11446 1 2024-09-12T22:11:30.953 INFO:tasks.workunit.client.0.smithi019.stdout:2/839: write d0/d31/d4/f10e [4022268,14685] 0 2024-09-12T22:11:30.954 INFO:tasks.workunit.client.0.smithi019.stdout:4/986: mknod d9/d58/c14b 0 2024-09-12T22:11:30.954 INFO:tasks.workunit.client.0.smithi019.stdout:7/933: dwrite da/d19/d25/f2e [0,4194304] 0 2024-09-12T22:11:30.956 INFO:tasks.workunit.client.0.smithi019.stdout:3/971: dwrite d18/d1d/d35/fea [0,4194304] 0 2024-09-12T22:11:30.956 INFO:tasks.workunit.client.0.smithi019.stdout:1/973: write d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8/f118 [230611,68379] 0 2024-09-12T22:11:30.959 INFO:tasks.workunit.client.0.smithi019.stdout:4/987: fsync d9/d58/d146/d3f/f91 0 2024-09-12T22:11:30.959 INFO:tasks.workunit.client.0.smithi019.stdout:7/934: creat da/d24/d28/d1c/d32/daf/dfa/f13a x:0 0 0 2024-09-12T22:11:30.961 INFO:tasks.workunit.client.0.smithi019.stdout:9/971: getdents d12/dd7/dc7/d74/d77/d86/ddf 0 2024-09-12T22:11:30.962 INFO:tasks.workunit.client.0.smithi019.stdout:4/988: creat d9/db/d2b/de0/f14c x:0 0 0 2024-09-12T22:11:30.962 INFO:tasks.workunit.client.0.smithi019.stdout:7/935: chown da/d24/d28/d1c/c86 121448 1 2024-09-12T22:11:30.962 INFO:tasks.workunit.client.0.smithi019.stdout:3/972: truncate d18/d26/da5/dbd/f10b 665740 0 2024-09-12T22:11:30.962 INFO:tasks.workunit.client.0.smithi019.stdout:9/972: dread - d12/d1b/d40/d85/de8/f118 zero size 2024-09-12T22:11:30.963 INFO:tasks.workunit.client.0.smithi019.stdout:1/974: dwrite d1/d2/fe2 [0,4194304] 0 2024-09-12T22:11:30.964 INFO:tasks.workunit.client.0.smithi019.stdout:7/936: write da/d24/d28/f57 [2247745,24772] 0 2024-09-12T22:11:30.964 INFO:tasks.workunit.client.0.smithi019.stdout:9/973: dread - d12/d1b/d40/d85/de8/def/f105 zero size 2024-09-12T22:11:30.964 INFO:tasks.workunit.client.0.smithi019.stdout:7/937: readlink da/d24/l81 0 2024-09-12T22:11:30.965 INFO:tasks.workunit.client.0.smithi019.stdout:1/975: stat d1/d2/d18/d35/d84/d98/fc2 0 2024-09-12T22:11:30.965 INFO:tasks.workunit.client.0.smithi019.stdout:9/974: stat d12/d1b/d20/d64/d83/dd1/f132 0 2024-09-12T22:11:30.965 INFO:tasks.workunit.client.0.smithi019.stdout:2/840: read d0/d3/df/d7b/d44/de9/f104 [307030,121664] 0 2024-09-12T22:11:30.966 INFO:tasks.workunit.client.0.smithi019.stdout:7/938: fsync da/d19/d25/d39/fb0 0 2024-09-12T22:11:30.966 INFO:tasks.workunit.client.0.smithi019.stdout:4/989: write d9/db/d2b/f30 [828144,29363] 0 2024-09-12T22:11:30.966 INFO:tasks.workunit.client.0.smithi019.stdout:3/973: getdents d18/d26/d30/d71 0 2024-09-12T22:11:30.966 INFO:tasks.workunit.client.0.smithi019.stdout:1/976: dread - d1/d2/d18/d35/d84/df8/d55/d56/fff zero size 2024-09-12T22:11:30.967 INFO:tasks.workunit.client.0.smithi019.stdout:9/975: write d12/f30 [1938360,64631] 0 2024-09-12T22:11:30.967 INFO:tasks.workunit.client.0.smithi019.stdout:4/990: stat d9/db/d2b/dc7/f126 0 2024-09-12T22:11:30.967 INFO:tasks.workunit.client.0.smithi019.stdout:3/974: dread - d18/d26/d30/fef zero size 2024-09-12T22:11:30.967 INFO:tasks.workunit.client.0.smithi019.stdout:7/939: fdatasync da/d30/f117 0 2024-09-12T22:11:30.968 INFO:tasks.workunit.client.0.smithi019.stdout:2/841: write d0/d3/d11/d77/d78/d2c/d2d/de4/fe8 [738673,54497] 0 2024-09-12T22:11:30.968 INFO:tasks.workunit.client.0.smithi019.stdout:4/991: symlink d9/db/d2b/l14d 0 2024-09-12T22:11:30.968 INFO:tasks.workunit.client.0.smithi019.stdout:1/977: creat d1/d2/d18/d35/d84/d136/f140 x:0 0 0 2024-09-12T22:11:30.969 INFO:tasks.workunit.client.0.smithi019.stdout:3/975: mkdir d18/d26/d30/d4e/d80/df2/d128 0 2024-09-12T22:11:30.969 INFO:tasks.workunit.client.0.smithi019.stdout:7/940: rmdir da/d24/d28 39 2024-09-12T22:11:30.969 INFO:tasks.workunit.client.0.smithi019.stdout:9/976: read d12/d1b/d20/da0/f120 [528521,60647] 0 2024-09-12T22:11:30.969 INFO:tasks.workunit.client.0.smithi019.stdout:4/992: write d9/d58/ff4 [184397,96288] 0 2024-09-12T22:11:30.970 INFO:tasks.workunit.client.0.smithi019.stdout:2/842: creat d0/d3/de1/f111 x:0 0 0 2024-09-12T22:11:30.970 INFO:tasks.workunit.client.0.smithi019.stdout:1/978: chown d1/d2/d18/d29/d51/la9 0 1 2024-09-12T22:11:30.970 INFO:tasks.workunit.client.0.smithi019.stdout:2/843: fdatasync d0/fd7 0 2024-09-12T22:11:30.970 INFO:tasks.workunit.client.0.smithi019.stdout:3/976: chown d18/d26/d30/d64/f121 1 1 2024-09-12T22:11:30.971 INFO:tasks.workunit.client.0.smithi019.stdout:9/977: creat d12/d1b/d20/d64/d83/f14a x:0 0 0 2024-09-12T22:11:30.971 INFO:tasks.workunit.client.0.smithi019.stdout:7/941: rename da/d24/f2c to da/d24/dff/d116/d131/f13b 0 2024-09-12T22:11:30.971 INFO:tasks.workunit.client.0.smithi019.stdout:2/844: fdatasync d0/d3/d11/d77/fa2 0 2024-09-12T22:11:30.971 INFO:tasks.workunit.client.0.smithi019.stdout:7/942: mkdir da/d24/dff/d13c 0 2024-09-12T22:11:30.971 INFO:tasks.workunit.client.0.smithi019.stdout:9/978: write d12/d1b/d20/d59/f122 [265581,33410] 0 2024-09-12T22:11:30.972 INFO:tasks.workunit.client.0.smithi019.stdout:2/845: mknod d0/d3/d11/d77/d82/df3/dba/c112 0 2024-09-12T22:11:30.972 INFO:tasks.workunit.client.0.smithi019.stdout:7/943: symlink da/d19/d25/d39/d51/df8/l13d 0 2024-09-12T22:11:30.973 INFO:tasks.workunit.client.0.smithi019.stdout:9/979: rename d12/dd7/dc7/d74/d77 to d12/d1b/d20/db0/d14b 0 2024-09-12T22:11:30.974 INFO:tasks.workunit.client.0.smithi019.stdout:9/980: readlink d12/d1b/d20/db0/d14b/l91 0 2024-09-12T22:11:30.974 INFO:tasks.workunit.client.0.smithi019.stdout:0/965: sync 2024-09-12T22:11:30.974 INFO:tasks.workunit.client.0.smithi019.stdout:1/979: sync 2024-09-12T22:11:30.975 INFO:tasks.workunit.client.0.smithi019.stdout:2/846: read d0/d3/d11/d2e/d70/d10a/fd4 [3306119,110288] 0 2024-09-12T22:11:30.976 INFO:tasks.workunit.client.0.smithi019.stdout:7/944: rename da/d24/d28/f98 to da/d24/d28/d1c/d32/df0/f13e 0 2024-09-12T22:11:30.976 INFO:tasks.workunit.client.0.smithi019.stdout:3/977: dwrite d18/d26/d30/d4e/f52 [0,4194304] 0 2024-09-12T22:11:30.976 INFO:tasks.workunit.client.0.smithi019.stdout:9/981: write d12/d1b/d20/d59/f122 [283922,120513] 0 2024-09-12T22:11:30.976 INFO:tasks.workunit.client.0.smithi019.stdout:0/966: read - d5/d7/de/d8d/fc0 zero size 2024-09-12T22:11:30.977 INFO:tasks.workunit.client.0.smithi019.stdout:3/978: write d18/f56 [126794,9310] 0 2024-09-12T22:11:30.977 INFO:tasks.workunit.client.0.smithi019.stdout:2/847: read - d0/d3/d11/d77/d78/d2c/d56/fe2 zero size 2024-09-12T22:11:30.977 INFO:tasks.workunit.client.0.smithi019.stdout:1/980: rmdir d1/d2/d18/d35/d84/dc/df/d2c/d5d/db8 39 2024-09-12T22:11:30.978 INFO:tasks.workunit.client.0.smithi019.stdout:3/979: creat d18/d1d/d8b/dc5/d105/f129 x:0 0 0 2024-09-12T22:11:30.978 INFO:tasks.workunit.client.0.smithi019.stdout:0/967: creat d5/d7/d2c/d44/d6a/d46/db2/f13c x:0 0 0 2024-09-12T22:11:30.979 INFO:tasks.workunit.client.0.smithi019.stdout:2/848: dread - d0/d3/d11/d77/d82/df3/fe7 zero size 2024-09-12T22:11:30.979 INFO:tasks.workunit.client.0.smithi019.stdout:0/968: chown d5/c14 788855315 1 2024-09-12T22:11:30.979 INFO:tasks.workunit.client.0.smithi019.stdout:9/982: getdents d12/d1b/d20/d59/d5b/d9e 0 2024-09-12T22:11:30.981 INFO:tasks.workunit.client.0.smithi019.stdout:1/981: rename d1/d2/d18/d35/d84/dc/df/d61/f52 to d1/d2/d18/d35/d84/dc/df/d61/f141 0 2024-09-12T22:11:30.981 INFO:tasks.workunit.client.0.smithi019.stdout:4/993: sync 2024-09-12T22:11:30.981 INFO:tasks.workunit.client.0.smithi019.stdout:8/930: sync 2024-09-12T22:11:30.981 INFO:tasks.workunit.client.0.smithi019.stdout:5/998: sync 2024-09-12T22:11:30.981 INFO:tasks.workunit.client.0.smithi019.stdout:0/969: creat d5/d7/d10/d26/d2a/f13d x:0 0 0 2024-09-12T22:11:30.982 INFO:tasks.workunit.client.0.smithi019.stdout:8/931: chown d5 107006 1 2024-09-12T22:11:30.983 INFO:tasks.workunit.client.0.smithi019.stdout:4/994: creat d9/db/dcd/dc1/f14e x:0 0 0 2024-09-12T22:11:30.983 INFO:tasks.workunit.client.0.smithi019.stdout:5/999: mkdir d0/d26/d5f/d146 0 2024-09-12T22:11:30.983 INFO:tasks.workunit.client.0.smithi019.stdout:8/932: readlink d5/d16/d19/d29/l46 0 2024-09-12T22:11:30.984 INFO:tasks.workunit.client.0.smithi019.stdout:1/982: fdatasync d1/d2/d18/d35/d84/d98/dbc/fe5 0 2024-09-12T22:11:30.985 INFO:tasks.workunit.client.0.smithi019.stdout:4/995: chown d9/db/dcd/dc1/f14e 0 1 2024-09-12T22:11:30.985 INFO:tasks.workunit.client.0.smithi019.stdout:3/980: dwrite d18/d26/fd3 [8388608,4194304] 0 2024-09-12T22:11:30.987 INFO:tasks.workunit.client.0.smithi019.stdout:1/983: chown d1/d2/d18/d35/d84/d6e/f126 237311 1 2024-09-12T22:11:30.988 INFO:tasks.workunit.client.0.smithi019.stdout:4/996: creat d9/d14/f14f x:0 0 0 2024-09-12T22:11:30.988 INFO:tasks.workunit.client.0.smithi019.stdout:3/981: mknod d18/d26/d30/d4e/d9a/dd5/d123/c12a 0 2024-09-12T22:11:30.990 INFO:tasks.workunit.client.0.smithi019.stdout:9/983: dwrite d12/d1b/d40/d85/de8/def/ffe [0,4194304] 0 2024-09-12T22:11:30.990 INFO:tasks.workunit.client.0.smithi019.stdout:0/970: dwrite d5/d7/dac/db6/f101 [0,4194304] 0 2024-09-12T22:11:30.991 INFO:tasks.workunit.client.0.smithi019.stdout:0/971: chown d5/d7/d2c/fe0 93 1 2024-09-12T22:11:30.992 INFO:tasks.workunit.client.0.smithi019.stdout:3/982: mknod d18/d1d/d8b/dc5/c12b 0 2024-09-12T22:11:30.993 INFO:tasks.workunit.client.0.smithi019.stdout:4/997: symlink d9/d14/d57/d95/d96/ddd/dc5/dd5/l150 0 2024-09-12T22:11:30.993 INFO:tasks.workunit.client.0.smithi019.stdout:0/972: symlink d5/d7/d2c/d44/d6a/d46/db2/l13e 0 2024-09-12T22:11:30.994 INFO:tasks.workunit.client.0.smithi019.stdout:9/984: creat d12/d1b/d40/d52/d119/f14c x:0 0 0 2024-09-12T22:11:30.995 INFO:tasks.workunit.client.0.smithi019.stdout:0/973: mknod d5/d7/d2c/d81/c13f 0 2024-09-12T22:11:30.995 INFO:tasks.workunit.client.0.smithi019.stdout:9/985: mknod d12/d1b/d40/d85/c14d 0 2024-09-12T22:11:30.995 INFO:tasks.workunit.client.0.smithi019.stdout:3/983: mkdir d18/d26/d30/d4e/d80/df2/d117/d12c 0 2024-09-12T22:11:30.995 INFO:tasks.workunit.client.0.smithi019.stdout:0/974: read - d5/d88/f130 zero size 2024-09-12T22:11:30.995 INFO:tasks.workunit.client.0.smithi019.stdout:3/984: mknod d18/d1d/c12d 0 2024-09-12T22:11:30.995 INFO:tasks.workunit.client.0.smithi019.stdout:9/986: chown d12/d1b/d20/db0/d14b/d86/cca 28 1 2024-09-12T22:11:30.996 INFO:tasks.workunit.client.0.smithi019.stdout:0/975: truncate d5/d7/d2c/d44/d6a/d46/f10f 267445 0 2024-09-12T22:11:30.998 INFO:tasks.workunit.client.0.smithi019.stdout:0/976: mkdir d5/d7/d2c/ddc/d140 0 2024-09-12T22:11:30.998 INFO:tasks.workunit.client.0.smithi019.stdout:9/987: rename d12/d1b/d40/d85 to d12/d1b/d20/db0/d14b/d86/ddf/df2/d14e 0 2024-09-12T22:11:30.998 INFO:tasks.workunit.client.0.smithi019.stdout:4/998: write f7 [1328510,93174] 0 2024-09-12T22:11:31.000 INFO:tasks.workunit.client.0.smithi019.stdout:7/945: dread da/d24/d28/f57 [0,4194304] 0 2024-09-12T22:11:31.001 INFO:tasks.workunit.client.0.smithi019.stdout:0/977: fdatasync d5/d7/d2c/d81/dcb/deb/f12a 0 2024-09-12T22:11:31.001 INFO:tasks.workunit.client.0.smithi019.stdout:9/988: creat d12/d1b/d20/db0/d14b/f14f x:0 0 0 2024-09-12T22:11:31.002 INFO:tasks.workunit.client.0.smithi019.stdout:3/985: dwrite d18/d26/d30/f3c [0,4194304] 0 2024-09-12T22:11:31.003 INFO:tasks.workunit.client.0.smithi019.stdout:9/989: chown d12/d1b/d20/d59/d5b/d9e/f7f 438459 1 2024-09-12T22:11:31.004 INFO:tasks.workunit.client.0.smithi019.stdout:4/999: dwrite f7 [0,4194304] 0 2024-09-12T22:11:31.004 INFO:tasks.workunit.client.0.smithi019.stdout:3/986: chown d18/d26/dce/df6/c10c 4 1 2024-09-12T22:11:31.007 INFO:tasks.workunit.client.0.smithi019.stdout:0/978: creat d5/d7/d10/d26/d8a/daf/df9/f141 x:0 0 0 2024-09-12T22:11:31.007 INFO:tasks.workunit.client.0.smithi019.stdout:7/946: rename da/d19/d25/d39/f71 to da/d24/d28/d1c/d32/d94/f13f 0 2024-09-12T22:11:31.007 INFO:tasks.workunit.client.0.smithi019.stdout:8/933: dread d5/d16/d19/f50 [0,4194304] 0 2024-09-12T22:11:31.009 INFO:tasks.workunit.client.0.smithi019.stdout:9/990: creat d12/d1b/d40/d52/d62/f150 x:0 0 0 2024-09-12T22:11:31.009 INFO:tasks.workunit.client.0.smithi019.stdout:9/991: stat d12/dd7/dc7/d56/d60 0 2024-09-12T22:11:31.009 INFO:tasks.workunit.client.0.smithi019.stdout:7/947: symlink da/d19/d25/d39/d134/l140 0 2024-09-12T22:11:31.010 INFO:tasks.workunit.client.0.smithi019.stdout:9/992: chown d12/d1b/d20/db0/cd9 196 1 2024-09-12T22:11:31.011 INFO:tasks.workunit.client.0.smithi019.stdout:7/948: symlink da/d19/d25/d39/d51/l141 0 2024-09-12T22:11:31.014 INFO:tasks.workunit.client.0.smithi019.stdout:7/949: write da/d24/d28/d1c/d32/d94/fde [471560,26764] 0 2024-09-12T22:11:31.014 INFO:tasks.workunit.client.0.smithi019.stdout:8/934: dwrite d5/dc/d26/d43/d49/d92/fb6 [0,4194304] 0 2024-09-12T22:11:31.014 INFO:tasks.workunit.client.0.smithi019.stdout:0/979: dwrite d5/d7/d2c/d44/f74 [0,4194304] 0 2024-09-12T22:11:31.017 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:31.015+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:31.017 INFO:tasks.workunit.client.0.smithi019.stdout:0/980: symlink d5/d7/d2c/d44/l142 0 2024-09-12T22:11:31.017 INFO:tasks.workunit.client.0.smithi019.stdout:7/950: write da/d19/d25/d39/d51/dd7/db1/db5/db6/db8/f139 [707100,30546] 0 2024-09-12T22:11:31.018 INFO:tasks.workunit.client.0.smithi019.stdout:9/993: dwrite d12/d1b/d40/d52/d62/de7/f133 [0,4194304] 0 2024-09-12T22:11:31.020 INFO:tasks.workunit.client.0.smithi019.stdout:8/935: dwrite d5/d16/d19/d29/f4d [0,4194304] 0 2024-09-12T22:11:31.022 INFO:tasks.workunit.client.0.smithi019.stdout:9/994: unlink d12/d1b/d20/da0/f120 0 2024-09-12T22:11:31.022 INFO:tasks.workunit.client.0.smithi019.stdout:7/951: creat da/d24/d28/d1c/d32/dc2/f142 x:0 0 0 2024-09-12T22:11:31.022 INFO:tasks.workunit.client.0.smithi019.stdout:0/981: creat d5/d7/d10/d26/d8a/daf/d136/f143 x:0 0 0 2024-09-12T22:11:31.023 INFO:tasks.workunit.client.0.smithi019.stdout:9/995: write d12/d1b/f7d [3680123,4793] 0 2024-09-12T22:11:31.024 INFO:tasks.workunit.client.0.smithi019.stdout:0/982: fsync d5/d7/f5f 0 2024-09-12T22:11:31.025 INFO:tasks.workunit.client.0.smithi019.stdout:7/952: mknod da/d19/d79/d12a/c143 0 2024-09-12T22:11:31.025 INFO:tasks.workunit.client.0.smithi019.stdout:2/849: sync 2024-09-12T22:11:31.025 INFO:tasks.workunit.client.0.smithi019.stdout:1/984: sync 2024-09-12T22:11:31.025 INFO:tasks.workunit.client.0.smithi019.stdout:8/936: dwrite d5/dc/d26/d4b/df5/ffc [0,4194304] 0 2024-09-12T22:11:31.026 INFO:tasks.workunit.client.0.smithi019.stdout:7/953: rmdir da/d24/d28 39 2024-09-12T22:11:31.027 INFO:tasks.workunit.client.0.smithi019.stdout:7/954: dread - da/d19/d79/d120/f128 zero size 2024-09-12T22:11:31.028 INFO:tasks.workunit.client.0.smithi019.stdout:2/850: write d0/d3/d11/d77/d78/d2c/d56/fe2 [846263,106745] 0 2024-09-12T22:11:31.029 INFO:tasks.workunit.client.0.smithi019.stdout:1/985: creat d1/d2/d18/d35/d84/dc/df/d61/d10a/f142 x:0 0 0 2024-09-12T22:11:31.029 INFO:tasks.workunit.client.0.smithi019.stdout:0/983: link d5/d7/d2c/fa9 d5/d7/d2c/d44/db7/f144 0 2024-09-12T22:11:31.029 INFO:tasks.workunit.client.0.smithi019.stdout:8/937: symlink d5/dc/d26/d43/d49/d92/d10d/l133 0 2024-09-12T22:11:31.029 INFO:tasks.workunit.client.0.smithi019.stdout:1/986: readlink d1/d2/d18/d29/d51/la9 0 2024-09-12T22:11:31.030 INFO:tasks.workunit.client.0.smithi019.stdout:9/996: dwrite d12/dd7/dc7/d56/f79 [0,4194304] 0 2024-09-12T22:11:31.030 INFO:tasks.workunit.client.0.smithi019.stdout:1/987: dread - d1/d129/f139 zero size 2024-09-12T22:11:31.032 INFO:tasks.workunit.client.0.smithi019.stdout:7/955: creat da/d24/d101/f144 x:0 0 0 2024-09-12T22:11:31.032 INFO:tasks.workunit.client.0.smithi019.stdout:1/988: symlink d1/d37/l143 0 2024-09-12T22:11:31.033 INFO:tasks.workunit.client.0.smithi019.stdout:9/997: unlink d12/d1b/d20/db0/d14b/d86/ddf/df2/d14e/de8/l146 0 2024-09-12T22:11:31.033 INFO:tasks.workunit.client.0.smithi019.stdout:1/989: creat d1/d2/d18/d35/d84/d98/f144 x:0 0 0 2024-09-12T22:11:31.034 INFO:tasks.workunit.client.0.smithi019.stdout:1/990: creat d1/d2/d18/d70/f145 x:0 0 0 2024-09-12T22:11:31.035 INFO:tasks.workunit.client.0.smithi019.stdout:2/851: truncate d0/d3/d11/d77/d78/d2c/d56/d60/fc9 1925120 0 2024-09-12T22:11:31.035 INFO:tasks.workunit.client.0.smithi019.stdout:8/938: dread d5/d53/d66/f99 [0,4194304] 0 2024-09-12T22:11:31.036 INFO:tasks.workunit.client.0.smithi019.stdout:2/852: chown d0/d3/d11/da9/l109 32 1 2024-09-12T22:11:31.036 INFO:tasks.workunit.client.0.smithi019.stdout:8/939: fdatasync d5/dc/d26/d43/d7d/ffe 0 2024-09-12T22:11:31.037 INFO:tasks.workunit.client.0.smithi019.stdout:1/991: truncate d1/d2/d18/d35/d84/df8/d55/d10b/f13d 180325 0 2024-09-12T22:11:31.037 INFO:tasks.workunit.client.0.smithi019.stdout:2/853: creat d0/d31/d12/d15/f113 x:0 0 0 2024-09-12T22:11:31.037 INFO:tasks.workunit.client.0.smithi019.stdout:8/940: unlink d5/dc/d26/d43/d49/l8b 0 2024-09-12T22:11:31.038 INFO:tasks.workunit.client.0.smithi019.stdout:1/992: write d1/d2/d18/d35/d84/dc/df/d61/f1b [134202,126910] 0 2024-09-12T22:11:31.038 INFO:tasks.workunit.client.0.smithi019.stdout:8/941: mkdir d5/dc/d8a/d8e/d134 0 2024-09-12T22:11:31.039 INFO:tasks.workunit.client.0.smithi019.stdout:8/942: stat d5/dc/d26/dc8/c109 0 2024-09-12T22:11:31.040 INFO:tasks.workunit.client.0.smithi019.stdout:9/998: read d12/d1b/d20/d59/d5b/d9e/f7f [4140825,49604] 0 2024-09-12T22:11:31.040 INFO:tasks.workunit.client.0.smithi019.stdout:8/943: creat d5/dc/d26/d43/d49/d7a/f135 x:0 0 0 2024-09-12T22:11:31.041 INFO:tasks.workunit.client.0.smithi019.stdout:7/956: read da/d30/d9c/fb2 [321342,9642] 0 2024-09-12T22:11:31.043 INFO:tasks.workunit.client.0.smithi019.stdout:9/999: link d12/d1b/d20/db0/cd9 d12/d1b/c151 0 2024-09-12T22:11:31.043 INFO:tasks.workunit.client.0.smithi019.stdout:2/854: dwrite d0/d3/d11/d77/d78/d2c/d56/d60/f74 [0,4194304] 0 2024-09-12T22:11:31.043 INFO:tasks.workunit.client.0.smithi019.stdout:8/944: mknod d5/dc/d26/d76/d10e/d11b/d125/c136 0 2024-09-12T22:11:31.044 INFO:tasks.workunit.client.0.smithi019.stdout:2/855: creat d0/d3/df/f114 x:0 0 0 2024-09-12T22:11:31.046 INFO:tasks.workunit.client.0.smithi019.stdout:7/957: link da/d8f/la7 da/d24/d28/d1c/d32/d99/dc8/df4/l145 0 2024-09-12T22:11:31.046 INFO:tasks.workunit.client.0.smithi019.stdout:2/856: symlink d0/d3/d11/d77/l115 0 2024-09-12T22:11:31.047 INFO:tasks.workunit.client.0.smithi019.stdout:8/945: creat d5/dc/d26/d43/d49/d7a/df8/d11d/f137 x:0 0 0 2024-09-12T22:11:31.048 INFO:tasks.workunit.client.0.smithi019.stdout:3/987: dread f17 [0,4194304] 0 2024-09-12T22:11:31.049 INFO:tasks.workunit.client.0.smithi019.stdout:7/958: write da/d24/d28/d1c/d32/daf/f100 [569545,106255] 0 2024-09-12T22:11:31.050 INFO:tasks.workunit.client.0.smithi019.stdout:3/988: write d18/d26/f36 [3324674,124007] 0 2024-09-12T22:11:31.052 INFO:tasks.workunit.client.0.smithi019.stdout:3/989: symlink d18/d26/l12e 0 2024-09-12T22:11:31.053 INFO:tasks.workunit.client.0.smithi019.stdout:1/993: dread d1/d2/da2/fa5 [0,4194304] 0 2024-09-12T22:11:31.054 INFO:tasks.workunit.client.0.smithi019.stdout:2/857: dwrite d0/d3/d11/d2e/d64/dce/d51/f89 [0,4194304] 0 2024-09-12T22:11:31.055 INFO:tasks.workunit.client.0.smithi019.stdout:1/994: fdatasync d1/ddb/ff0 0 2024-09-12T22:11:31.055 INFO:tasks.workunit.client.0.smithi019.stdout:8/946: dwrite d5/dc/d26/d43/d49/d7a/f135 [0,4194304] 0 2024-09-12T22:11:31.056 INFO:tasks.workunit.client.0.smithi019.stdout:2/858: chown d0/d3/d11/f5b 11 1 2024-09-12T22:11:31.056 INFO:tasks.workunit.client.0.smithi019.stdout:7/959: dwrite da/d19/d25/d39/d51/dd7/f64 [0,4194304] 0 2024-09-12T22:11:31.057 INFO:tasks.workunit.client.0.smithi019.stdout:1/995: write d1/d2/d18/d35/d84/d98/dbc/f117 [710569,118649] 0 2024-09-12T22:11:31.057 INFO:tasks.workunit.client.0.smithi019.stdout:8/947: rename d5/d53/d66/cdc to d5/d16/c138 0 2024-09-12T22:11:31.057 INFO:tasks.workunit.client.0.smithi019.stdout:2/859: symlink d0/d3/d11/l116 0 2024-09-12T22:11:31.057 INFO:tasks.workunit.client.0.smithi019.stdout:3/990: mknod d18/d1d/d8b/db5/df5/c12f 0 2024-09-12T22:11:31.058 INFO:tasks.workunit.client.0.smithi019.stdout:2/860: creat d0/f117 x:0 0 0 2024-09-12T22:11:31.058 INFO:tasks.workunit.client.0.smithi019.stdout:1/996: mknod d1/d2/d18/d59/c146 0 2024-09-12T22:11:31.059 INFO:tasks.workunit.client.0.smithi019.stdout:7/960: dread - da/d24/dff/d116/f137 zero size 2024-09-12T22:11:31.059 INFO:tasks.workunit.client.0.smithi019.stdout:8/948: getdents d5/dc/d26/dc8 0 2024-09-12T22:11:31.061 INFO:tasks.workunit.client.0.smithi019.stdout:7/961: dread - da/d24/d28/d1c/d32/dc2/dca/f136 zero size 2024-09-12T22:11:31.061 INFO:tasks.workunit.client.0.smithi019.stdout:1/997: creat d1/d2/d18/d35/d84/df8/f147 x:0 0 0 2024-09-12T22:11:31.061 INFO:tasks.workunit.client.0.smithi019.stdout:2/861: chown d0/d3/df/d6b/fab 289034243 1 2024-09-12T22:11:31.061 INFO:tasks.workunit.client.0.smithi019.stdout:8/949: write d5/d53/d66/f6f [292564,124059] 0 2024-09-12T22:11:31.062 INFO:tasks.workunit.client.0.smithi019.stdout:1/998: symlink d1/d2/d18/l148 0 2024-09-12T22:11:31.062 INFO:tasks.workunit.client.0.smithi019.stdout:2/862: creat d0/d3/d11/d77/f118 x:0 0 0 2024-09-12T22:11:31.062 INFO:tasks.workunit.client.0.smithi019.stdout:7/962: mknod da/d19/d25/d39/d51/dd7/db1/db5/d130/c146 0 2024-09-12T22:11:31.063 INFO:tasks.workunit.client.0.smithi019.stdout:7/963: readlink da/l6e 0 2024-09-12T22:11:31.063 INFO:tasks.workunit.client.0.smithi019.stdout:2/863: fsync d0/d3/df/d7b/d44/f93 0 2024-09-12T22:11:31.063 INFO:tasks.workunit.client.0.smithi019.stdout:3/991: getdents d18/d26/d30/d4e/d80/df2/d117/d12c 0 2024-09-12T22:11:31.063 INFO:tasks.workunit.client.0.smithi019.stdout:7/964: mknod da/d30/c147 0 2024-09-12T22:11:31.064 INFO:tasks.workunit.client.0.smithi019.stdout:3/992: readlink d18/d26/l79 0 2024-09-12T22:11:31.064 INFO:tasks.workunit.client.0.smithi019.stdout:2/864: write d0/d31/d12/d15/f113 [220284,13020] 0 2024-09-12T22:11:31.065 INFO:tasks.workunit.client.0.smithi019.stdout:1/999: rename d1/d2/d18/d35/d84/df8/d55/d56/f99 to d1/d2/d18/f149 0 2024-09-12T22:11:31.065 INFO:tasks.workunit.client.0.smithi019.stdout:8/950: dread d5/dc/d26/d4b/df5/ffc [0,4194304] 0 2024-09-12T22:11:31.065 INFO:tasks.workunit.client.0.smithi019.stdout:3/993: readlink d18/d26/d30/d71/d86/lb8 0 2024-09-12T22:11:31.066 INFO:tasks.workunit.client.0.smithi019.stdout:2/865: creat d0/d3/d11/d77/d82/df3/f119 x:0 0 0 2024-09-12T22:11:31.066 INFO:tasks.workunit.client.0.smithi019.stdout:3/994: write d18/d1d/d8b/dc5/dbb/fd7 [1415044,125980] 0 2024-09-12T22:11:31.066 INFO:tasks.workunit.client.0.smithi019.stdout:3/995: chown f13 129799 1 2024-09-12T22:11:31.067 INFO:tasks.workunit.client.0.smithi019.stdout:0/984: sync 2024-09-12T22:11:31.067 INFO:tasks.workunit.client.0.smithi019.stdout:8/951: link d5/d16/c70 d5/dc/d26/d4b/c139 0 2024-09-12T22:11:31.068 INFO:tasks.workunit.client.0.smithi019.stdout:8/952: write d5/d16/f28 [8245652,26844] 0 2024-09-12T22:11:31.068 INFO:tasks.workunit.client.0.smithi019.stdout:0/985: getdents d5/d7/de 0 2024-09-12T22:11:31.069 INFO:tasks.workunit.client.0.smithi019.stdout:8/953: write d5/dc/d8d/d96/da7/f12b [578337,50936] 0 2024-09-12T22:11:31.070 INFO:tasks.workunit.client.0.smithi019.stdout:8/954: read d5/dc/d26/d4b/fb8 [190987,121801] 0 2024-09-12T22:11:31.072 INFO:tasks.workunit.client.0.smithi019.stdout:7/965: dread da/d24/f74 [0,4194304] 0 2024-09-12T22:11:31.072 INFO:tasks.workunit.client.0.smithi019.stdout:7/966: readlink da/d30/l65 0 2024-09-12T22:11:31.073 INFO:tasks.workunit.client.0.smithi019.stdout:7/967: readlink da/d24/d28/l7b 0 2024-09-12T22:11:31.074 INFO:tasks.workunit.client.0.smithi019.stdout:7/968: unlink da/d24/d28/c1b 0 2024-09-12T22:11:31.076 INFO:tasks.workunit.client.0.smithi019.stdout:0/986: truncate d5/d7/d10/d26/d2a/f92 1066979 0 2024-09-12T22:11:31.076 INFO:tasks.workunit.client.0.smithi019.stdout:7/969: symlink da/d8f/l148 0 2024-09-12T22:11:31.076 INFO:tasks.workunit.client.0.smithi019.stdout:8/955: dwrite d5/dc/d8a/fbc [0,4194304] 0 2024-09-12T22:11:31.078 INFO:tasks.workunit.client.0.smithi019.stdout:0/987: write d5/d7/d2c/d44/d6a/d76/f7e [1354761,109231] 0 2024-09-12T22:11:31.078 INFO:tasks.workunit.client.0.smithi019.stdout:8/956: rename d5/dc/d26/d5c/f10a to d5/dc/d8a/d8e/f13a 0 2024-09-12T22:11:31.079 INFO:tasks.workunit.client.0.smithi019.stdout:8/957: write d5/dc/d26/d43/f57 [458407,28173] 0 2024-09-12T22:11:31.080 INFO:tasks.workunit.client.0.smithi019.stdout:7/970: dwrite da/d8f/fb4 [0,4194304] 0 2024-09-12T22:11:31.080 INFO:tasks.workunit.client.0.smithi019.stdout:0/988: truncate d5/d7/d2c/d81/dcb/deb/ff4 1220742 0 2024-09-12T22:11:31.081 INFO:tasks.workunit.client.0.smithi019.stdout:8/958: rename d5/f15 to d5/dc/d26/d76/d10e/d11b/d125/f13b 0 2024-09-12T22:11:31.081 INFO:tasks.workunit.client.0.smithi019.stdout:7/971: symlink da/d24/d101/l149 0 2024-09-12T22:11:31.081 INFO:tasks.workunit.client.0.smithi019.stdout:0/989: unlink d5/d7/d2c/d44/d6a/d46/db2/l13e 0 2024-09-12T22:11:31.082 INFO:tasks.workunit.client.0.smithi019.stdout:8/959: read - d5/dc/d8d/d96/da7/ff0 zero size 2024-09-12T22:11:31.083 INFO:tasks.workunit.client.0.smithi019.stdout:8/960: write d5/d53/d66/f6f [2025543,117942] 0 2024-09-12T22:11:31.083 INFO:tasks.workunit.client.0.smithi019.stdout:0/990: mknod d5/d7/d2c/d44/d6a/d46/db2/d10c/d129/c145 0 2024-09-12T22:11:31.085 INFO:tasks.workunit.client.0.smithi019.stdout:8/961: mknod d5/dc/d26/d4b/df5/d127/c13c 0 2024-09-12T22:11:31.085 INFO:tasks.workunit.client.0.smithi019.stdout:7/972: dwrite da/f11 [0,4194304] 0 2024-09-12T22:11:31.087 INFO:tasks.workunit.client.0.smithi019.stdout:8/962: fdatasync d5/dc/d26/d43/d49/d92/d10d/f12f 0 2024-09-12T22:11:31.087 INFO:tasks.workunit.client.0.smithi019.stdout:7/973: rename da/d8f to da/d24/d28/d1c/d32/dc2/d14a 0 2024-09-12T22:11:31.088 INFO:tasks.workunit.client.0.smithi019.stdout:8/963: chown d5/dc/d8d/d96 33105 1 2024-09-12T22:11:31.088 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:31.086+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:31.089 INFO:tasks.workunit.client.0.smithi019.stdout:0/991: dwrite d5/d7/d10/d26/d8a/f125 [0,4194304] 0 2024-09-12T22:11:31.090 INFO:tasks.workunit.client.0.smithi019.stdout:0/992: chown d5/d7/f4a 21 1 2024-09-12T22:11:31.091 INFO:tasks.workunit.client.0.smithi019.stdout:0/993: dread - d5/d7/d2c/d44/d6a/d46/db2/f12f zero size 2024-09-12T22:11:31.092 INFO:tasks.workunit.client.0.smithi019.stdout:0/994: rename d5/d7/fe8 to d5/d7/d2c/d44/d6a/d46/db2/f146 0 2024-09-12T22:11:31.097 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.376292435, 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.375691501, 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.364130376, 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.164286886999999, 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.164265038, 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.164250248, 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.164240379000001, 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.164226293, 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:31.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:31.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.2776503229999996, 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:31.144 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:31.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:31.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.9769788720000001, 2024-09-12T22:11:31.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:31.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:31.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.6474512680000002, 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:31.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.162 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1764944780000004, 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.163 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:31.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7569681780000002, 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:31.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.6821686069999999, 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.175 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:31.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:31.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.648103109, 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:31.181 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:31.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:31.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:31.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.495026008, 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:31.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:31.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.4163248159999999, 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.194 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:31.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14224 4.b 4:d18ebcc4:::100000033ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.356883346, 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028328506, 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14224 2024-09-12T22:11:31.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745412+0000", 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067359029999999997 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745430+0000", 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745440+0000", 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745489+0000", 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8594999999999998e-05 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745551+0000", 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2578999999999998e-05 2024-09-12T22:11:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745645+0000", 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3461000000000005e-05 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755780+0000", 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010135633999999999 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766912+0000", 2024-09-12T22:11:31.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011132079 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766968+0000", 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5835999999999999e-05 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.767004+0000", 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6134999999999999e-05 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14227 4.b 4:d1ba6b2c:::1000000348d.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.350049396, 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027107289999999999, 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14227 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.206 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751396+0000", 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058854429999999998 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751419+0000", 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2847e-05 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751426+0000", 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751491+0000", 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4604999999999996e-05 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751686+0000", 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000195088 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751828+0000", 2024-09-12T22:11:31.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014222400000000001 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755837+0000", 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040090810000000003 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772520+0000", 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016682704999999999 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772573+0000", 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3235000000000001e-05 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772617+0000", 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4060999999999997e-05 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14704 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304 [2@1278380]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:31.212 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.87217374800000003, 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026165253999999999, 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14704 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:31.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223386+0000", 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.54e-07 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227867+0000", 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004480393 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227884+0000", 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227893+0000", 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8750000000000006e-06 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227975+0000", 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2102999999999996e-05 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228034+0000", 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9243000000000002e-05 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228138+0000", 2024-09-12T22:11:31.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103705 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.236978+0000", 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088398509999999993 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249495+0000", 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012517128000000001 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249527+0000", 2024-09-12T22:11:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1890999999999997e-05 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249551+0000", 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3785e-05 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:31.218 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:31.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:31.226 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:31.219+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:31.229 INFO:tasks.workunit.client.0.smithi019.stdout:7/974: dread da/d30/da5/fec [0,4194304] 0 2024-09-12T22:11:31.229 INFO:tasks.workunit.client.0.smithi019.stdout:7/975: mknod da/d19/c14b 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:2/866: sync 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/976: mkdir da/d24/dff/d116/d131/d14c 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:2/867: getdents d0/d3/df/d7b/d44/de9 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/977: chown da/d24/d28/d1c/d32/dc2/dca 589598 1 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:3/996: dread d18/d26/d30/d71/d86/f9e [0,4194304] 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/978: chown da/d30/da5 135135216 1 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:3/997: stat d18/d1d/d8b/lb1 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:2/868: mkdir d0/d3/d11/d2e/d11a 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/979: write da/d19/d25/f9e [1447147,118026] 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/980: readlink da/d19/l44 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:2/869: creat d0/d3/d11/d2e/d64/f11b x:0 0 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/981: mknod da/d24/c14d 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:3/998: link d18/d26/d30/l66 d18/d1d/d8b/dc5/dbb/df1/dfd/d11c/l130 0 2024-09-12T22:11:31.230 INFO:tasks.workunit.client.0.smithi019.stdout:3/999: creat d18/d26/da5/dbd/f131 x:0 0 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/982: fdatasync da/d19/d25/d39/d51/dd7/db1/db5/db6/df5/fcb 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/983: creat da/d19/d25/d39/d51/f14e x:0 0 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/984: creat da/d19/d25/deb/f14f x:0 0 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/985: fdatasync da/d24/d28/d1c/d32/dc2/d14a/fc1 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:0/995: dread d5/d7/d2c/d44/d6a/d46/f73 [0,4194304] 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/870: dwrite d0/d3/d11/d77/d78/d2c/fc6 [0,4194304] 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/986: write da/d24/fbb [1980844,122440] 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:8/964: dread d5/f42 [4194304,4194304] 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/871: rename d0/d3/d11/d77/d82/dc0/lca to d0/d31/d12/d92/l11c 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:8/965: mkdir d5/dc/d26/d4b/df5/d13d 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/987: getdents da/d24/d28/d1c 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/872: rename d0/d31/d4/fef to d0/d3/df/d7b/d80/d9a/daa/f11d 0 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/873: chown d0/d3/d21/c29 55558 1 2024-09-12T22:11:31.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/874: rmdir d0/d3/d11/d77/d82/df3 39 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:8/966: dwrite d5/d16/d19/f40 [0,4194304] 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/875: creat d0/d3/d11/d2e/d64/dce/d51/f11e x:0 0 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:7/988: dwrite da/d24/d28/d1c/d32/d94/f13f [0,4194304] 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/876: chown d0/d3/d11/d2e/d64/dce/d51/f11e 245553806 1 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:7/989: chown da/d19/f4a 99544 1 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/877: dread - d0/d3/de1/f111 zero size 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/878: mknod d0/d3/d11/d77/d78/d2c/d56/c11f 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:7/990: dwrite da/d24/d28/d1c/d32/f89 [0,4194304] 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:7/991: write da/d24/d28/d1c/d32/dc2/d14a/fb4 [578782,65876] 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/879: dwrite d0/d31/d12/d15/fa0 [0,4194304] 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/880: fdatasync d0/d3/df/f2a 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/881: unlink d0/d3/d11/d77/f118 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:7/992: rename da/d24/l8e to da/d19/d25/d39/d51/dd7/l150 0 2024-09-12T22:11:31.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/882: readlink d0/d3/d11/d77/d78/d2c/d56/d60/l69 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:7/993: symlink da/d19/d25/d39/d51/df8/l151 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/967: dread d5/dc/d26/f3a [0,4194304] 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/968: creat d5/d53/f13e x:0 0 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:0/996: dread d5/d7/d2c/d44/d6a/d46/f11d [0,4194304] 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/969: unlink d5/dc/d26/dc8/c109 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/883: dwrite d0/d31/fa3 [0,4194304] 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/884: dread - d0/f117 zero size 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/970: link d5/d16/d19/d29/l11a d5/dc/d26/d43/d49/d92/d10d/l13f 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/971: creat d5/dc/d26/dc8/f140 x:0 0 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/972: truncate d5/dc/d26/f73 736517 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/885: write d0/d3/d11/f8a [1790674,129143] 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/973: chown d5/dc/d8d/d96/da7/f12b 28533 1 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/886: creat d0/d3/df/d6b/f120 x:0 0 0 2024-09-12T22:11:31.233 INFO:tasks.workunit.client.0.smithi019.stdout:8/974: mkdir d5/d16/d19/d29/d141 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/975: fdatasync d5/dc/d8d/d96/da7/fec 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/976: getdents d5/dc/d26/d76/d10e/d11b 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/887: truncate d0/d3/d11/f8a 1413367 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/888: read d0/d31/d12/d15/fa0 [1097858,113096] 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/977: truncate d5/d16/d19/d29/fc4 3050705 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/978: mknod d5/dc/d8d/c142 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/979: write d5/dc/d8d/d96/fed [1906288,51240] 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/889: dwrite d0/d3/d11/d2e/d70/d10a/fd4 [0,4194304] 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:7/994: dread da/d19/f4a [0,4194304] 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/890: read d0/d3/df/f37 [3138853,40323] 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/980: link d5/dc/d8d/d96/da7/ff0 d5/dc/d26/d4b/f143 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/891: symlink d0/d3/d11/d77/d82/df3/l121 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/981: link l3 d5/d53/d66/l144 0 2024-09-12T22:11:31.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/892: write d0/d3/d11/d77/fa2 [1624419,44640] 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/982: chown d5/dc/d26/d76/d10e/d11b/f123 492 1 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/995: dwrite da/d24/d101/f144 [0,4194304] 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/983: fdatasync d5/dc/d26/d43/f57 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/996: fdatasync da/d24/d28/d1c/d32/d94/f9b 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/984: rename d5/d16/d19/f3c to d5/f145 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:0/997: dread d5/d7/d2c/d44/d6a/f12e [4194304,4194304] 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/985: mknod d5/dc/d26/d43/d49/d7a/df8/c146 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/997: creat da/d19/f152 x:0 0 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/986: write d5/dc/d26/f36 [264749,119400] 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/998: unlink da/d19/d25/d39/d51/dd7/c107 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/999: rename da/d19/d79/d12a/c143 to da/d24/d28/d1c/c153 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/987: dwrite d5/dc/d26/dc8/f140 [0,4194304] 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/988: stat d5/dc/d8a/cf2 0 2024-09-12T22:11:31.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/989: link d5/d53/ldb d5/dc/d26/d76/d10e/d11b/l147 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/990: creat d5/dc/d26/d4b/df5/f148 x:0 0 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/991: rename d5/dc/d8a/cf2 to d5/dc/c149 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/992: fdatasync d5/dc/d26/d4b/df5/f119 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/993: readlink d5/d16/d19/l3e 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/994: creat d5/dc/d26/d4b/df5/d13d/f14a x:0 0 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/995: mkdir d5/dc/d8d/d96/d14b 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/893: sync 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/894: fsync d0/d3/d11/d2e/d70/d10a/fd4 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/895: readlink d0/d3/df/l2f 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:0/998: sync 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/896: dread d0/d3/d11/d77/d78/d2c/d2d/fe6 [0,4194304] 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:0/999: chown d5/d7/d2c/d44/d6a/d76/f80 97 1 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/897: dread d0/d3/d11/da9/fad [0,4194304] 0 2024-09-12T22:11:31.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/898: write d0/d3/d11/d77/d82/f10c [142029,123754] 0 2024-09-12T22:11:31.237 INFO:tasks.workunit.client.0.smithi019.stdout:2/899: rename d0/d3/df/l2f to d0/d3/d11/d2e/l122 0 2024-09-12T22:11:31.237 INFO:tasks.workunit.client.0.smithi019.stdout:8/996: sync 2024-09-12T22:11:31.237 INFO:tasks.workunit.client.0.smithi019.stdout:8/997: chown d5/dc/d26/d76/d10e/d11b/f116 3890 1 2024-09-12T22:11:31.237 INFO:tasks.workunit.client.0.smithi019.stdout:2/900: dwrite d0/d3/df/d7b/d44/de9/f104 [4194304,4194304] 0 2024-09-12T22:11:31.237 INFO:tasks.workunit.client.0.smithi019.stdout:8/998: chown d5/d16/d19/l6c 34519820 1 2024-09-12T22:11:31.238 INFO:tasks.workunit.client.0.smithi019.stdout:2/901: write d0/d3/d11/d77/d78/d2c/d30/d32/de5/f90 [5129128,119385] 0 2024-09-12T22:11:31.238 INFO:tasks.workunit.client.0.smithi019.stdout:8/999: mkdir d5/d16/d19/d29/d14c 0 2024-09-12T22:11:31.238 INFO:tasks.workunit.client.0.smithi019.stdout:2/902: rename d0/d3/d11/d77/d78/d2c/d2d/de4/cf7 to d0/d3/d11/d77/d78/d2c/d30/d32/de5/c123 0 2024-09-12T22:11:31.239 INFO:tasks.workunit.client.0.smithi019.stdout:2/903: write d0/d3/df/d7b/d80/d9a/daa/f11d [1473852,108658] 0 2024-09-12T22:11:31.239 INFO:tasks.workunit.client.0.smithi019.stdout:2/904: creat d0/d3/d11/d2e/d70/d10a/f124 x:0 0 0 2024-09-12T22:11:31.239 INFO:tasks.workunit.client.0.smithi019.stdout:2/905: rename d0/d31/d12/f83 to d0/d31/d12/d3b/f125 0 2024-09-12T22:11:31.239 INFO:tasks.workunit.client.0.smithi019.stdout:2/906: dwrite d0/d3/d11/d77/d78/d2c/d56/fe2 [0,4194304] 0 2024-09-12T22:11:31.241 INFO:tasks.workunit.client.0.smithi019.stdout:2/907: fdatasync d0/d3/df/d7b/dbe/fda 0 2024-09-12T22:11:31.241 INFO:tasks.workunit.client.0.smithi019.stdout:2/908: chown d0/d31/d12/d3b/ffa 10386 1 2024-09-12T22:11:31.242 INFO:tasks.workunit.client.0.smithi019.stdout:2/909: fdatasync d0/fd7 0 2024-09-12T22:11:31.243 INFO:tasks.workunit.client.0.smithi019.stdout:2/910: creat d0/d31/d12/d3b/f126 x:0 0 0 2024-09-12T22:11:31.244 INFO:tasks.workunit.client.0.smithi019.stdout:2/911: mknod d0/d3/df/d7b/d44/de9/c127 0 2024-09-12T22:11:31.245 INFO:tasks.workunit.client.0.smithi019.stdout:2/912: write d0/d3/f66 [2069683,84105] 0 2024-09-12T22:11:31.245 INFO:tasks.workunit.client.0.smithi019.stdout:2/913: mkdir d0/d3/df/d7b/d128 0 2024-09-12T22:11:31.249 INFO:tasks.workunit.client.0.smithi019.stdout:2/914: dwrite d0/d31/d12/d3b/ffa [0,4194304] 0 2024-09-12T22:11:31.250 INFO:tasks.workunit.client.0.smithi019.stdout:2/915: creat d0/f129 x:0 0 0 2024-09-12T22:11:31.266 INFO:tasks.workunit.client.0.smithi019.stdout:2/916: dread d0/d31/d4/f3f [0,4194304] 0 2024-09-12T22:11:31.266 INFO:tasks.workunit.client.0.smithi019.stdout:2/917: mknod d0/d3/df/d7b/d44/c12a 0 2024-09-12T22:11:31.269 INFO:tasks.workunit.client.0.smithi019.stdout:2/918: truncate d0/d3/df/d7b/d80/d9a/daa/f11d 515316 0 2024-09-12T22:11:31.270 INFO:tasks.workunit.client.0.smithi019.stdout:2/919: creat d0/d3/df/f12b x:0 0 0 2024-09-12T22:11:31.271 INFO:tasks.workunit.client.0.smithi019.stdout:2/920: fdatasync d0/d31/d12/d15/fa0 0 2024-09-12T22:11:31.272 INFO:tasks.workunit.client.0.smithi019.stdout:2/921: dread - d0/d3/d11/d77/d82/df3/dba/ff0 zero size 2024-09-12T22:11:31.273 INFO:tasks.workunit.client.0.smithi019.stdout:2/922: fsync d0/d3/df/d7b/d44/de9/f110 0 2024-09-12T22:11:31.274 INFO:tasks.workunit.client.0.smithi019.stdout:2/923: rename d0/d3/d11/d77/d82/dc0 to d0/d3/d11/d2e/d12c 0 2024-09-12T22:11:31.275 INFO:tasks.workunit.client.0.smithi019.stdout:2/924: unlink d0/d3/d11/d77/d78/d2c/d56/d60/fdc 0 2024-09-12T22:11:31.275 INFO:tasks.workunit.client.0.smithi019.stdout:2/925: chown d0/d3/d11/d77/d78/d2c/d56/d60/lcf 484759032 1 2024-09-12T22:11:31.276 INFO:tasks.workunit.client.0.smithi019.stdout:2/926: fsync d0/d31/d12/d15/f23 0 2024-09-12T22:11:31.276 INFO:tasks.workunit.client.0.smithi019.stdout:2/927: chown d0/d3/d11/d77/d82/fbb 9174246 1 2024-09-12T22:11:31.279 INFO:tasks.workunit.client.0.smithi019.stdout:2/928: dread d0/d3/d11/d2e/d64/dce/d51/f89 [0,4194304] 0 2024-09-12T22:11:31.280 INFO:tasks.workunit.client.0.smithi019.stdout:2/929: symlink d0/d3/df/d52/l12d 0 2024-09-12T22:11:31.280 INFO:tasks.workunit.client.0.smithi019.stdout:2/930: mknod d0/d3/d11/d2e/c12e 0 2024-09-12T22:11:31.281 INFO:tasks.workunit.client.0.smithi019.stdout:2/931: creat d0/d3/df/d7b/d44/ddd/f12f x:0 0 0 2024-09-12T22:11:31.283 INFO:tasks.workunit.client.0.smithi019.stdout:2/932: dread d0/d3/d11/d77/d78/f7c [0,4194304] 0 2024-09-12T22:11:31.284 INFO:tasks.workunit.client.0.smithi019.stdout:2/933: read d0/d31/d4/f3f [2289178,43394] 0 2024-09-12T22:11:31.285 INFO:tasks.workunit.client.0.smithi019.stdout:2/934: mkdir d0/d3/d11/d77/d78/d2c/d30/d32/de5/d130 0 2024-09-12T22:11:31.288 INFO:tasks.workunit.client.0.smithi019.stdout:2/935: dwrite d0/d31/d12/f1b [0,4194304] 0 2024-09-12T22:11:31.288 INFO:tasks.workunit.client.0.smithi019.stdout:2/936: stat d0/d31/d12/d15/f33 0 2024-09-12T22:11:31.289 INFO:tasks.workunit.client.0.smithi019.stdout:2/937: mkdir d0/d3/d21/d131 0 2024-09-12T22:11:31.298 INFO:tasks.workunit.client.0.smithi019.stdout:2/938: dread d0/d3/df/d7b/d44/f93 [0,4194304] 0 2024-09-12T22:11:31.302 INFO:tasks.workunit.client.0.smithi019.stdout:2/939: dwrite d0/d3/df/d52/fd2 [0,4194304] 0 2024-09-12T22:11:31.303 INFO:tasks.workunit.client.0.smithi019.stdout:2/940: link d0/d31/d12/d3b/f125 d0/d3/d11/d77/d78/d2c/d30/f132 0 2024-09-12T22:11:31.304 INFO:tasks.workunit.client.0.smithi019.stdout:2/941: symlink d0/d3/df/l133 0 2024-09-12T22:11:31.305 INFO:tasks.workunit.client.0.smithi019.stdout:2/942: symlink d0/d3/de1/l134 0 2024-09-12T22:11:31.306 INFO:tasks.workunit.client.0.smithi019.stdout:2/943: symlink d0/d31/d12/d15/dae/l135 0 2024-09-12T22:11:31.306 INFO:tasks.workunit.client.0.smithi019.stdout:2/944: creat d0/d3/dc5/f136 x:0 0 0 2024-09-12T22:11:31.307 INFO:tasks.workunit.client.0.smithi019.stdout:2/945: rename d0/d3/d11/d77/d78/d2c/d2d/fe6 to d0/d3/d11/d2e/df1/f137 0 2024-09-12T22:11:31.308 INFO:tasks.workunit.client.0.smithi019.stdout:2/946: creat d0/d3/d11/d77/d78/d2c/d56/dec/f138 x:0 0 0 2024-09-12T22:11:31.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:31.312 INFO:tasks.workunit.client.0.smithi019.stdout:2/947: dwrite d0/d3/d11/d2e/d64/dce/fa5 [0,4194304] 0 2024-09-12T22:11:31.317 INFO:tasks.workunit.client.0.smithi019.stdout:2/948: dwrite d0/d3/d11/d77/d78/d2c/d56/d60/feb [0,4194304] 0 2024-09-12T22:11:31.318 INFO:tasks.workunit.client.0.smithi019.stdout:2/949: mkdir d0/d31/d12/d15/d139 0 2024-09-12T22:11:31.318 INFO:tasks.workunit.client.0.smithi019.stdout:2/950: read - d0/d3/f10d zero size 2024-09-12T22:11:31.319 INFO:tasks.workunit.client.0.smithi019.stdout:2/951: symlink d0/d31/l13a 0 2024-09-12T22:11:31.320 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:31.318+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:31.335 INFO:tasks.workunit.client.0.smithi019.stdout:2/952: dread d0/d31/d4/f16 [0,4194304] 0 2024-09-12T22:11:31.338 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:31.339 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:31.339 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:31.339 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:31.339 INFO:tasks.workunit.client.0.smithi019.stdout:2/953: dwrite d0/d3/d11/d77/d78/d2c/d56/d60/feb [0,4194304] 0 2024-09-12T22:11:31.341 INFO:tasks.workunit.client.0.smithi019.stdout:2/954: mknod d0/d3/df/d7b/d80/c13b 0 2024-09-12T22:11:31.342 INFO:tasks.workunit.client.0.smithi019.stdout:2/955: creat d0/d3/d11/d77/d78/d2c/d56/dec/f13c x:0 0 0 2024-09-12T22:11:31.343 INFO:tasks.workunit.client.0.smithi019.stdout:2/956: readlink d0/d3/d11/d77/d82/df3/l121 0 2024-09-12T22:11:31.343 INFO:tasks.workunit.client.0.smithi019.stdout:2/957: symlink d0/d3/d11/d106/l13d 0 2024-09-12T22:11:31.344 INFO:tasks.workunit.client.0.smithi019.stdout:2/958: creat d0/d3/f13e x:0 0 0 2024-09-12T22:11:31.345 INFO:tasks.workunit.client.0.smithi019.stdout:2/959: rename d0/d3/d11/d77/d78/d2c/d30/d32/f81 to d0/d3/d11/d2e/d11a/f13f 0 2024-09-12T22:11:31.345 INFO:tasks.workunit.client.0.smithi019.stdout:2/960: creat d0/d3/df/d52/f140 x:0 0 0 2024-09-12T22:11:31.346 INFO:tasks.workunit.client.0.smithi019.stdout:2/961: mkdir d0/d3/d21/d141 0 2024-09-12T22:11:31.346 INFO:tasks.workunit.client.0.smithi019.stdout:2/962: chown d0/d31/d12/d3b/c59 327 1 2024-09-12T22:11:31.347 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:31.349 INFO:tasks.workunit.client.0.smithi019.stdout:2/963: dread d0/d3/df/d7b/d44/de9/f104 [4194304,4194304] 0 2024-09-12T22:11:31.350 INFO:tasks.workunit.client.0.smithi019.stdout:2/964: write d0/d3/d11/d77/d78/d2c/fc6 [5186781,40038] 0 2024-09-12T22:11:31.352 INFO:tasks.workunit.client.0.smithi019.stdout:2/965: truncate d0/d3/d11/d77/d78/d2c/d56/dec/f13c 246354 0 2024-09-12T22:11:31.353 INFO:tasks.workunit.client.0.smithi019.stdout:2/966: rename d0/d3/d11/cb0 to d0/d3/d11/d2e/d70/c142 0 2024-09-12T22:11:31.353 INFO:tasks.workunit.client.0.smithi019.stdout:2/967: dread - d0/d3/df/d6b/fb5 zero size 2024-09-12T22:11:31.354 INFO:tasks.workunit.client.0.smithi019.stdout:2/968: chown d0/fcd 1921297642 1 2024-09-12T22:11:31.355 INFO:tasks.workunit.client.0.smithi019.stdout:2/969: truncate d0/d31/d12/d15/f9f 2160879 0 2024-09-12T22:11:31.356 INFO:tasks.workunit.client.0.smithi019.stdout:2/970: fdatasync d0/d3/df/d52/f140 0 2024-09-12T22:11:31.356 INFO:tasks.workunit.client.0.smithi019.stdout:2/971: rmdir d0/d31/d12/d15 39 2024-09-12T22:11:31.357 INFO:tasks.workunit.client.0.smithi019.stdout:2/972: dread - d0/d31/d12/d3b/ff2 zero size 2024-09-12T22:11:31.361 INFO:tasks.workunit.client.0.smithi019.stdout:2/973: dwrite d0/d3/d11/d77/d78/d2c/d30/f132 [0,4194304] 0 2024-09-12T22:11:31.363 INFO:tasks.workunit.client.0.smithi019.stdout:2/974: creat d0/d31/d12/d15/d139/f143 x:0 0 0 2024-09-12T22:11:31.364 INFO:tasks.workunit.client.0.smithi019.stdout:2/975: getdents d0/d3/d11/d77/d78/d2c/d2d/de4 0 2024-09-12T22:11:31.365 INFO:tasks.workunit.client.0.smithi019.stdout:2/976: write d0/d31/d12/d3b/f126 [58743,10861] 0 2024-09-12T22:11:31.366 INFO:tasks.workunit.client.0.smithi019.stdout:2/977: truncate d0/d3/d11/d2e/d64/f11b 1005972 0 2024-09-12T22:11:31.371 INFO:tasks.workunit.client.0.smithi019.stdout:2/978: dwrite d0/d31/d12/d15/fb2 [0,4194304] 0 2024-09-12T22:11:31.372 INFO:tasks.workunit.client.0.smithi019.stdout:2/979: mkdir d0/d3/d21/d141/d144 0 2024-09-12T22:11:31.372 INFO:tasks.workunit.client.0.smithi019.stdout:2/980: stat d0/d31/d12/f1b 0 2024-09-12T22:11:31.374 INFO:tasks.workunit.client.0.smithi019.stdout:2/981: write d0/d3/df/d7b/d44/f93 [2543608,22266] 0 2024-09-12T22:11:31.375 INFO:tasks.workunit.client.0.smithi019.stdout:2/982: read - d0/d3/df/f114 zero size 2024-09-12T22:11:31.378 INFO:tasks.workunit.client.0.smithi019.stdout:2/983: dwrite d0/d3/df/f12b [0,4194304] 0 2024-09-12T22:11:31.380 INFO:tasks.workunit.client.0.smithi019.stdout:2/984: creat d0/d3/f145 x:0 0 0 2024-09-12T22:11:31.383 INFO:tasks.workunit.client.0.smithi019.stdout:2/985: mknod d0/d3/d11/d77/d78/d2c/d30/d32/de5/c146 0 2024-09-12T22:11:31.385 INFO:tasks.workunit.client.0.smithi019.stdout:2/986: dread d0/d3/d11/d77/d78/f7c [0,4194304] 0 2024-09-12T22:11:31.385 INFO:tasks.workunit.client.0.smithi019.stdout:2/987: stat d0/d31/d12/c7f 0 2024-09-12T22:11:31.386 INFO:tasks.workunit.client.0.smithi019.stdout:2/988: creat d0/d3/d11/d77/d78/d2c/f147 x:0 0 0 2024-09-12T22:11:31.419 INFO:tasks.workunit.client.0.smithi019.stdout:2/989: sync 2024-09-12T22:11:31.420 INFO:tasks.workunit.client.0.smithi019.stdout:2/990: symlink d0/d3/d11/d77/d78/d2c/d56/l148 0 2024-09-12T22:11:31.420 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:31.419+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:31.420 INFO:tasks.workunit.client.0.smithi019.stdout:2/991: write d0/d3/d11/d106/f107 [478018,18214] 0 2024-09-12T22:11:31.424 INFO:tasks.workunit.client.0.smithi019.stdout:2/992: rmdir d0/d3/d11/d2e 39 2024-09-12T22:11:31.424 INFO:tasks.workunit.client.0.smithi019.stdout:2/993: creat d0/d3/d11/d77/d82/df3/f149 x:0 0 0 2024-09-12T22:11:31.434 INFO:tasks.workunit.client.0.smithi019.stdout:2/994: dread d0/d3/df/d7b/fa1 [0,4194304] 0 2024-09-12T22:11:31.438 INFO:tasks.workunit.client.0.smithi019.stdout:2/995: truncate d0/d3/d11/d77/d78/d2c/f5a 4764363 0 2024-09-12T22:11:31.439 INFO:tasks.workunit.client.0.smithi019.stdout:2/996: creat d0/d3/d11/d77/d78/d2c/d2d/de4/f14a x:0 0 0 2024-09-12T22:11:31.439 INFO:tasks.workunit.client.0.smithi019.stdout:2/997: stat d0/d3/d11/d77/d78/d2c/d30/d32/de5 0 2024-09-12T22:11:31.443 INFO:tasks.workunit.client.0.smithi019.stdout:2/998: dwrite d0/d31/d12/d15/f33 [0,4194304] 0 2024-09-12T22:11:31.444 INFO:tasks.workunit.client.0.smithi019.stdout:2/999: write d0/fd7 [1343908,96559] 0 2024-09-12T22:11:31.447 INFO:tasks.workunit.client.0.smithi019.stderr:+ rm -rf -- ./tmp.9UfnLYadXw 2024-09-12T22:11:31.455 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:31.455 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:31.455 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:31.455 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:31.456 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:31.459 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:31.465 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:31.479 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:31.479 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:31.479 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:31.482 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:31.482 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:31.521 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:31.519+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:31.550 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:11:31.609 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:31.609 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:31.618 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:31.622 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:31.621+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:31.723 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:31.722+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:31.727 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:31.727 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:31.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:31.823 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:31.821+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:31.841 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:31.841 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:31.850 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:31.935 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:31.933+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:31.997 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:31.997 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.008 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:32.052 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:32.051+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:32.113 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:32.113 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.122 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:32.163 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:32.162+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:32.226 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:32.225+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:32.264 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:32.265 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:32.327 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:32.326+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:32.376 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:32.377 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.386 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:32.429 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:32.427+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:32.496 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:32.496 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.505 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:32.546 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:32.544+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:32.630 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:32.629+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:32.651 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:32.651 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:32.731 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:32.730+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:32.773 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:32.773 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.778 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:32.831 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:32.830+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:32.894 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:32.894 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:32.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:32.947 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:32.946+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:33.011 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:33.011 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:33.022 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:33.063 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:33.062+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:33.135 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:33.133+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:33.166 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:33.166 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:33.175 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:33.236 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:33.235+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:33.281 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:33.281 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:33.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:33.337 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:33.335+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:33.392 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:33.392 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:33.401 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:33.442 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:33.440+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:33.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:33.539 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:33.537+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:33.543 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:33.543 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:33.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:33.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:11:33.625 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:33.625 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:33.640 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:33.639+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:33.648 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:33.652 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:33.653 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:33.660 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:33.660 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:33.660 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:33.660 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:33.669 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:33.741 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:33.739+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:33.775 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:33.776 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:33.776 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:33.776 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:33.776 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:33.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-09-12T22:11:33.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:33.810 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T22:11:33.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T22:11:33.842 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:33.841+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:33.892 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.170814671999999, 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:33.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.158752073999999, 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:33.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.905 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11071 4.c 4:3257e780:::1000000321f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6842824890000001, 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024562179, 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11071 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205482+0000", 2024-09-12T22:11:33.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211316+0000", 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058333539999999998 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211327+0000", 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1756000000000001e-05 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211335+0000", 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211385+0000", 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0507999999999998e-05 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211500+0000", 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114472 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211586+0000", 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5820000000000002e-05 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.215264+0000", 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036782809999999998 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.229982+0000", 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014718498 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230017+0000", 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4430000000000001e-05 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230044+0000", 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6653999999999999e-05 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11111 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304 [3@848846]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.617695468, 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034033252999999999, 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.912 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11111 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272069+0000", 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278159+0000", 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060894690000000001 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278172+0000", 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3237999999999999e-05 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278179+0000", 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0450000000000003e-06 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278240+0000", 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1273999999999996e-05 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278306+0000", 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6315000000000005e-05 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278428+0000", 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000121364 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.282607+0000", 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041791090000000003 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.305959+0000", 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023352435000000001 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306015+0000", 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5794000000000001e-05 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306102+0000", 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6508999999999995e-05 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.918 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11122 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304 [2@1285126]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6004291879999997, 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026237979000000002, 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11122 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.919 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289336+0000", 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296646+0000", 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073105109999999996 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296658+0000", 2024-09-12T22:11:33.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1525000000000001e-05 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296663+0000", 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4210000000000003e-06 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296738+0000", 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4574999999999997e-05 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296806+0000", 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8424999999999996e-05 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296901+0000", 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4530999999999993e-05 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.300955+0000", 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040546649999999998 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315478+0000", 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014523213 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315532+0000", 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3928000000000003e-05 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315573+0000", 2024-09-12T22:11:33.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0250000000000003e-05 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11421 4.1b 4:db3ef485:::100000031c2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.2073206750000001, 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024994136, 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.925 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11421 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:33.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682444+0000", 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690408+0000", 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079646000000000005 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690418+0000", 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3889999999999994e-06 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690423+0000", 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5430000000000001e-06 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690480+0000", 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6477999999999997e-05 2024-09-12T22:11:33.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690565+0000", 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690686+0000", 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012097899999999999 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.698289+0000", 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076032239999999996 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707338+0000", 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090485210000000003 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707398+0000", 2024-09-12T22:11:33.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9670000000000003e-05 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707437+0000", 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9780000000000002e-05 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11476 4.20 4:073157f6:::10000003181.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.1329263019999996, 2024-09-12T22:11:33.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024885865, 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11476 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756839+0000", 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.147e-06 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762627+0000", 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057881499999999997 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762655+0000", 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8581999999999998e-05 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762668+0000", 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2829e-05 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762764+0000", 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5867999999999998e-05 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762841+0000", 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7348999999999994e-05 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762936+0000", 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4968000000000003e-05 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.771619+0000", 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0086823079999999997 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781553+0000", 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099340929999999997 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781615+0000", 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1680999999999994e-05 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781723+0000", 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010889 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.937 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.9291600869999996, 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:33.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:33.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:33.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:33.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:33.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:33.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:33.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:33.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:33.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:33.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:33.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:33.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:33.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:33.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:33.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:33.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:33.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:33.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:33.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:33.949 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.949 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.949 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.950 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11632 4.18 4:1bddbeb1:::1000000315c.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.950 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:33.950 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.9175725479999999, 2024-09-12T22:11:33.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035921586999999998, 2024-09-12T22:11:33.950 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.951 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.951 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:33.951 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.951 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.952 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.952 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11632 2024-09-12T22:11:33.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.952 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972192+0000", 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.012e-06 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972197+0000", 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972209+0000", 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1968e-05 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972217+0000", 2024-09-12T22:11:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972263+0000", 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6477000000000002e-05 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972320+0000", 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7003999999999998e-05 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008113+0000", 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035792455000000001 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11633 4.1b 4:db3ef485:::100000031c2.00000000:head [read 131072~131072 [2@2632009]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.9160672510000003, 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034773432, 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:33.956 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11633 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:33.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7400000000000002e-07 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973701+0000", 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007401+0000", 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033700059999999997 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5108000000000001e-05 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007507+0000", 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0133e-05 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000102818 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008470+0000", 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086063800000000005 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.960 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.9126363230000001, 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:33.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11636 4.38 4:1f03a657:::10000003181.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.8821472999999997, 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026771987000000001, 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11636 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.966 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:33.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017190+0000", 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095727360000000001 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017205+0000", 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4758e-05 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017213+0000", 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6549999999999993e-06 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022810+0000", 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055969770000000004 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022856+0000", 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5136999999999998e-05 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022927+0000", 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1118999999999995e-05 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034260+0000", 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011333009999999999 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034309+0000", 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9605999999999999e-05 2024-09-12T22:11:33.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034349+0000", 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9742e-05 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034389+0000", 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9505000000000002e-05 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13875 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.5566767280000002, 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027048843999999999, 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13875 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333088+0000", 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.16e-07 2024-09-12T22:11:33.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338344+0000", 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052561609999999996 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338362+0000", 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8306000000000001e-05 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338377+0000", 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4154e-05 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338464+0000", 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7410000000000005e-05 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338582+0000", 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000117928 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338690+0000", 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010781 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.342821+0000", 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041308919999999997 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360022+0000", 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017201675999999999 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360059+0000", 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6777999999999999e-05 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360136+0000", 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6812999999999998e-05 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.977 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13961 4.30 4:0c2552b5:::10000003501.00000000:head [write 0~4194304 [2@434191]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.4524355880000002, 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030398076999999999, 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13961 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437329+0000", 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:11:33.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443713+0000", 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063844100000000001 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443726+0000", 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2371000000000001e-05 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443731+0000", 2024-09-12T22:11:33.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.271e-06 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443812+0000", 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1036000000000001e-05 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443881+0000", 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8749000000000002e-05 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.444133+0000", 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00025271700000000001 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.450353+0000", 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062195430000000001 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467617+0000", 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017263849000000001 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467678+0000", 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0714999999999997e-05 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467726+0000", 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8749999999999999e-05 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13999 4.18 4:18e6495a:::1000000353a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:33.983 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.4124488160000004, 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027586513999999999, 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13999 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477316+0000", 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.33e-06 2024-09-12T22:11:33.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482742+0000", 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054256349999999998 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482752+0000", 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0071999999999999e-05 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482758+0000", 2024-09-12T22:11:33.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482803+0000", 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5229999999999999e-05 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482932+0000", 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012920799999999999 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.483074+0000", 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014124100000000001 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.487006+0000", 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039324210000000002 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504821+0000", 2024-09-12T22:11:33.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017814673999999999 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504861+0000", 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0822000000000003e-05 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504902+0000", 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0113e-05 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14158 4.3c 4:3f94d4c3:::100000034d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.2196428719999997, 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030683077, 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14158 2024-09-12T22:11:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670122+0000", 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.677995+0000", 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078731040000000006 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678008+0000", 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3736e-05 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678018+0000", 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1749999999999994e-06 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678127+0000", 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010953100000000001 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678196+0000", 2024-09-12T22:11:33.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8594000000000001e-05 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678331+0000", 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013488700000000001 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.682561+0000", 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042304839999999996 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:33.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700726+0000", 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018165369000000001 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700770+0000", 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3373e-05 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700804+0000", 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4199999999999998e-05 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:33.995 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14223 4.2b 4:d78f40a6:::100000033bb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1544072249999999, 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030308063999999999, 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14223 2024-09-12T22:11:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741431+0000", 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060735420000000004 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741440+0000", 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2050000000000008e-06 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741445+0000", 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.476e-06 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741529+0000", 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4608e-05 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741582+0000", 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3211999999999998e-05 2024-09-12T22:11:33.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741662+0000", 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9062999999999998e-05 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.745183+0000", 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035216850000000001 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765556+0000", 2024-09-12T22:11:34.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020372946999999999 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765622+0000", 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5905e-05 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765665+0000", 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2583999999999998e-05 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15096 4.18 4:1834b564:::100000035f3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.2673106619999999, 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024804242000000001, 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15096 2024-09-12T22:11:34.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622454+0000", 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630159+0000", 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077051680000000001 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630170+0000", 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0866999999999999e-05 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630177+0000", 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630235+0000", 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8230000000000003e-05 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630290+0000", 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5578999999999998e-05 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630379+0000", 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8073999999999997e-05 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.634844+0000", 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044656640000000003 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647082+0000", 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012237804999999999 2024-09-12T22:11:34.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647177+0000", 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4728999999999994e-05 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647257+0000", 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0694999999999999e-05 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15394 4.c 4:334f772a:::10000003816.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.933127593, 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025644575999999999, 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:34.008 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.009 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15394 2024-09-12T22:11:34.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.009 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:34.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:34.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956637+0000", 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964008+0000", 2024-09-12T22:11:34.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073704119999999998 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964025+0000", 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7229999999999999e-05 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964033+0000", 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3920000000000003e-06 2024-09-12T22:11:34.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964109+0000", 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6110000000000001e-05 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964232+0000", 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012249799999999999 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:34.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964313+0000", 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1425000000000001e-05 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.969366+0000", 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050526989999999999 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982186+0000", 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012819818 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982244+0000", 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8532000000000001e-05 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982281+0000", 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6529999999999998e-05 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.015 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3747 3.e 3:715f5c78:::200.00000013:head [write 1826208~23101 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.228176869, 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028762724999999999, 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661588+0000", 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:34.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661606+0000", 2024-09-12T22:11:34.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:34.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:34.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661618+0000", 2024-09-12T22:11:34.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2283000000000001e-05 2024-09-12T22:11:34.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661623+0000", 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3970000000000002e-06 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661677+0000", 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3909000000000002e-05 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661722+0000", 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4464e-05 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.662559+0000", 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083668200000000005 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690278+0000", 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027719338 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:34.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690350+0000", 2024-09-12T22:11:34.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1806999999999999e-05 2024-09-12T22:11:34.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.022 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:34.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:34.022 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:34.022 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:34.024 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:34.023+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:34.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:34.125 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:34.123+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5008 3.17 3:e8010137:::100000030b0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.172632+0000", 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0040237019999999997, 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040394710000000002, 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172632+0000", 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172632+0000", 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172632+0000", 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4199999999999996e-07 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172634+0000", 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0940000000000002e-06 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172642+0000", 2024-09-12T22:11:34.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3710000000000002e-06 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172647+0000", 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172680+0000", 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2904000000000002e-05 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172774+0000", 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4204999999999997e-05 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:5003 4.39 e54/17 4:9d97a463:::100000030ab.00000000:head v 54'260, mlcod=54'257)", 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.172945+0000", 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0037100409999999999, 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003785854, 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172945+0000", 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172945+0000", 2024-09-12T22:11:34.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172946+0000", 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2e-07 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172950+0000", 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0609999999999997e-06 2024-09-12T22:11:34.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172957+0000", 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8210000000000004e-06 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172962+0000", 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9239999999999998e-06 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.172998+0000", 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6498000000000002e-05 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173016+0000", 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7558999999999999e-05 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.186 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5010 4.b 4:d02dcb9c:::100000030b6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.173345+0000", 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0033108299999999998, 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003422418, 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.188 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173345+0000", 2024-09-12T22:11:34.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173345+0000", 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173345+0000", 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3399999999999998e-07 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173349+0000", 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.349e-06 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173359+0000", 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0521e-05 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173364+0000", 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4120000000000003e-06 2024-09-12T22:11:34.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173396+0000", 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2110000000000003e-05 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173491+0000", 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4885999999999999e-05 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5012 4.1c 4:38c4c24e:::100000030bb.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.173380+0000", 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0032754529999999998, 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034176499999999999, 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173380+0000", 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173380+0000", 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173381+0000", 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8100000000000003e-07 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173382+0000", 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.886e-06 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173389+0000", 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2829999999999998e-06 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173395+0000", 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0959999999999997e-06 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173439+0000", 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3968999999999999e-05 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173513+0000", 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4028000000000003e-05 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5013 4.4 4:2360c7e4:::100000030bb.00000001:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.173403+0000", 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0032525470000000002, 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034320900000000001, 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173403+0000", 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173403+0000", 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173403+0000", 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6199999999999999e-07 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173405+0000", 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3200000000000001e-06 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173409+0000", 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4329999999999997e-06 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173412+0000", 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.937e-06 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173455+0000", 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3260000000000003e-05 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.173524+0000", 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8535999999999996e-05 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5014 3.12 3:4e8d747e:::100000030bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.174798+0000", 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.001857467, 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020734159999999998, 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174798+0000", 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174798+0000", 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174799+0000", 2024-09-12T22:11:34.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174802+0000", 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7409999999999998e-06 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174809+0000", 2024-09-12T22:11:34.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1480000000000003e-06 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174813+0000", 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1829999999999996e-06 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174850+0000", 2024-09-12T22:11:34.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7047e-05 2024-09-12T22:11:34.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174924+0000", 2024-09-12T22:11:34.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3943000000000007e-05 2024-09-12T22:11:34.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:5015 3.1 3:84251430:::100000030be.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.174896+0000", 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0017593610000000001, 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002018475, 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174896+0000", 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174896+0000", 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174897+0000", 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7700000000000004e-07 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174900+0000", 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.819e-06 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174906+0000", 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7109999999999998e-06 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174910+0000", 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4750000000000002e-06 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174938+0000", 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7759999999999998e-05 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.174997+0000", 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9380999999999999e-05 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.213 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(4.3c epoch 54/17 rep_tid 9132 entries 54'234 (0'0) error 4:3c2be35d:::100000030f7.00000000:head by mds.0.3:5016 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 54'231)", 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.175204+0000", 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0014511540000000001, 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017579850000000001, 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175204+0000", 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175204+0000", 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175205+0000", 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3500000000000002e-07 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175209+0000", 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3039999999999998e-06 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175221+0000", 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1813e-05 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175228+0000", 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0230000000000004e-06 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175273+0000", 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5519999999999998e-05 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.217 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:5017 3.1c e54/16 3:3939b497:::200.00000014:head v 54'25, mlcod=54'23)", 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:34.175625+0000", 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.001030347, 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013913389999999999, 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175625+0000", 2024-09-12T22:11:34.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175625+0000", 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175625+0000", 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8799999999999998e-07 2024-09-12T22:11:34.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175665+0000", 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9273999999999997e-05 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175671+0000", 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2349999999999996e-06 2024-09-12T22:11:34.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175674+0000", 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2739999999999999e-06 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175701+0000", 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6950000000000001e-05 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:34.175713+0000", 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.136e-05 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 9 2024-09-12T22:11:34.222 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:34.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:34.226 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:34.225+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:34.327 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:34.325+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:34.385 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:34.385 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:34.385 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:34.385 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:34.385 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:34.394 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:34.435 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:34.433+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:34.529 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:34.528+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:34.541 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:34.541 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:34.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.820026821999999, 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:34.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:34.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.819425888000001, 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.547 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:34.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:34.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:34.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.807864763000001, 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:34.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:34.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:34.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.608021273999999, 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:34.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:34.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.563 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.607999424999999, 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:34.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:34.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:34.569 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.607984635000001, 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:34.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:34.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:34.575 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.607974766000002, 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:34.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:34.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.581 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.607960680000001, 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:34.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7213847100000006, 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:34.587 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:34.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:34.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.4207132589999993, 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.594 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:34.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:34.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0911856550000003, 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:34.600 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:34.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:34.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6202288649999996, 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:34.606 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:34.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:34.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.2007025650000003, 2024-09-12T22:11:34.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:34.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.1259029939999996, 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:34.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:34.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.627 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0918374960000001, 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:34.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.9387603950000001, 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.8600592030000005, 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14224 4.b 4:d18ebcc4:::100000033ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.8006177330000002, 2024-09-12T22:11:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028328506, 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14224 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745412+0000", 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067359029999999997 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745430+0000", 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745440+0000", 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745489+0000", 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8594999999999998e-05 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745551+0000", 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2578999999999998e-05 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745645+0000", 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3461000000000005e-05 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755780+0000", 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010135633999999999 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766912+0000", 2024-09-12T22:11:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011132079 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766968+0000", 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5835999999999999e-05 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.767004+0000", 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6134999999999999e-05 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14227 4.b 4:d1ba6b2c:::1000000348d.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7937837830000003, 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027107289999999999, 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14227 2024-09-12T22:11:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751396+0000", 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058854429999999998 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751419+0000", 2024-09-12T22:11:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2847e-05 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751426+0000", 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751491+0000", 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4604999999999996e-05 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751686+0000", 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000195088 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751828+0000", 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014222400000000001 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755837+0000", 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040090810000000003 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772520+0000", 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016682704999999999 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772573+0000", 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3235000000000001e-05 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772617+0000", 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4060999999999997e-05 2024-09-12T22:11:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14704 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304 [2@1278380]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.3159081349999999, 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026165253999999999, 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14704 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223386+0000", 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.54e-07 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227867+0000", 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004480393 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227884+0000", 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227893+0000", 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8750000000000006e-06 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227975+0000", 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2102999999999996e-05 2024-09-12T22:11:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228034+0000", 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9243000000000002e-05 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228138+0000", 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103705 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.236978+0000", 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088398509999999993 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249495+0000", 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012517128000000001 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249527+0000", 2024-09-12T22:11:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1890999999999997e-05 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249551+0000", 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3785e-05 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:34.667 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:11:34.668 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:34.668 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:34.666+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:34.767 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:34.766+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:34.775 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:34.775 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:34.775 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:34.775 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:34.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:34.869 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:34.868+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:34.930 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:34.931 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:34.940 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:34.970 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:34.968+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:35.071 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:35.070+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:35.116 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:35.116 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:35.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:35.116 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:35.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.116 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.394230584999999, 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:35.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:35.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:35.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.382167986999999, 2024-09-12T22:11:35.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:35.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:35.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:35.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11071 4.c 4:3257e780:::1000000321f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:35.128 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.9076984019999994, 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024562179, 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11071 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205482+0000", 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211316+0000", 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058333539999999998 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211327+0000", 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1756000000000001e-05 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211335+0000", 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:11:35.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211385+0000", 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0507999999999998e-05 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211500+0000", 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114472 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211586+0000", 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5820000000000002e-05 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.215264+0000", 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036782809999999998 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.229982+0000", 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014718498 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230017+0000", 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4430000000000001e-05 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230044+0000", 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6653999999999999e-05 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.134 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11111 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304 [3@848846]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.8411113809999993, 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034033252999999999, 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11111 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272069+0000", 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:11:35.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278159+0000", 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060894690000000001 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278172+0000", 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3237999999999999e-05 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278179+0000", 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0450000000000003e-06 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278240+0000", 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1273999999999996e-05 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278306+0000", 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6315000000000005e-05 2024-09-12T22:11:35.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278428+0000", 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000121364 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.282607+0000", 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041791090000000003 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.305959+0000", 2024-09-12T22:11:35.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023352435000000001 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306015+0000", 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5794000000000001e-05 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306102+0000", 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6508999999999995e-05 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.140 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11122 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304 [2@1285126]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.8238451009999999, 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026237979000000002, 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.141 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11122 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289336+0000", 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296646+0000", 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073105109999999996 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296658+0000", 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1525000000000001e-05 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296663+0000", 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4210000000000003e-06 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296738+0000", 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4574999999999997e-05 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296806+0000", 2024-09-12T22:11:35.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8424999999999996e-05 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296901+0000", 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4530999999999993e-05 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.300955+0000", 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040546649999999998 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315478+0000", 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014523213 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315532+0000", 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3928000000000003e-05 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315573+0000", 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0250000000000003e-05 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.146 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11421 4.1b 4:db3ef485:::100000031c2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.4307365880000003, 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024994136, 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.147 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11421 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682444+0000", 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690408+0000", 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079646000000000005 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690418+0000", 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3889999999999994e-06 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690423+0000", 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5430000000000001e-06 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690480+0000", 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6477999999999997e-05 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690565+0000", 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690686+0000", 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012097899999999999 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.698289+0000", 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076032239999999996 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707338+0000", 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090485210000000003 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707398+0000", 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9670000000000003e-05 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707437+0000", 2024-09-12T22:11:35.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9780000000000002e-05 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11476 4.20 4:073157f6:::10000003181.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.3563422149999997, 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024885865, 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.153 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11476 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756839+0000", 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.147e-06 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762627+0000", 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057881499999999997 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762655+0000", 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8581999999999998e-05 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762668+0000", 2024-09-12T22:11:35.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2829e-05 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762764+0000", 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5867999999999998e-05 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762841+0000", 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7348999999999994e-05 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762936+0000", 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4968000000000003e-05 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.771619+0000", 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0086823079999999997 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781553+0000", 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099340929999999997 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781615+0000", 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1680999999999994e-05 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781723+0000", 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010889 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.159 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1525759999999998, 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:35.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.165 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11632 4.18 4:1bddbeb1:::1000000315c.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1409884609999992, 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035921586999999998, 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.166 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11632 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972192+0000", 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.012e-06 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972197+0000", 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972209+0000", 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1968e-05 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972217+0000", 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972263+0000", 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6477000000000002e-05 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972320+0000", 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7003999999999998e-05 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008113+0000", 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035792455000000001 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.170 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11633 4.1b 4:db3ef485:::100000031c2.00000000:head [read 131072~131072 [2@2632009]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1394831639999996, 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034773432, 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11633 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7400000000000002e-07 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973701+0000", 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007401+0000", 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033700059999999997 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:35.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5108000000000001e-05 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007507+0000", 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0133e-05 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000102818 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008470+0000", 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086063800000000005 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1360522359999994, 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.175 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:35.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:35.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11636 4.38 4:1f03a657:::10000003181.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.1055632129999999, 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026771987000000001, 2024-09-12T22:11:35.180 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11636 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017190+0000", 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095727360000000001 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017205+0000", 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4758e-05 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017213+0000", 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6549999999999993e-06 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022810+0000", 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055969770000000004 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022856+0000", 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5136999999999998e-05 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022927+0000", 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1118999999999995e-05 2024-09-12T22:11:35.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034260+0000", 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011333009999999999 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034309+0000", 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9605999999999999e-05 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034349+0000", 2024-09-12T22:11:35.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9742e-05 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034389+0000", 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9505000000000002e-05 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13875 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.7800926409999995, 2024-09-12T22:11:35.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027048843999999999, 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13875 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333088+0000", 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.16e-07 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338344+0000", 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052561609999999996 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338362+0000", 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8306000000000001e-05 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338377+0000", 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4154e-05 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338464+0000", 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7410000000000005e-05 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338582+0000", 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000117928 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338690+0000", 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010781 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.342821+0000", 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041308919999999997 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360022+0000", 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017201675999999999 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360059+0000", 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6777999999999999e-05 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360136+0000", 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6812999999999998e-05 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13961 4.30 4:0c2552b5:::10000003501.00000000:head [write 0~4194304 [2@434191]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.6758515010000004, 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030398076999999999, 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.192 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13961 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437329+0000", 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443713+0000", 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063844100000000001 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443726+0000", 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2371000000000001e-05 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443731+0000", 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.271e-06 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443812+0000", 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1036000000000001e-05 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443881+0000", 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8749000000000002e-05 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.444133+0000", 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00025271700000000001 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.450353+0000", 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062195430000000001 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467617+0000", 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017263849000000001 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467678+0000", 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0714999999999997e-05 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467726+0000", 2024-09-12T22:11:35.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8749999999999999e-05 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13999 4.18 4:18e6495a:::1000000353a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.6358647289999997, 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027586513999999999, 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.198 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13999 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477316+0000", 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.33e-06 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482742+0000", 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054256349999999998 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482752+0000", 2024-09-12T22:11:35.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0071999999999999e-05 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482758+0000", 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482803+0000", 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5229999999999999e-05 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482932+0000", 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012920799999999999 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.483074+0000", 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014124100000000001 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.487006+0000", 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039324210000000002 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504821+0000", 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017814673999999999 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504861+0000", 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0822000000000003e-05 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504902+0000", 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0113e-05 2024-09-12T22:11:35.203 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14158 4.3c 4:3f94d4c3:::100000034d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.4430587849999998, 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030683077, 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.204 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14158 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670122+0000", 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.677995+0000", 2024-09-12T22:11:35.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078731040000000006 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678008+0000", 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3736e-05 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678018+0000", 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1749999999999994e-06 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678127+0000", 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010953100000000001 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678196+0000", 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8594000000000001e-05 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678331+0000", 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013488700000000001 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.682561+0000", 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042304839999999996 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700726+0000", 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018165369000000001 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700770+0000", 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3373e-05 2024-09-12T22:11:35.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700804+0000", 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4199999999999998e-05 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14223 4.2b 4:d78f40a6:::100000033bb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.3778231380000001, 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030308063999999999, 2024-09-12T22:11:35.210 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14223 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741431+0000", 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060735420000000004 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741440+0000", 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2050000000000008e-06 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741445+0000", 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.476e-06 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741529+0000", 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4608e-05 2024-09-12T22:11:35.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741582+0000", 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3211999999999998e-05 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741662+0000", 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9062999999999998e-05 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.745183+0000", 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035216850000000001 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765556+0000", 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020372946999999999 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765622+0000", 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5905e-05 2024-09-12T22:11:35.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765665+0000", 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2583999999999998e-05 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15096 4.18 4:1834b564:::100000035f3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.4907265750000001, 2024-09-12T22:11:35.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024804242000000001, 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15096 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622454+0000", 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630159+0000", 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077051680000000001 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630170+0000", 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0866999999999999e-05 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630177+0000", 2024-09-12T22:11:35.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630235+0000", 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8230000000000003e-05 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630290+0000", 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5578999999999998e-05 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630379+0000", 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8073999999999997e-05 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.634844+0000", 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044656640000000003 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647082+0000", 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012237804999999999 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647177+0000", 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4728999999999994e-05 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647257+0000", 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0694999999999999e-05 2024-09-12T22:11:35.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15394 4.c 4:334f772a:::10000003816.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1565435060000002, 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025644575999999999, 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.223 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15394 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956637+0000", 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964008+0000", 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073704119999999998 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964025+0000", 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7229999999999999e-05 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964033+0000", 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3920000000000003e-06 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964109+0000", 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6110000000000001e-05 2024-09-12T22:11:35.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964232+0000", 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012249799999999999 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964313+0000", 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1425000000000001e-05 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.969366+0000", 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050526989999999999 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982186+0000", 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012819818 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982244+0000", 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8532000000000001e-05 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982281+0000", 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6529999999999998e-05 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3747 3.e 3:715f5c78:::200.00000013:head [write 1826208~23101 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.4515927820000001, 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028762724999999999, 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:35.229 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661588+0000", 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661606+0000", 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661618+0000", 2024-09-12T22:11:35.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2283000000000001e-05 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661623+0000", 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3970000000000002e-06 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661677+0000", 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3909000000000002e-05 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:35.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661722+0000", 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4464e-05 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.662559+0000", 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083668200000000005 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690278+0000", 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027719338 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:35.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690350+0000", 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1806999999999999e-05 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:35.234 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:35.236 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:35.236 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:35.234+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:35.336 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:35.335+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:35.339 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:35.339 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:35.339 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:35.339 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:35.348 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:35.437 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:35.436+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:35.450 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:35.450 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:35.450 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:35.450 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:35.450 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:35.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:35.539 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:35.537+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.841500192000002, 2024-09-12T22:11:35.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:35.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:35.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.840899258, 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:35.568 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:35.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:35.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.829338133, 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:35.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:35.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.629494644000001, 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.629472795000002, 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.629458005, 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.629448136000001, 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.62943405, 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.7428580799999995, 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.4421866290000001, 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.1126590249999992, 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6417022350000003, 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.2221759350000001, 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.1473763640000003, 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.113310866, 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.9602337649999999, 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.8815325730000003, 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14224 4.b 4:d18ebcc4:::100000033ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.822091103, 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028328506, 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14224 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:11:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745412+0000", 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067359029999999997 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745430+0000", 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745440+0000", 2024-09-12T22:11:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745489+0000", 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8594999999999998e-05 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745551+0000", 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2578999999999998e-05 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745645+0000", 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3461000000000005e-05 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755780+0000", 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010135633999999999 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766912+0000", 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011132079 2024-09-12T22:11:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766968+0000", 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5835999999999999e-05 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.767004+0000", 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6134999999999999e-05 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14227 4.b 4:d1ba6b2c:::1000000348d.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.8152571530000001, 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027107289999999999, 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14227 2024-09-12T22:11:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751396+0000", 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058854429999999998 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751419+0000", 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2847e-05 2024-09-12T22:11:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751426+0000", 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751491+0000", 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4604999999999996e-05 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751686+0000", 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000195088 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751828+0000", 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014222400000000001 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755837+0000", 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040090810000000003 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772520+0000", 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016682704999999999 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772573+0000", 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3235000000000001e-05 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772617+0000", 2024-09-12T22:11:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4060999999999997e-05 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14704 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304 [2@1278380]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.3373815049999997, 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026165253999999999, 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14704 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223386+0000", 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.54e-07 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227867+0000", 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004480393 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227884+0000", 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227893+0000", 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8750000000000006e-06 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227975+0000", 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2102999999999996e-05 2024-09-12T22:11:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228034+0000", 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9243000000000002e-05 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228138+0000", 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103705 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.236978+0000", 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088398509999999993 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249495+0000", 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012517128000000001 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249527+0000", 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1890999999999997e-05 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249551+0000", 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3785e-05 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:35.690 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:35.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:35.692 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:35.693 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:35.690+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:35.793 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:35.792+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:35.797 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:35.797 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:35.797 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:35.797 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:35.806 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:35.830 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:35.830 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:35.850 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:35.850 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:35.851 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:35.855 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:35.856 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:35.894 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:35.893+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:35.910 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:35.911 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:35.920 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:35.995 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:35.994+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:36.025 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.025 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.034 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:36.096 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:36.095+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:36.139 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.140 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:36.197 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:36.196+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:36.252 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.252 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.259 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:36.300 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:36.299+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:36.400 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:36.399+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:36.402 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.402 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:36.501 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:36.500+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:36.517 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.517 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:36.611 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:36.610+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:36.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:11:36.672 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.672 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.682 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:36.705 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:36.701+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:36.805 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:36.804+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:36.828 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.828 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.836 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:36.905 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:36.904+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:36.943 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:36.943 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:36.952 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:37.006 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:37.005+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:37.068 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:37.068 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:37.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:37.129 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:37.126+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:37.208 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:37.206+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:37.230 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:37.230 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:37.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:37.308 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:37.307+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:37.343 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:37.344 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:37.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:37.437 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:37.436+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:37.498 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:37.498 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:37.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:37.509 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:37.508+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:37.565 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:11:37.610 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:37.609+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:37.654 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:37.654 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:37.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:37.711 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:37.710+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:37.768 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:37.768 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:37.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:37.822 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:37.821+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:37.856 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:37.883 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:37.884 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:37.893 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:37.912 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:37.911+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:37.991 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:37.992 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:38.012 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:38.013 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:38.012+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:38.016 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:38.016 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:38.041 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.320111208, 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.319510273999999, 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.307949148999999, 2024-09-12T22:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.059 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.10810566, 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:38.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:38.065 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.108083811, 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:38.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:38.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:38.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.108069020999999, 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:38.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:38.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:38.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.108059151999999, 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.078 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:38.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:38.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.084 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.108045065999999, 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:38.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:38.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:38.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.092 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.221469096, 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.093 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:38.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.096 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:38.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:38.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:38.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:38.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:38.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.920797645, 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:38.103 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.104 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.104 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.104 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:38.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:38.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.591270041, 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:38.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:38.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.120313251000001, 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:38.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7007869509999995, 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:38.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:38.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:38.129 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.6259873799999998, 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:38.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:38.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:38.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:38.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.136 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5919218819999994, 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:38.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:38.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.4388447810000002, 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:38.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:38.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:38.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:38.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:38.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:38.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.151 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.3601435889999998, 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:38.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:38.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.158 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14224 4.b 4:d18ebcc4:::100000033ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.3007021190000003, 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028328506, 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14224 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745412+0000", 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067359029999999997 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745430+0000", 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745440+0000", 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:11:38.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745489+0000", 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8594999999999998e-05 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745551+0000", 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2578999999999998e-05 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745645+0000", 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3461000000000005e-05 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755780+0000", 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010135633999999999 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766912+0000", 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011132079 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766968+0000", 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5835999999999999e-05 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.767004+0000", 2024-09-12T22:11:38.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6134999999999999e-05 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14227 4.b 4:d1ba6b2c:::1000000348d.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.2938681689999996, 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027107289999999999, 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14227 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:11:38.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751396+0000", 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058854429999999998 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751419+0000", 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2847e-05 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751426+0000", 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751491+0000", 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4604999999999996e-05 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751686+0000", 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000195088 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751828+0000", 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014222400000000001 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755837+0000", 2024-09-12T22:11:38.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040090810000000003 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772520+0000", 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016682704999999999 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772573+0000", 2024-09-12T22:11:38.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3235000000000001e-05 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772617+0000", 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4060999999999997e-05 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14704 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304 [2@1278380]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.8159925210000001, 2024-09-12T22:11:38.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026165253999999999, 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14704 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223386+0000", 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.54e-07 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227867+0000", 2024-09-12T22:11:38.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004480393 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227884+0000", 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227893+0000", 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8750000000000006e-06 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:38.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227975+0000", 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2102999999999996e-05 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228034+0000", 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9243000000000002e-05 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228138+0000", 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103705 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.236978+0000", 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088398509999999993 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249495+0000", 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012517128000000001 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249527+0000", 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1890999999999997e-05 2024-09-12T22:11:38.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249551+0000", 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3785e-05 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:38.179 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:38.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:38.182 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:38.180+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:38.281 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:38.280+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:38.316 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:38.316 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:38.316 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:38.316 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:38.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:38.382 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:38.381+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:38.471 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:38.471 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:38.471 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:38.471 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:38.471 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:38.480 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:38.483 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:38.482+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:38.583 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:38.582+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:38.590 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.869383336999999, 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.857320738999999, 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11071 4.c 4:3257e780:::1000000321f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.382851154000001, 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024562179, 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11071 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205482+0000", 2024-09-12T22:11:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211316+0000", 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058333539999999998 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211327+0000", 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1756000000000001e-05 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211335+0000", 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211385+0000", 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0507999999999998e-05 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211500+0000", 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114472 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211586+0000", 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5820000000000002e-05 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.215264+0000", 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036782809999999998 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.229982+0000", 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014718498 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230017+0000", 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4430000000000001e-05 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230044+0000", 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6653999999999999e-05 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11111 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304 [3@848846]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.316264133000001, 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034033252999999999, 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11111 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272069+0000", 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278159+0000", 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060894690000000001 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278172+0000", 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3237999999999999e-05 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278179+0000", 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0450000000000003e-06 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278240+0000", 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1273999999999996e-05 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278306+0000", 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6315000000000005e-05 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278428+0000", 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000121364 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.282607+0000", 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041791090000000003 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.305959+0000", 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023352435000000001 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306015+0000", 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5794000000000001e-05 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306102+0000", 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6508999999999995e-05 2024-09-12T22:11:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11122 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304 [2@1285126]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.298997852999999, 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026237979000000002, 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11122 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289336+0000", 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296646+0000", 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073105109999999996 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296658+0000", 2024-09-12T22:11:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1525000000000001e-05 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296663+0000", 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4210000000000003e-06 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296738+0000", 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4574999999999997e-05 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296806+0000", 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8424999999999996e-05 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296901+0000", 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4530999999999993e-05 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.300955+0000", 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040546649999999998 2024-09-12T22:11:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315478+0000", 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014523213 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315532+0000", 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3928000000000003e-05 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315573+0000", 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0250000000000003e-05 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11421 4.1b 4:db3ef485:::100000031c2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.90588934, 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024994136, 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11421 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682444+0000", 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690408+0000", 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079646000000000005 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690418+0000", 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3889999999999994e-06 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690423+0000", 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5430000000000001e-06 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690480+0000", 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6477999999999997e-05 2024-09-12T22:11:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690565+0000", 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690686+0000", 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012097899999999999 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.698289+0000", 2024-09-12T22:11:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076032239999999996 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707338+0000", 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090485210000000003 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707398+0000", 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9670000000000003e-05 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707437+0000", 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9780000000000002e-05 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11476 4.20 4:073157f6:::10000003181.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.831494966999999, 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024885865, 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11476 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756839+0000", 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.147e-06 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762627+0000", 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057881499999999997 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762655+0000", 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8581999999999998e-05 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762668+0000", 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2829e-05 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762764+0000", 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5867999999999998e-05 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762841+0000", 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7348999999999994e-05 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762936+0000", 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4968000000000003e-05 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.771619+0000", 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0086823079999999997 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781553+0000", 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099340929999999997 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781615+0000", 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1680999999999994e-05 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781723+0000", 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010889 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.627728751999999, 2024-09-12T22:11:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11632 4.18 4:1bddbeb1:::1000000315c.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.616141213000001, 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035921586999999998, 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11632 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972192+0000", 2024-09-12T22:11:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.012e-06 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972197+0000", 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972209+0000", 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1968e-05 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972217+0000", 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972263+0000", 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6477000000000002e-05 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972320+0000", 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7003999999999998e-05 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008113+0000", 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035792455000000001 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11633 4.1b 4:db3ef485:::100000031c2.00000000:head [read 131072~131072 [2@2632009]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.614635915999999, 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034773432, 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11633 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7400000000000002e-07 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973701+0000", 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:11:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007401+0000", 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033700059999999997 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5108000000000001e-05 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007507+0000", 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0133e-05 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000102818 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008470+0000", 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086063800000000005 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.611204988000001, 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11636 4.38 4:1f03a657:::10000003181.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.580715965, 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026771987000000001, 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11636 2024-09-12T22:11:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017190+0000", 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095727360000000001 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017205+0000", 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4758e-05 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017213+0000", 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6549999999999993e-06 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022810+0000", 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055969770000000004 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022856+0000", 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5136999999999998e-05 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022927+0000", 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1118999999999995e-05 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034260+0000", 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011333009999999999 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034309+0000", 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9605999999999999e-05 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034349+0000", 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9742e-05 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034389+0000", 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9505000000000002e-05 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13875 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2552453929999992, 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027048843999999999, 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13875 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333088+0000", 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.16e-07 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338344+0000", 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052561609999999996 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338362+0000", 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8306000000000001e-05 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338377+0000", 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4154e-05 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338464+0000", 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7410000000000005e-05 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338582+0000", 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000117928 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338690+0000", 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010781 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.342821+0000", 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041308919999999997 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360022+0000", 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017201675999999999 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360059+0000", 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6777999999999999e-05 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360136+0000", 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6812999999999998e-05 2024-09-12T22:11:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13961 4.30 4:0c2552b5:::10000003501.00000000:head [write 0~4194304 [2@434191]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.151004253, 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030398076999999999, 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13961 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437329+0000", 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443713+0000", 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063844100000000001 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443726+0000", 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2371000000000001e-05 2024-09-12T22:11:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443731+0000", 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.271e-06 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443812+0000", 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1036000000000001e-05 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443881+0000", 2024-09-12T22:11:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8749000000000002e-05 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.444133+0000", 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00025271700000000001 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.450353+0000", 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062195430000000001 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467617+0000", 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017263849000000001 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467678+0000", 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0714999999999997e-05 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467726+0000", 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8749999999999999e-05 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13999 4.18 4:18e6495a:::1000000353a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.1110174809999993, 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027586513999999999, 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13999 2024-09-12T22:11:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477316+0000", 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.33e-06 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482742+0000", 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054256349999999998 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482752+0000", 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0071999999999999e-05 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482758+0000", 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482803+0000", 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5229999999999999e-05 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482932+0000", 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012920799999999999 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.483074+0000", 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014124100000000001 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.487006+0000", 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039324210000000002 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504821+0000", 2024-09-12T22:11:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017814673999999999 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504861+0000", 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0822000000000003e-05 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504902+0000", 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0113e-05 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14158 4.3c 4:3f94d4c3:::100000034d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.9182115369999995, 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030683077, 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14158 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670122+0000", 2024-09-12T22:11:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.677995+0000", 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078731040000000006 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678008+0000", 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3736e-05 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678018+0000", 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1749999999999994e-06 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678127+0000", 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010953100000000001 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678196+0000", 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8594000000000001e-05 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678331+0000", 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013488700000000001 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.682561+0000", 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042304839999999996 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700726+0000", 2024-09-12T22:11:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018165369000000001 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700770+0000", 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3373e-05 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700804+0000", 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4199999999999998e-05 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14223 4.2b 4:d78f40a6:::100000033bb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.8529758899999997, 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030308063999999999, 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14223 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:38.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741431+0000", 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060735420000000004 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741440+0000", 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2050000000000008e-06 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741445+0000", 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.476e-06 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741529+0000", 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4608e-05 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741582+0000", 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3211999999999998e-05 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741662+0000", 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9062999999999998e-05 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.745183+0000", 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035216850000000001 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765556+0000", 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020372946999999999 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765622+0000", 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5905e-05 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765665+0000", 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2583999999999998e-05 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15096 4.18 4:1834b564:::100000035f3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.9658793269999997, 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024804242000000001, 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15096 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622454+0000", 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:11:38.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630159+0000", 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077051680000000001 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630170+0000", 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0866999999999999e-05 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630177+0000", 2024-09-12T22:11:38.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630235+0000", 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8230000000000003e-05 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630290+0000", 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5578999999999998e-05 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630379+0000", 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8073999999999997e-05 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.634844+0000", 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044656640000000003 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647082+0000", 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012237804999999999 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647177+0000", 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4728999999999994e-05 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647257+0000", 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0694999999999999e-05 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.696 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15394 4.c 4:334f772a:::10000003816.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6316962579999998, 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025644575999999999, 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15394 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956637+0000", 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964008+0000", 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073704119999999998 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964025+0000", 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7229999999999999e-05 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964033+0000", 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3920000000000003e-06 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964109+0000", 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6110000000000001e-05 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964232+0000", 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012249799999999999 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964313+0000", 2024-09-12T22:11:38.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1425000000000001e-05 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.969366+0000", 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050526989999999999 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982186+0000", 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012819818 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982244+0000", 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8532000000000001e-05 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982281+0000", 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6529999999999998e-05 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3747 3.e 3:715f5c78:::200.00000013:head [write 1826208~23101 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.9267455340000001, 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028762724999999999, 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661588+0000", 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661606+0000", 2024-09-12T22:11:38.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661618+0000", 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2283000000000001e-05 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661623+0000", 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3970000000000002e-06 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661677+0000", 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3909000000000002e-05 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661722+0000", 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4464e-05 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.662559+0000", 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083668200000000005 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690278+0000", 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027719338 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690350+0000", 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1806999999999999e-05 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.709 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:38.710 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:38.710 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:38.711 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:38.710+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:38.711 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:38.811 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:38.811+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:38.818 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:38.819 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:38.827 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:38.912 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:38.911+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:38.930 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:38.930 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:38.930 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:38.930 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:38.930 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:38.938 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:39.023 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:39.022+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:39.102 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.379649864000001, 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.37904893, 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.367487805, 2024-09-12T22:11:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.167644316000001, 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.167622467000001, 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.167607676999999, 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.167597808, 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.167583722, 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:39.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.281007752000001, 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.980336300999999, 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.650808697, 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.179851907, 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.175 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.7603256070000004, 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.176 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:39.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.6855260360000006, 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:39.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:39.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.6514605380000003, 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.189 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:39.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:39.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.4983834369999993, 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:39.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:39.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.4196822450000006, 2024-09-12T22:11:39.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:39.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:39.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:39.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.354 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14224 4.b 4:d18ebcc4:::100000033ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.354 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:39.354 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3602407749999994, 2024-09-12T22:11:39.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028328506, 2024-09-12T22:11:39.354 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14224 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745412+0000", 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067359029999999997 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745430+0000", 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745440+0000", 2024-09-12T22:11:39.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745489+0000", 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8594999999999998e-05 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745551+0000", 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2578999999999998e-05 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745645+0000", 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3461000000000005e-05 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755780+0000", 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010135633999999999 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766912+0000", 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011132079 2024-09-12T22:11:39.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766968+0000", 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5835999999999999e-05 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.767004+0000", 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6134999999999999e-05 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.360 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14227 4.b 4:d1ba6b2c:::1000000348d.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3534068250000004, 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027107289999999999, 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.361 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14227 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:39.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751396+0000", 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058854429999999998 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751419+0000", 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2847e-05 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751426+0000", 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751491+0000", 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4604999999999996e-05 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751686+0000", 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000195088 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751828+0000", 2024-09-12T22:11:39.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014222400000000001 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755837+0000", 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040090810000000003 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772520+0000", 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016682704999999999 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772573+0000", 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3235000000000001e-05 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772617+0000", 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4060999999999997e-05 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14704 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304 [2@1278380]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.367 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8755311769999992, 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026165253999999999, 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14704 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223386+0000", 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.54e-07 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227867+0000", 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004480393 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227884+0000", 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227893+0000", 2024-09-12T22:11:39.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8750000000000006e-06 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227975+0000", 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2102999999999996e-05 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228034+0000", 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9243000000000002e-05 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228138+0000", 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103705 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.236978+0000", 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088398509999999993 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249495+0000", 2024-09-12T22:11:39.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012517128000000001 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249527+0000", 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1890999999999997e-05 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249551+0000", 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3785e-05 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.373 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:39.374 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:39.374 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:39.376 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:39.376 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:39.374+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:39.475 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:39.475+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:39.481 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:39.482 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:39.482 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:39.482 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:39.493 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:39.577 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:39.576+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:39.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:11:39.638 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:39.639 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:39.647 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:39.678 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:39.677+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:39.757 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:39.757 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:39.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:39.757 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:39.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.757 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:39.757 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.035626454999999, 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.758 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:39.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.023563856999999, 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:39.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:39.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:39.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11071 4.c 4:3257e780:::1000000321f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.549094272, 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024562179, 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.773 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11071 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205482+0000", 2024-09-12T22:11:39.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211316+0000", 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058333539999999998 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211327+0000", 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1756000000000001e-05 2024-09-12T22:11:39.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211335+0000", 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211385+0000", 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0507999999999998e-05 2024-09-12T22:11:39.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211500+0000", 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114472 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211586+0000", 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5820000000000002e-05 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.215264+0000", 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036782809999999998 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.229982+0000", 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014718498 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230017+0000", 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4430000000000001e-05 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230044+0000", 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6653999999999999e-05 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11111 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304 [3@848846]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.482507250999999, 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034033252999999999, 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11111 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272069+0000", 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278159+0000", 2024-09-12T22:11:39.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060894690000000001 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278172+0000", 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3237999999999999e-05 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278179+0000", 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0450000000000003e-06 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278240+0000", 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1273999999999996e-05 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278306+0000", 2024-09-12T22:11:39.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6315000000000005e-05 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278428+0000", 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000121364 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.282607+0000", 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041791090000000003 2024-09-12T22:11:39.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.305959+0000", 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023352435000000001 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306015+0000", 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5794000000000001e-05 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306102+0000", 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6508999999999995e-05 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11122 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304 [2@1285126]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:39.788 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.465240971, 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026237979000000002, 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11122 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289336+0000", 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296646+0000", 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073105109999999996 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296658+0000", 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1525000000000001e-05 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296663+0000", 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4210000000000003e-06 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296738+0000", 2024-09-12T22:11:39.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4574999999999997e-05 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296806+0000", 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8424999999999996e-05 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296901+0000", 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4530999999999993e-05 2024-09-12T22:11:39.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.300955+0000", 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040546649999999998 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315478+0000", 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014523213 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315532+0000", 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3928000000000003e-05 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315573+0000", 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0250000000000003e-05 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11421 4.1b 4:db3ef485:::100000031c2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.072132458, 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024994136, 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11421 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:39.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682444+0000", 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690408+0000", 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079646000000000005 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690418+0000", 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3889999999999994e-06 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690423+0000", 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5430000000000001e-06 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690480+0000", 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6477999999999997e-05 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690565+0000", 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690686+0000", 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012097899999999999 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.698289+0000", 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076032239999999996 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707338+0000", 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090485210000000003 2024-09-12T22:11:39.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707398+0000", 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9670000000000003e-05 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707437+0000", 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9780000000000002e-05 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11476 4.20 4:073157f6:::10000003181.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.997738085, 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024885865, 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.803 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11476 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756839+0000", 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.147e-06 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762627+0000", 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057881499999999997 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762655+0000", 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8581999999999998e-05 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762668+0000", 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2829e-05 2024-09-12T22:11:39.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762764+0000", 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5867999999999998e-05 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762841+0000", 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7348999999999994e-05 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762936+0000", 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4968000000000003e-05 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.771619+0000", 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0086823079999999997 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781553+0000", 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099340929999999997 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781615+0000", 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1680999999999994e-05 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781723+0000", 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010889 2024-09-12T22:11:39.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.79397187, 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.810 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:39.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:39.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11632 4.18 4:1bddbeb1:::1000000315c.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.782384330999999, 2024-09-12T22:11:39.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035921586999999998, 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11632 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972192+0000", 2024-09-12T22:11:39.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.012e-06 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972197+0000", 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972209+0000", 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1968e-05 2024-09-12T22:11:39.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972217+0000", 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972263+0000", 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6477000000000002e-05 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972320+0000", 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7003999999999998e-05 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008113+0000", 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035792455000000001 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11633 4.1b 4:db3ef485:::100000031c2.00000000:head [read 131072~131072 [2@2632009]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.780879034, 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034773432, 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.823 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11633 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7400000000000002e-07 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973701+0000", 2024-09-12T22:11:39.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007401+0000", 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033700059999999997 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5108000000000001e-05 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007507+0000", 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0133e-05 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000102818 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008470+0000", 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086063800000000005 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:39.828 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.777448106, 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11636 4.38 4:1f03a657:::10000003181.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.746959083, 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026771987000000001, 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.835 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11636 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017190+0000", 2024-09-12T22:11:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095727360000000001 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017205+0000", 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4758e-05 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017213+0000", 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6549999999999993e-06 2024-09-12T22:11:39.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022810+0000", 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055969770000000004 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022856+0000", 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5136999999999998e-05 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022927+0000", 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1118999999999995e-05 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034260+0000", 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011333009999999999 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034309+0000", 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9605999999999999e-05 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034349+0000", 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9742e-05 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034389+0000", 2024-09-12T22:11:39.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9505000000000002e-05 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13875 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.421488511, 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027048843999999999, 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.842 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13875 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333088+0000", 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.16e-07 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338344+0000", 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052561609999999996 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338362+0000", 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8306000000000001e-05 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338377+0000", 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4154e-05 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338464+0000", 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7410000000000005e-05 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338582+0000", 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000117928 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338690+0000", 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010781 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.342821+0000", 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041308919999999997 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360022+0000", 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017201675999999999 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360059+0000", 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6777999999999999e-05 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360136+0000", 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6812999999999998e-05 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13961 4.30 4:0c2552b5:::10000003501.00000000:head [write 0~4194304 [2@434191]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.317247371000001, 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030398076999999999, 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.850 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13961 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437329+0000", 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443713+0000", 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063844100000000001 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443726+0000", 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2371000000000001e-05 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443731+0000", 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.271e-06 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443812+0000", 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1036000000000001e-05 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443881+0000", 2024-09-12T22:11:39.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8749000000000002e-05 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.444133+0000", 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00025271700000000001 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.450353+0000", 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062195430000000001 2024-09-12T22:11:39.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467617+0000", 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017263849000000001 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467678+0000", 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0714999999999997e-05 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467726+0000", 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8749999999999999e-05 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13999 4.18 4:18e6495a:::1000000353a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.277260599, 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027586513999999999, 2024-09-12T22:11:39.857 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13999 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:39.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477316+0000", 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.33e-06 2024-09-12T22:11:39.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482742+0000", 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054256349999999998 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482752+0000", 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0071999999999999e-05 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482758+0000", 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482803+0000", 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5229999999999999e-05 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482932+0000", 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012920799999999999 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.483074+0000", 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014124100000000001 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.487006+0000", 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039324210000000002 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504821+0000", 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017814673999999999 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504861+0000", 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0822000000000003e-05 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504902+0000", 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0113e-05 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.864 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14158 4.3c 4:3f94d4c3:::100000034d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.084454655, 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030683077, 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.865 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14158 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670122+0000", 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.677995+0000", 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078731040000000006 2024-09-12T22:11:39.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678008+0000", 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3736e-05 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678018+0000", 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1749999999999994e-06 2024-09-12T22:11:39.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678127+0000", 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010953100000000001 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678196+0000", 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8594000000000001e-05 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678331+0000", 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013488700000000001 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.682561+0000", 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042304839999999996 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700726+0000", 2024-09-12T22:11:39.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018165369000000001 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700770+0000", 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3373e-05 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700804+0000", 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4199999999999998e-05 2024-09-12T22:11:39.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14223 4.2b 4:d78f40a6:::100000033bb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.019219008, 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030308063999999999, 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14223 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:11:39.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741431+0000", 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060735420000000004 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741440+0000", 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2050000000000008e-06 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741445+0000", 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.476e-06 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741529+0000", 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4608e-05 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741582+0000", 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3211999999999998e-05 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741662+0000", 2024-09-12T22:11:39.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9062999999999998e-05 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.745183+0000", 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035216850000000001 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765556+0000", 2024-09-12T22:11:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020372946999999999 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765622+0000", 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5905e-05 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765665+0000", 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2583999999999998e-05 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.879 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15096 4.18 4:1834b564:::100000035f3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.1321224450000003, 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024804242000000001, 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15096 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622454+0000", 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:11:39.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630159+0000", 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077051680000000001 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630170+0000", 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0866999999999999e-05 2024-09-12T22:11:39.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630177+0000", 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630235+0000", 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8230000000000003e-05 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630290+0000", 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5578999999999998e-05 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630379+0000", 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8073999999999997e-05 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.634844+0000", 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044656640000000003 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647082+0000", 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012237804999999999 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647177+0000", 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4728999999999994e-05 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647257+0000", 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0694999999999999e-05 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15394 4.c 4:334f772a:::10000003816.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7979393760000004, 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025644575999999999, 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:39.888 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15394 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956637+0000", 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964008+0000", 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073704119999999998 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964025+0000", 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7229999999999999e-05 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964033+0000", 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3920000000000003e-06 2024-09-12T22:11:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964109+0000", 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6110000000000001e-05 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964232+0000", 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012249799999999999 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964313+0000", 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1425000000000001e-05 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.969366+0000", 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050526989999999999 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982186+0000", 2024-09-12T22:11:39.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012819818 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982244+0000", 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8532000000000001e-05 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982281+0000", 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6529999999999998e-05 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.894 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3747 3.e 3:715f5c78:::200.00000013:head [write 1826208~23101 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.0929886519999998, 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028762724999999999, 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:39.895 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:39.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661588+0000", 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661606+0000", 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661618+0000", 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2283000000000001e-05 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661623+0000", 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3970000000000002e-06 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661677+0000", 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3909000000000002e-05 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661722+0000", 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4464e-05 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.662559+0000", 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083668200000000005 2024-09-12T22:11:39.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690278+0000", 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027719338 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690350+0000", 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1806999999999999e-05 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.900 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:39.901 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:39.901 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:39.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~64s 2024-09-12T22:11:39.902 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:39.901+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:39.903 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:40.003 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:40.002+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:40.008 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:40.008 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:40.016 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:40.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:40.105 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:40.103+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:40.156 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:40.178 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:40.182 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:40.182 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:40.205 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:40.204+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:40.211 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:40.211 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:40.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:40.306 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:40.305+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:40.324 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:40.324 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:40.333 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:40.406 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:40.405+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:40.440 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:40.440 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:40.449 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:40.508 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:40.507+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:40.554 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:40.554 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:40.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:40.587 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:11:40.608 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:40.607+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:40.671 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:40.671 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:40.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:40.710 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:40.709+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:40.787 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:40.787 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:40.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:40.811 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:40.810+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:40.903 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:40.903 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:40.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:40.914 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:40.911+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.013 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.012+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.059 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:41.060 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:41.070 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:41.114 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:41.113+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:41.215 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.214+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.216 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:41.216 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:41.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:41.316 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.315+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.371 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:41.371 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:41.380 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:41.416 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.415+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.490 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:41.490 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:41.499 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:41.546 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.545+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.603 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:41.603 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:41.613 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:41.618 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:41.617+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:41.719 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.718+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.758 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:41.758 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:41.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:41.852 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.851+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.912 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:41.912 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:41.920 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:41.919+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:41.921 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:42.021 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:42.020+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:42.027 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:42.027 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:42.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:42.122 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:42.121+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:42.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:42.223 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:42.223 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:42.223 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:42.222+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:42.232 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:42.324 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:42.322+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:42.328 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:42.349 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:42.350 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:42.350 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:42.353 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:42.354 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:42.368 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-12T22:11:42.368 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T22:11:42.379 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.657191161, 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:42.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:42.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:42.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:42.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.645128563, 2024-09-12T22:11:42.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:42.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:42.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:42.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:42.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:42.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.398 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.398 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:42.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:42.398 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.399 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.399 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.399 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11071 4.c 4:3257e780:::1000000321f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.399 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:42.400 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.170658977999999, 2024-09-12T22:11:42.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024562179, 2024-09-12T22:11:42.400 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.400 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.400 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.400 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.400 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.401 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.401 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11071 2024-09-12T22:11:42.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.401 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205482+0000", 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211316+0000", 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058333539999999998 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211327+0000", 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1756000000000001e-05 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211335+0000", 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211385+0000", 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0507999999999998e-05 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211500+0000", 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114472 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211586+0000", 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5820000000000002e-05 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.215264+0000", 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036782809999999998 2024-09-12T22:11:42.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.229982+0000", 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014718498 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230017+0000", 2024-09-12T22:11:42.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4430000000000001e-05 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230044+0000", 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6653999999999999e-05 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11111 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304 [3@848846]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:42.408 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.104071956999999, 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034033252999999999, 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11111 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272069+0000", 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278159+0000", 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060894690000000001 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278172+0000", 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3237999999999999e-05 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278179+0000", 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0450000000000003e-06 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278240+0000", 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1273999999999996e-05 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278306+0000", 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6315000000000005e-05 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278428+0000", 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000121364 2024-09-12T22:11:42.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.282607+0000", 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041791090000000003 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.305959+0000", 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023352435000000001 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306015+0000", 2024-09-12T22:11:42.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5794000000000001e-05 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306102+0000", 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6508999999999995e-05 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11122 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304 [2@1285126]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.086805677000001, 2024-09-12T22:11:42.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026237979000000002, 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11122 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289336+0000", 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296646+0000", 2024-09-12T22:11:42.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073105109999999996 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296658+0000", 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1525000000000001e-05 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296663+0000", 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4210000000000003e-06 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.417 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296738+0000", 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4574999999999997e-05 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296806+0000", 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8424999999999996e-05 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296901+0000", 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4530999999999993e-05 2024-09-12T22:11:42.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.300955+0000", 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040546649999999998 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315478+0000", 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014523213 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315532+0000", 2024-09-12T22:11:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3928000000000003e-05 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315573+0000", 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0250000000000003e-05 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11421 4.1b 4:db3ef485:::100000031c2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 15.693697164, 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024994136, 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.421 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11421 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:42.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682444+0000", 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690408+0000", 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079646000000000005 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690418+0000", 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3889999999999994e-06 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690423+0000", 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5430000000000001e-06 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690480+0000", 2024-09-12T22:11:42.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6477999999999997e-05 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690565+0000", 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690686+0000", 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012097899999999999 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.425 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.698289+0000", 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076032239999999996 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707338+0000", 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090485210000000003 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707398+0000", 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9670000000000003e-05 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707437+0000", 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9780000000000002e-05 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11476 4.20 4:073157f6:::10000003181.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 15.619302790999999, 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024885865, 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.427 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11476 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756839+0000", 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.147e-06 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762627+0000", 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057881499999999997 2024-09-12T22:11:42.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762655+0000", 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8581999999999998e-05 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762668+0000", 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2829e-05 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762764+0000", 2024-09-12T22:11:42.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5867999999999998e-05 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762841+0000", 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7348999999999994e-05 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762936+0000", 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4968000000000003e-05 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.771619+0000", 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0086823079999999997 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781553+0000", 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099340929999999997 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781615+0000", 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1680999999999994e-05 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781723+0000", 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010889 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:42.433 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 15.415536575999999, 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.434 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:42.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.439 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11632 4.18 4:1bddbeb1:::1000000315c.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 15.403949037, 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035921586999999998, 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11632 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972192+0000", 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.012e-06 2024-09-12T22:11:42.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972197+0000", 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972209+0000", 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1968e-05 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972217+0000", 2024-09-12T22:11:42.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972263+0000", 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6477000000000002e-05 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972320+0000", 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7003999999999998e-05 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.443 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008113+0000", 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035792455000000001 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11633 4.1b 4:db3ef485:::100000031c2.00000000:head [read 131072~131072 [2@2632009]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 15.402443740000001, 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034773432, 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.444 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11633 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7400000000000002e-07 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973701+0000", 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007401+0000", 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033700059999999997 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5108000000000001e-05 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007507+0000", 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0133e-05 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000102818 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008470+0000", 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086063800000000005 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.448 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 15.399012812, 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.449 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:42.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:42.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.452 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11636 4.38 4:1f03a657:::10000003181.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 15.368523788999999, 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026771987000000001, 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11636 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017190+0000", 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095727360000000001 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017205+0000", 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4758e-05 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017213+0000", 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6549999999999993e-06 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022810+0000", 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055969770000000004 2024-09-12T22:11:42.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022856+0000", 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5136999999999998e-05 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022927+0000", 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1118999999999995e-05 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034260+0000", 2024-09-12T22:11:42.458 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011333009999999999 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034309+0000", 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9605999999999999e-05 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034349+0000", 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9742e-05 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034389+0000", 2024-09-12T22:11:42.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9505000000000002e-05 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13875 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.043053217000001, 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027048843999999999, 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.460 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13875 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333088+0000", 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.16e-07 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338344+0000", 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052561609999999996 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338362+0000", 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8306000000000001e-05 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338377+0000", 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4154e-05 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338464+0000", 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7410000000000005e-05 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338582+0000", 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000117928 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338690+0000", 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010781 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.342821+0000", 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041308919999999997 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360022+0000", 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017201675999999999 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360059+0000", 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6777999999999999e-05 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360136+0000", 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6812999999999998e-05 2024-09-12T22:11:42.465 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13961 4.30 4:0c2552b5:::10000003501.00000000:head [write 0~4194304 [2@434191]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.938812077, 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030398076999999999, 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.466 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13961 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437329+0000", 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443713+0000", 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063844100000000001 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443726+0000", 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2371000000000001e-05 2024-09-12T22:11:42.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443731+0000", 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.271e-06 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443812+0000", 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1036000000000001e-05 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443881+0000", 2024-09-12T22:11:42.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8749000000000002e-05 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.444133+0000", 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00025271700000000001 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.450353+0000", 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062195430000000001 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467617+0000", 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017263849000000001 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467678+0000", 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0714999999999997e-05 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467726+0000", 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8749999999999999e-05 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.471 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13999 4.18 4:18e6495a:::1000000353a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.898825305000001, 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027586513999999999, 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13999 2024-09-12T22:11:42.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.473 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477316+0000", 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.33e-06 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482742+0000", 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054256349999999998 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482752+0000", 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0071999999999999e-05 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482758+0000", 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482803+0000", 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5229999999999999e-05 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482932+0000", 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012920799999999999 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.483074+0000", 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014124100000000001 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.487006+0000", 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039324210000000002 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504821+0000", 2024-09-12T22:11:42.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017814673999999999 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504861+0000", 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0822000000000003e-05 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504902+0000", 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0113e-05 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14158 4.3c 4:3f94d4c3:::100000034d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.706019360999999, 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030683077, 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14158 2024-09-12T22:11:42.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670122+0000", 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.677995+0000", 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078731040000000006 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678008+0000", 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3736e-05 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678018+0000", 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1749999999999994e-06 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678127+0000", 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010953100000000001 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678196+0000", 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8594000000000001e-05 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678331+0000", 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013488700000000001 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.682561+0000", 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042304839999999996 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700726+0000", 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018165369000000001 2024-09-12T22:11:42.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700770+0000", 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3373e-05 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700804+0000", 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4199999999999998e-05 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14223 4.2b 4:d78f40a6:::100000033bb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.640783713999999, 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030308063999999999, 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14223 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741431+0000", 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060735420000000004 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741440+0000", 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2050000000000008e-06 2024-09-12T22:11:42.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741445+0000", 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.476e-06 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741529+0000", 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4608e-05 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741582+0000", 2024-09-12T22:11:42.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3211999999999998e-05 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741662+0000", 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9062999999999998e-05 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.745183+0000", 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035216850000000001 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765556+0000", 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020372946999999999 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765622+0000", 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5905e-05 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765665+0000", 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2583999999999998e-05 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.489 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15096 4.18 4:1834b564:::100000035f3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.753687150999999, 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024804242000000001, 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.490 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15096 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622454+0000", 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630159+0000", 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077051680000000001 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630170+0000", 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0866999999999999e-05 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630177+0000", 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630235+0000", 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8230000000000003e-05 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630290+0000", 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5578999999999998e-05 2024-09-12T22:11:42.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630379+0000", 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8073999999999997e-05 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.634844+0000", 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044656640000000003 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647082+0000", 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012237804999999999 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647177+0000", 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4728999999999994e-05 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647257+0000", 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0694999999999999e-05 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.495 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15394 4.c 4:334f772a:::10000003816.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.419504082, 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025644575999999999, 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.496 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15394 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956637+0000", 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964008+0000", 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073704119999999998 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964025+0000", 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7229999999999999e-05 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964033+0000", 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3920000000000003e-06 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964109+0000", 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6110000000000001e-05 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964232+0000", 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012249799999999999 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964313+0000", 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1425000000000001e-05 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.969366+0000", 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050526989999999999 2024-09-12T22:11:42.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982186+0000", 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012819818 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982244+0000", 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8532000000000001e-05 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982281+0000", 2024-09-12T22:11:42.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6529999999999998e-05 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3747 3.e 3:715f5c78:::200.00000013:head [write 1826208~23101 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7145533579999999, 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028762724999999999, 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:42.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661588+0000", 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:11:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661606+0000", 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661618+0000", 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2283000000000001e-05 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661623+0000", 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3970000000000002e-06 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661677+0000", 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3909000000000002e-05 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661722+0000", 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4464e-05 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.662559+0000", 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083668200000000005 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690278+0000", 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027719338 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690350+0000", 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1806999999999999e-05 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.506 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.507 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:42.507 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:42.507 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:42.508 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:42.507+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:42.509 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:42.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:11:42.608 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:42.608+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:42.612 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:42.612 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:42.612 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:42.612 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:42.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:42.709 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:42.708+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:42.724 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:42.724 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:42.724 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:42.724 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:42.724 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:42.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:42.810 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:42.809+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:42.822 DEBUG:teuthology.parallel:result is None 2024-09-12T22:11:42.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.116408103000001, 2024-09-12T22:11:42.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.115807169, 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.843 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:42.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.104246044, 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.848 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:42.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.852 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.904402555000001, 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:42.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:42.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:42.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.904380706000001, 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:42.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.904365916, 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:42.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:42.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:42.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.904356047, 2024-09-12T22:11:42.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:42.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.904341961, 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:42.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.017765991000001, 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.717094540000002, 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.387566935999999, 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.916610146, 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.497083846000001, 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.422284274999999, 2024-09-12T22:11:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.388218777000001, 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.235141676, 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.156440484000001, 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14224 4.b 4:d18ebcc4:::100000033ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.096999014, 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028328506, 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14224 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745412+0000", 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067359029999999997 2024-09-12T22:11:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745430+0000", 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745440+0000", 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745489+0000", 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8594999999999998e-05 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745551+0000", 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2578999999999998e-05 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745645+0000", 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3461000000000005e-05 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755780+0000", 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010135633999999999 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766912+0000", 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011132079 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766968+0000", 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5835999999999999e-05 2024-09-12T22:11:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.767004+0000", 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6134999999999999e-05 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14227 4.b 4:d1ba6b2c:::1000000348d.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.090165064000001, 2024-09-12T22:11:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027107289999999999, 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14227 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751396+0000", 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058854429999999998 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751419+0000", 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2847e-05 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751426+0000", 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751491+0000", 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4604999999999996e-05 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751686+0000", 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000195088 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751828+0000", 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014222400000000001 2024-09-12T22:11:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755837+0000", 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040090810000000003 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772520+0000", 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016682704999999999 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772573+0000", 2024-09-12T22:11:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3235000000000001e-05 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772617+0000", 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4060999999999997e-05 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14704 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304 [2@1278380]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.612289415999999, 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026165253999999999, 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14704 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223386+0000", 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.54e-07 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227867+0000", 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004480393 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227884+0000", 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227893+0000", 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8750000000000006e-06 2024-09-12T22:11:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227975+0000", 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2102999999999996e-05 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228034+0000", 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9243000000000002e-05 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228138+0000", 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103705 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.236978+0000", 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088398509999999993 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249495+0000", 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012517128000000001 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249527+0000", 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1890999999999997e-05 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249551+0000", 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3785e-05 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:42.956 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:42.958 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T22:11:42.958 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T22:11:42.968 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T22:11:42.968 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:11:42.968 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:11:42.969 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:42.969 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:42.957+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:43.014 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:11:43.014 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:11:43.058 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:43.057+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:43.071 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T22:11:43.076 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:43.076 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:43.076 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:43.076 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:43.085 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:43.159 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:43.158+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:43.254 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:43.254 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:43.260 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:43.259+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:43.263 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:43.360 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:43.359+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:43.368 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:43.368 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:43.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.647267023000001, 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.369 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:43.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:43.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:43.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5093 4.2c 4:37d010ff:::100000017c3.00000000:head [write 0~459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.635204425000001, 2024-09-12T22:11:43.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030255562, 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5093 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731012+0000", 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731013+0000", 2024-09-12T22:11:43.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0139999999999999e-06 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731018+0000", 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2480000000000004e-06 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731033+0000", 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.47e-05 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731042+0000", 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0690000000000008e-06 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731084+0000", 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2070000000000002e-05 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731164+0000", 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9758000000000004e-05 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731236+0000", 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2527999999999994e-05 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.731795+0000", 2024-09-12T22:11:43.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00055926299999999995 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761204+0000", 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029408586 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761243+0000", 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9347999999999997e-05 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.761267+0000", 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3978e-05 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11071 4.c 4:3257e780:::1000000321f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.16073484, 2024-09-12T22:11:43.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024562179, 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11071 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205481+0000", 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.205482+0000", 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211316+0000", 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058333539999999998 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211327+0000", 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1756000000000001e-05 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211335+0000", 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-06 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211385+0000", 2024-09-12T22:11:43.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0507999999999998e-05 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211500+0000", 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114472 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.211586+0000", 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5820000000000002e-05 2024-09-12T22:11:43.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.215264+0000", 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0036782809999999998 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.229982+0000", 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014718498 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230017+0000", 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4430000000000001e-05 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.230044+0000", 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6653999999999999e-05 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11111 4.20 4:060b30bc:::100000030e8.00000000:head [write 0~4194304 [3@848846]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.094147819, 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034033252999999999, 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.391 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11111 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272068+0000", 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.272069+0000", 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0100000000000004e-07 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278159+0000", 2024-09-12T22:11:43.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060894690000000001 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278172+0000", 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3237999999999999e-05 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278179+0000", 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0450000000000003e-06 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278240+0000", 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1273999999999996e-05 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278306+0000", 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6315000000000005e-05 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.278428+0000", 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000121364 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.282607+0000", 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041791090000000003 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.305959+0000", 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023352435000000001 2024-09-12T22:11:43.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306015+0000", 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5794000000000001e-05 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.306102+0000", 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6508999999999995e-05 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.397 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11122 4.2b 4:d5a2f2a8:::10000003161.00000000:head [write 0~4194304 [2@1285126]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.076881538999999, 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026237979000000002, 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.398 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.399 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.399 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11122 2024-09-12T22:11:43.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.399 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.399 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.399 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289335+0000", 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.289336+0000", 2024-09-12T22:11:43.400 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3500000000000005e-07 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296646+0000", 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073105109999999996 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296658+0000", 2024-09-12T22:11:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1525000000000001e-05 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296663+0000", 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4210000000000003e-06 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296738+0000", 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4574999999999997e-05 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296806+0000", 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8424999999999996e-05 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.296901+0000", 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4530999999999993e-05 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.300955+0000", 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040546649999999998 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315478+0000", 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014523213 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315532+0000", 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3928000000000003e-05 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.315573+0000", 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0250000000000003e-05 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11421 4.1b 4:db3ef485:::100000031c2.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.683773026000001, 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024994136, 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.406 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11421 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682443+0000", 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.682444+0000", 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9200000000000001e-07 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690408+0000", 2024-09-12T22:11:43.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079646000000000005 2024-09-12T22:11:43.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690418+0000", 2024-09-12T22:11:43.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3889999999999994e-06 2024-09-12T22:11:43.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690423+0000", 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5430000000000001e-06 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690480+0000", 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6477999999999997e-05 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690565+0000", 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5359999999999996e-05 2024-09-12T22:11:43.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.690686+0000", 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012097899999999999 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.698289+0000", 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076032239999999996 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707338+0000", 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090485210000000003 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707398+0000", 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9670000000000003e-05 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.707437+0000", 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9780000000000002e-05 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11476 4.20 4:073157f6:::10000003181.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:43.416 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.609378653, 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024885865, 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11476 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756838+0000", 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.756839+0000", 2024-09-12T22:11:43.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.147e-06 2024-09-12T22:11:43.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762627+0000", 2024-09-12T22:11:43.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057881499999999997 2024-09-12T22:11:43.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762655+0000", 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8581999999999998e-05 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762668+0000", 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2829e-05 2024-09-12T22:11:43.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762764+0000", 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5867999999999998e-05 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762841+0000", 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7348999999999994e-05 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.421 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.762936+0000", 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4968000000000003e-05 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.771619+0000", 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0086823079999999997 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.422 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781553+0000", 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099340929999999997 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781615+0000", 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1680999999999994e-05 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.781723+0000", 2024-09-12T22:11:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010889 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.405612437999999, 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.431 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11632 4.18 4:1bddbeb1:::1000000315c.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.394024899000001, 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035921586999999998, 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11632 2024-09-12T22:11:43.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972191+0000", 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972192+0000", 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.012e-06 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972197+0000", 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972209+0000", 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1968e-05 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972217+0000", 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972263+0000", 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6477000000000002e-05 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972320+0000", 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7003999999999998e-05 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008113+0000", 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035792455000000001 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11633 4.1b 4:db3ef485:::100000031c2.00000000:head [read 131072~131072 [2@2632009]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:43.437 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.392519602, 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034773432, 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11633 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973697+0000", 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7400000000000002e-07 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.973701+0000", 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8010000000000001e-06 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007401+0000", 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033700059999999997 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5108000000000001e-05 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007507+0000", 2024-09-12T22:11:43.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0133e-05 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000102818 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.008470+0000", 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086063800000000005 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.389088674, 2024-09-12T22:11:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.444 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:43.445 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.447 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:43.448 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11636 4.38 4:1f03a657:::10000003181.00000000:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.358599650999999, 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026771987000000001, 2024-09-12T22:11:43.449 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11636 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:43.450 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007617+0000", 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4199999999999995e-07 2024-09-12T22:11:43.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017190+0000", 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095727360000000001 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.452 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017205+0000", 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4758e-05 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.017213+0000", 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6549999999999993e-06 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.453 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022810+0000", 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055969770000000004 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022856+0000", 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5136999999999998e-05 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.022927+0000", 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1118999999999995e-05 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034260+0000", 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011333009999999999 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.455 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034309+0000", 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9605999999999999e-05 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034349+0000", 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9742e-05 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.034389+0000", 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9505000000000002e-05 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13875 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 14.033129079, 2024-09-12T22:11:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027048843999999999, 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13875 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333087+0000", 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.459 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.333088+0000", 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.16e-07 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338344+0000", 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052561609999999996 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338362+0000", 2024-09-12T22:11:43.460 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8306000000000001e-05 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338377+0000", 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4154e-05 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338464+0000", 2024-09-12T22:11:43.461 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7410000000000005e-05 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338582+0000", 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000117928 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.338690+0000", 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010781 2024-09-12T22:11:43.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.342821+0000", 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041308919999999997 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360022+0000", 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017201675999999999 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.463 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360059+0000", 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6777999999999999e-05 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.360136+0000", 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6812999999999998e-05 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13961 4.30 4:0c2552b5:::10000003501.00000000:head [write 0~4194304 [2@434191]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.928887938999999, 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030398076999999999, 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13961 2024-09-12T22:11:43.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437328+0000", 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.437329+0000", 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6599999999999996e-07 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443713+0000", 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0063844100000000001 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443726+0000", 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2371000000000001e-05 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443731+0000", 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.271e-06 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443812+0000", 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1036000000000001e-05 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.443881+0000", 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8749000000000002e-05 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.444133+0000", 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00025271700000000001 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.450353+0000", 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0062195430000000001 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.470 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467617+0000", 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017263849000000001 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467678+0000", 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0714999999999997e-05 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.467726+0000", 2024-09-12T22:11:43.471 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8749999999999999e-05 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:13999 4.18 4:18e6495a:::1000000353a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.888901167, 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027586513999999999, 2024-09-12T22:11:43.472 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13999 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.473 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477315+0000", 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.474 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.477316+0000", 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.33e-06 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482742+0000", 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054256349999999998 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.475 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482752+0000", 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0071999999999999e-05 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482758+0000", 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7679999999999997e-06 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482803+0000", 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5229999999999999e-05 2024-09-12T22:11:43.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.482932+0000", 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012920799999999999 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.483074+0000", 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014124100000000001 2024-09-12T22:11:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.487006+0000", 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039324210000000002 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504821+0000", 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017814673999999999 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504861+0000", 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0822000000000003e-05 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.504902+0000", 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0113e-05 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.479 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14158 4.3c 4:3f94d4c3:::100000034d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.696095223, 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030683077, 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.480 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14158 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670121+0000", 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.670122+0000", 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2399999999999998e-07 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.677995+0000", 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078731040000000006 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678008+0000", 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3736e-05 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678018+0000", 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1749999999999994e-06 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678127+0000", 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010953100000000001 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678196+0000", 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8594000000000001e-05 2024-09-12T22:11:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.678331+0000", 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013488700000000001 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.682561+0000", 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042304839999999996 2024-09-12T22:11:43.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700726+0000", 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018165369000000001 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700770+0000", 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3373e-05 2024-09-12T22:11:43.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.700804+0000", 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4199999999999998e-05 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:14223 4.2b 4:d78f40a6:::100000033bb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:43.487 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.630859576000001, 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030308063999999999, 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 14223 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.735357+0000", 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3699999999999999e-07 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741431+0000", 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0060735420000000004 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741440+0000", 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2050000000000008e-06 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741445+0000", 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.476e-06 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741529+0000", 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4608e-05 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741582+0000", 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3211999999999998e-05 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.741662+0000", 2024-09-12T22:11:43.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9062999999999998e-05 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.745183+0000", 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035216850000000001 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765556+0000", 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020372946999999999 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765622+0000", 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5905e-05 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:29.765665+0000", 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2583999999999998e-05 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15096 4.18 4:1834b564:::100000035f3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.743763013000001, 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024804242000000001, 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.495 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15096 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622453+0000", 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.622454+0000", 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630159+0000", 2024-09-12T22:11:43.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077051680000000001 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630170+0000", 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0866999999999999e-05 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630177+0000", 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630235+0000", 2024-09-12T22:11:43.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8230000000000003e-05 2024-09-12T22:11:43.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630290+0000", 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5578999999999998e-05 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.630379+0000", 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8073999999999997e-05 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.634844+0000", 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0044656640000000003 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647082+0000", 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012237804999999999 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647177+0000", 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4728999999999994e-05 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.647257+0000", 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0694999999999999e-05 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.502 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:15394 4.c 4:334f772a:::10000003816.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.409579944000001, 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025644575999999999, 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.503 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15394 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956636+0000", 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.956637+0000", 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2999999999999999e-07 2024-09-12T22:11:43.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964008+0000", 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073704119999999998 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964025+0000", 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7229999999999999e-05 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964033+0000", 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3920000000000003e-06 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964109+0000", 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6110000000000001e-05 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964232+0000", 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012249799999999999 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.964313+0000", 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1425000000000001e-05 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.969366+0000", 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050526989999999999 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982186+0000", 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012819818 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982244+0000", 2024-09-12T22:11:43.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8532000000000001e-05 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:30.982281+0000", 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6529999999999998e-05 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.510 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3747 3.e 3:715f5c78:::200.00000013:head [write 1826208~23101 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.7046292199999993, 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028762724999999999, 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:43.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661587+0000", 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:43.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661588+0000", 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0070000000000001e-06 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661606+0000", 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7838000000000001e-05 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661618+0000", 2024-09-12T22:11:43.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2283000000000001e-05 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661623+0000", 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3970000000000002e-06 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661677+0000", 2024-09-12T22:11:43.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3909000000000002e-05 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.661722+0000", 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4464e-05 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:43.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.662559+0000", 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083668200000000005 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690278+0000", 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027719338 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:33.690350+0000", 2024-09-12T22:11:43.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1806999999999999e-05 2024-09-12T22:11:43.517 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.517 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.520 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.520 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:43.520 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:43.521 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T22:11:43.523 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:11:43.523 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:11:43.524 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:43.525 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:43.521+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:43.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T22:11:43.601 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:11:43.623 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:43.622+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:43.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:43.727 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:43.726+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:43.787 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:43.787 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:43.787 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:43.787 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:43.787 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:43.796 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:43.837 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:43.836+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:43.885 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T22:11:43.898 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-09-12T22:11:43.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:11:43.898 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T22:11:43.924 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:11:43.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[33048]: fuse finished with error 0 and tester_r 0 2024-09-12T22:11:43.926 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:43.925+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:43.947 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:43.947 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:43.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:43.947 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:43.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.947 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:43.947 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.225807487000001, 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:43.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.225206553, 2024-09-12T22:11:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:43.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5093 4.2c e49/17 4:37d010ff:::100000017c3.00000000:head v 49'89, mlcod=49'87)", 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.213645428, 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029617228999999998, 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731429+0000", 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731430+0000", 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.573e-06 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.731441+0000", 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:11:43.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759025+0000", 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027583963999999999 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759034+0000", 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3009999999999995e-06 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759077+0000", 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3312999999999997e-05 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759096+0000", 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8071e-05 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761015+0000", 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019194380000000001 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761046+0000", 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1028999999999997e-05 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 3801467~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.013801939, 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024955926999999999, 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931272+0000", 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931273+0000", 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0699999999999998e-07 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931276+0000", 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.847e-06 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931286+0000", 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0151e-05 2024-09-12T22:11:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931290+0000", 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9029999999999997e-06 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953686+0000", 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022396475999999998 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953734+0000", 2024-09-12T22:11:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8427999999999998e-05 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.953802+0000", 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7889e-05 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955278+0000", 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001475547 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956143+0000", 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086506099999999998 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956192+0000", 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8699999999999998e-05 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956228+0000", 2024-09-12T22:11:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6517999999999998e-05 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 3802874~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.013780090000001, 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026378899000000001, 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931294+0000", 2024-09-12T22:11:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931299+0000", 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3139999999999997e-06 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931303+0000", 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4839999999999998e-06 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931306+0000", 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6290000000000002e-06 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954178+0000", 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022871783 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954257+0000", 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9837000000000001e-05 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954367+0000", 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109332 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955283+0000", 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091584299999999995 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957587+0000", 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002304062 2024-09-12T22:11:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957636+0000", 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957673+0000", 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6550000000000001e-05 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 3804275~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.013765299999999, 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026453556999999999, 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931309+0000", 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.36e-07 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931310+0000", 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3319999999999999e-06 2024-09-12T22:11:43.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931314+0000", 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0510000000000001e-06 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931316+0000", 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.526e-06 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954641+0000", 2024-09-12T22:11:43.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023324866 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954715+0000", 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4398000000000002e-05 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.954833+0000", 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011747399999999999 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.956656+0000", 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018235320000000001 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957711+0000", 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010549730000000001 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957740+0000", 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8476e-05 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957762+0000", 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 3805677~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.013755431, 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028237469000000001, 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.979 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931319+0000", 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1e-07 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931323+0000", 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8060000000000001e-06 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931327+0000", 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-09-12T22:11:43.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931330+0000", 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6620000000000001e-06 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955320+0000", 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023989808000000001 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955399+0000", 2024-09-12T22:11:43.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8988999999999999e-05 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955509+0000", 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010986500000000001 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957804+0000", 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022953420000000001 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:43.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959507+0000", 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001703057 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959534+0000", 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.671e-05 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.959556+0000", 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2609999999999999e-05 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 3807077~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.013741345, 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031243184, 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:43.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931333+0000", 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.23e-07 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931335+0000", 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4219999999999999e-06 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931338+0000", 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8079999999999998e-06 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.931341+0000", 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1480000000000002e-06 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955793+0000", 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024451581 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955839+0000", 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5575000000000003e-05 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.955910+0000", 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1637999999999994e-05 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.957836+0000", 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019260600000000001 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962510+0000", 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004673801 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962537+0000", 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.652e-05 2024-09-12T22:11:43.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:17.962576+0000", 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9407999999999999e-05 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:10842 4.17 4:e9364d23:::100000030ac.00000000:head [write 0~4194304 [2@170952]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.127165375000001, 2024-09-12T22:11:43.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028583956000000001, 2024-09-12T22:11:43.991 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.991 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.991 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.991 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:43.991 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:43.991 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 10842 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817909+0000", 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.817910+0000", 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.288e-06 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825597+0000", 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076864510000000004 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825613+0000", 2024-09-12T22:11:43.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6005e-05 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825620+0000", 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9979999999999997e-06 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825676+0000", 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6888999999999997e-05 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:43.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825759+0000", 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2755000000000003e-05 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.825902+0000", 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142435 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.835465+0000", 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095636520000000006 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846390+0000", 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01092457 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846451+0000", 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1500000000000004e-05 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:25.846493+0000", 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1412999999999998e-05 2024-09-12T22:11:43.996 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11025 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [2@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.826493924000001, 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02465703, 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:43.997 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11025 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118580+0000", 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.118581+0000", 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124207+0000", 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056258269999999999 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124222+0000", 2024-09-12T22:11:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5160999999999999e-05 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124229+0000", 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7599999999999997e-06 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124297+0000", 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8268000000000004e-05 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124389+0000", 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1459000000000006e-05 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.124520+0000", 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013186400000000001 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.132237+0000", 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077164950000000003 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143126+0000", 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0108889 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143188+0000", 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2333000000000001e-05 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.143237+0000", 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9194999999999999e-05 2024-09-12T22:11:44.002 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11241 4.11 4:889a8549:::10000003149.00000000:head [write 0~4194304 [2@3818163]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.496966319999999, 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028484895, 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.003 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11241 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448108+0000", 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.448109+0000", 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8599999999999996e-07 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456934+0000", 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088254149999999996 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456949+0000", 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4477999999999999e-05 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.456957+0000", 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2509999999999994e-06 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457021+0000", 2024-09-12T22:11:44.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3534000000000005e-05 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457114+0000", 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3882999999999995e-05 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.457260+0000", 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014556700000000001 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.462645+0000", 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053850119999999998 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476484+0000", 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013839139 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476542+0000", 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7547999999999999e-05 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.476593+0000", 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1082000000000003e-05 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:11580 4.11 4:8929e5dc:::100000032b6.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.02600953, 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024759115000000002, 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 11580 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.919065+0000", 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000001e-07 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926668+0000", 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0076022920000000001 2024-09-12T22:11:44.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926680+0000", 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2539e-05 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926688+0000", 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1589999999999993e-06 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926784+0000", 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5742000000000006e-05 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.926909+0000", 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012478700000000001 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.927061+0000", 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151848 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.930956+0000", 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038956289999999998 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943727+0000", 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01277095 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943791+0000", 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3676000000000005e-05 2024-09-12T22:11:44.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:26.943824+0000", 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2722000000000003e-05 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13880 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 [4@3933230]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.60648323, 2024-09-12T22:11:44.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029949267000000002, 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13880 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:44.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338591+0000", 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.338592+0000", 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3300000000000002e-07 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344944+0000", 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063524499999999999 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344958+0000", 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4328000000000001e-05 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.344966+0000", 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5100000000000001e-06 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345057+0000", 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1118000000000004e-05 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345133+0000", 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5872999999999997e-05 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.345297+0000", 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016373900000000001 2024-09-12T22:11:44.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.353149+0000", 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078525910000000008 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368371+0000", 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015221487000000001 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368485+0000", 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113805 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.368540+0000", 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5733000000000003e-05 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13951 4.0 4:035713a6:::1000000363a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.531683659, 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024789072999999998, 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.025 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13951 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:44.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.413391+0000", 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418209+0000", 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048180990000000002 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418219+0000", 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0073e-05 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418224+0000", 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9250000000000003e-06 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418285+0000", 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1116000000000002e-05 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418414+0000", 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128567 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.418553+0000", 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013895100000000001 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.426628+0000", 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080750409999999998 2024-09-12T22:11:44.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438092+0000", 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011464326 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438142+0000", 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9733e-05 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.438180+0000", 2024-09-12T22:11:44.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7696e-05 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:13972 4.29 4:94839381:::10000003376.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.497618161, 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02941301, 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.031 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 13972 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447456+0000", 2024-09-12T22:11:44.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.447457+0000", 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-06 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453972+0000", 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065153160000000002 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453982+0000", 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5270000000000004e-06 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.453988+0000", 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1639999999999998e-06 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454100+0000", 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111542 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454207+0000", 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107268 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.454294+0000", 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7213999999999995e-05 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.459004+0000", 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047098299999999999 2024-09-12T22:11:44.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476777+0000", 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017773105000000001 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476829+0000", 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1632000000000003e-05 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.476869+0000", 2024-09-12T22:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0389000000000002e-05 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14105 4.1e 4:7b3e3ee0:::100000036a3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.344541059999999, 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024557447999999999, 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.037 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14105 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600533+0000", 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.600539+0000", 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.066e-06 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607878+0000", 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073384380000000001 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607889+0000", 2024-09-12T22:11:44.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1351e-05 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607895+0000", 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5539999999999997e-06 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607938+0000", 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3618000000000001e-05 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.607985+0000", 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6686e-05 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.608054+0000", 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8769000000000005e-05 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.613206+0000", 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051520639999999996 2024-09-12T22:11:44.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625013+0000", 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011807748999999999 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625058+0000", 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4161e-05 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.625091+0000", 2024-09-12T22:11:44.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2991999999999999e-05 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14163 4.b 4:d003a5f5:::100000037ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.265839868, 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025500183999999999, 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.043 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14163 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679234+0000", 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.679235+0000", 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8999999999999995e-07 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688606+0000", 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093705799999999999 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688619+0000", 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3557000000000001e-05 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688627+0000", 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5889999999999997e-06 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688692+0000", 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4689000000000004e-05 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688821+0000", 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012978999999999999 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.688953+0000", 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131428 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.693862+0000", 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049090139999999997 2024-09-12T22:11:44.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704645+0000", 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010783513999999999 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704689+0000", 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3407e-05 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.704735+0000", 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5726000000000002e-05 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14224 4.b 4:d18ebcc4:::100000033ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.206398397999999, 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028328506, 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.049 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14224 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:44.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.738676+0000", 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1100000000000001e-07 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745412+0000", 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067359029999999997 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745430+0000", 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7909000000000001e-05 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745440+0000", 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9639999999999998e-06 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745489+0000", 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8594999999999998e-05 2024-09-12T22:11:44.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745551+0000", 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2578999999999998e-05 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745645+0000", 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3461000000000005e-05 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755780+0000", 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010135633999999999 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766912+0000", 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011132079 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.766968+0000", 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5835999999999999e-05 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.767004+0000", 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6134999999999999e-05 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14227 4.b 4:d1ba6b2c:::1000000348d.00000000:head [write 0~3538944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.199564448, 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027107289999999999, 2024-09-12T22:11:44.055 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14227 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.745510+0000", 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751396+0000", 2024-09-12T22:11:44.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058854429999999998 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751419+0000", 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2847e-05 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751426+0000", 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4390000000000003e-06 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751491+0000", 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4604999999999996e-05 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751686+0000", 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000195088 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.751828+0000", 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014222400000000001 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.755837+0000", 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040090810000000003 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772520+0000", 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016682704999999999 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772573+0000", 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3235000000000001e-05 2024-09-12T22:11:44.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:29.772617+0000", 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4060999999999997e-05 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:14704 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304 [2@1278380]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.721688800000001, 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026165253999999999, 2024-09-12T22:11:44.061 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14704 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223385+0000", 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.223386+0000", 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.54e-07 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227867+0000", 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004480393 2024-09-12T22:11:44.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227884+0000", 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7526000000000001e-05 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227893+0000", 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8750000000000006e-06 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:44.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.227975+0000", 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2102999999999996e-05 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228034+0000", 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9243000000000002e-05 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.228138+0000", 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103705 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.236978+0000", 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088398509999999993 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249495+0000", 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012517128000000001 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249527+0000", 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1890999999999997e-05 2024-09-12T22:11:44.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:30.249551+0000", 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3785e-05 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:44.067 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:44.069 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:44.070 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:44.068+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:44.170 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:44.168+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:44.210 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:44.210 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:44.210 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:44.211 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:44.219 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:44.270 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:44.269+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:44.323 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:44.323 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:44.323 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:44.323 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:44.323 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:44.332 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:44.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:44.372 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:44.371+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:44.472 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:44.471+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:44.476 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 27.756150296000001, 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:44.477 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:44.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:44.482 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.514495710999999, 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:44.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:44.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:44.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.488 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.497971947, 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:44.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:44.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.494 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18622 4.38 4:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.494 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:44.496 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54136467099999996, 2024-09-12T22:11:44.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.03891592, 2024-09-12T22:11:44.496 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.496 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933737+0000", 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9939999999999999e-06 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933743+0000", 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9449999999999998e-06 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933748+0000", 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8250000000000004e-06 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933795+0000", 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6817999999999998e-05 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933910+0000", 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011495899999999999 2024-09-12T22:11:44.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972651+0000", 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038740987999999997 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18624 4.1a 4:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54134139400000003, 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038978367, 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2e-07 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933761+0000", 2024-09-12T22:11:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3290000000000001e-06 2024-09-12T22:11:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933767+0000", 2024-09-12T22:11:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1109999999999996e-06 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933772+0000", 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935594+0000", 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001821958 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936590+0000", 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0009959770000000001 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972736+0000", 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036146409999999997 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18626 4.20 4:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54132111500000002, 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038899771999999999, 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:44.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933779+0000", 2024-09-12T22:11:44.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:11:44.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933781+0000", 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5019999999999999e-06 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933796+0000", 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4586999999999999e-05 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933801+0000", 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5820000000000001e-06 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933889+0000", 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7452000000000002e-05 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:44.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110463 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972678+0000", 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038678803999999997 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18631 4.3a 4:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:44.511 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54123810500000002, 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038845520000000001, 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933862+0000", 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0899999999999997e-07 2024-09-12T22:11:44.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933864+0000", 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.858e-06 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933869+0000", 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2730000000000002e-06 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933876+0000", 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8279999999999997e-06 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936845+0000", 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002969027 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936937+0000", 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2283999999999999e-05 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972707+0000", 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035769941 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18641 4.18 4:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54111210300000001, 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038895449999999998, 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.516 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.517 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.517 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:44.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933988+0000", 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9200000000000002e-07 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933990+0000", 2024-09-12T22:11:44.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2330000000000001e-06 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933995+0000", 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1379999999999998e-06 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9020000000000001e-06 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934492+0000", 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00049258699999999995 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934610+0000", 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118046 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038273252000000001 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.520 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18642 4.3c 4:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54109562099999997, 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038875940999999997, 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.521 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:44.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.15e-07 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934006+0000", 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7740000000000001e-06 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934011+0000", 2024-09-12T22:11:44.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934015+0000", 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0690000000000003e-06 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934180+0000", 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000165174 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8505999999999995e-05 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972880+0000", 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038601128999999998 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18653 4.38 4:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.525 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54096436299999995, 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038668936000000001, 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934136+0000", 2024-09-12T22:11:44.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.51e-07 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934138+0000", 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0190000000000001e-06 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934143+0000", 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7379999999999999e-06 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934148+0000", 2024-09-12T22:11:44.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7849999999999999e-06 2024-09-12T22:11:44.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934927+0000", 2024-09-12T22:11:44.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077865900000000001 2024-09-12T22:11:44.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935079+0000", 2024-09-12T22:11:44.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015255600000000001 2024-09-12T22:11:44.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972804+0000", 2024-09-12T22:11:44.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037724727999999999 2024-09-12T22:11:44.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.532 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18655 4.6 4:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54092639099999995, 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038394178000000001, 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934174+0000", 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1399999999999997e-07 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934176+0000", 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.962e-06 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934181+0000", 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6999999999999996e-06 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934186+0000", 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5739999999999997e-06 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5296000000000001e-05 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010753500000000001 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972567+0000", 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038228597000000003 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.537 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18659 4.3c 4:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54088114300000001, 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038770623999999997, 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934219+0000", 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1600000000000002e-07 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934221+0000", 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0499999999999999e-06 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934226+0000", 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3589999999999999e-06 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935492+0000", 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012608540000000001 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936029+0000", 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053760600000000004 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036959576000000001 2024-09-12T22:11:44.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18661 4.6 4:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54083935900000002, 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038480874999999998, 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934261+0000", 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9500000000000003e-07 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934263+0000", 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9759999999999998e-06 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934268+0000", 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934273+0000", 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2710000000000003e-06 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934845+0000", 2024-09-12T22:11:44.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00057226900000000003 2024-09-12T22:11:44.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934952+0000", 2024-09-12T22:11:44.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107215 2024-09-12T22:11:44.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972741+0000", 2024-09-12T22:11:44.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037788927999999999 2024-09-12T22:11:44.548 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.548 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.548 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.548 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18662 4.2c 4:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.540820733, 2024-09-12T22:11:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038710241999999999, 2024-09-12T22:11:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:44.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:44.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:44.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:11:44.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934281+0000", 2024-09-12T22:11:44.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8959999999999999e-06 2024-09-12T22:11:44.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934288+0000", 2024-09-12T22:11:44.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:11:44.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934293+0000", 2024-09-12T22:11:44.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:11:44.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935485+0000", 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0011921 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935597+0000", 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112075 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:44.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037391498000000002 2024-09-12T22:11:44.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.556 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18665 4.2b 4:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54077943799999995, 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038440224000000002, 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.557 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3500000000000002e-07 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934322+0000", 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.057e-06 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934328+0000", 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.852e-06 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934333+0000", 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0869999999999997e-06 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936530+0000", 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021970029999999999 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936631+0000", 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100939 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972760+0000", 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036128950999999999 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18666 4.6 4:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:44.561 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54076076500000003, 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038544538000000003, 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2099999999999998e-07 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934351+0000", 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1627999999999999e-05 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934357+0000", 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6259999999999997e-06 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934363+0000", 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7019999999999998e-06 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935430+0000", 2024-09-12T22:11:44.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001067089 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935570+0000", 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000139825 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037313346999999997 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.565 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18668 4.1a 4:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54072973099999999, 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038934431999999998, 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5499999999999998e-07 2024-09-12T22:11:44.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934385+0000", 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4929000000000001e-05 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934393+0000", 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0690000000000002e-06 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934400+0000", 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7259999999999996e-06 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.939889+0000", 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054895430000000004 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.940378+0000", 2024-09-12T22:11:44.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048856500000000005 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973304+0000", 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.032926144999999997 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18690 4.18 4:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:44.570 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54062620299999997, 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038539486999999997, 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:44.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934474+0000", 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1100000000000002e-07 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934475+0000", 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6050000000000001e-06 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934480+0000", 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0669999999999999e-06 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934484+0000", 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1300000000000003e-06 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937283+0000", 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027990160000000001 2024-09-12T22:11:44.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937384+0000", 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100727 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973013+0000", 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035628631000000001 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18692 4.30 4:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54059463799999996, 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038490674000000002, 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.39e-07 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934507+0000", 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.376e-06 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934511+0000", 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8539999999999996e-06 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934515+0000", 2024-09-12T22:11:44.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.811e-06 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937322+0000", 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028068609999999999 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937420+0000", 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7423999999999994e-05 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972995+0000", 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035575909000000003 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18695 4.2c 4:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54057988300000004, 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038576371999999998, 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:44.579 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934521+0000", 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4810000000000001e-06 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934526+0000", 2024-09-12T22:11:44.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1220000000000003e-06 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934531+0000", 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1110000000000001e-06 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936813+0000", 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002282615 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:44.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936911+0000", 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8064000000000002e-05 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973096+0000", 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036184710000000002 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:44.583 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:44.584 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:44.585 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:44.586 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:44.586 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:44.584+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:44.586 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:44.587 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:44.587 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:44.588 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:44.588 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:44.685 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:44.684+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:44.692 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:44.692 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:44.701 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:44.786 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:44.785+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:44.802 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:44.802 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:44.810 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:44.887 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:44.886+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:44.914 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:44.914 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:44.923 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:44.987 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:44.986+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:45.026 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.027 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:45.088 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:45.087+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:45.138 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.139 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.147 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:45.191 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:45.190+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:45.251 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.251 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.260 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:45.301 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:45.300+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:45.363 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.364 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:45.416 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:45.415+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:45.474 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.474 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:45.524 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:45.523+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:45.593 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:45.592+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:45.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:11:45.626 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.626 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:45.694 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:45.693+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:45.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-09-12T22:11:45.740 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.740 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.749 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:45.794 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:45.794+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:45.893 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:45.893 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:45.896 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:45.895+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:45.902 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:45.997 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:45.996+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:46.004 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:46.004 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:46.014 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:46.097 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:46.097+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:46.117 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:46.117 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:46.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:46.198 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:46.197+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:46.228 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:46.228 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:46.237 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:46.321 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:46.320+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:46.379 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:46.379 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:46.388 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:46.432 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:46.431+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:46.491 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:46.491 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:46.500 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:46.499+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:46.501 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:46.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:11:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:11:46.600 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:46.599+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:46.645 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:46.645 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:46.654 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:46.700 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:46.700+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:46.724 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:46.725 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:46.743 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:46.743 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:46.743 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:46.746 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:46.746 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:46.799 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.079205809000001, 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.800 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:46.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:46.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.806 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.837551223999998, 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:46.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:46.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:46.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:46.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.82102746, 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:46.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:46.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18622 4.38 4:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8644201840000001, 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.03891592, 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933737+0000", 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9939999999999999e-06 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933743+0000", 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9449999999999998e-06 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933748+0000", 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8250000000000004e-06 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933795+0000", 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6817999999999998e-05 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933910+0000", 2024-09-12T22:11:46.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011495899999999999 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972651+0000", 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038740987999999997 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18624 4.1a 4:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8643969070000002, 2024-09-12T22:11:46.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038978367, 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2e-07 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933761+0000", 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3290000000000001e-06 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933767+0000", 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1109999999999996e-06 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933772+0000", 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935594+0000", 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001821958 2024-09-12T22:11:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936590+0000", 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0009959770000000001 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972736+0000", 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036146409999999997 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18626 4.20 4:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.864376628, 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038899771999999999, 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:46.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933779+0000", 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933781+0000", 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5019999999999999e-06 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933796+0000", 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4586999999999999e-05 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933801+0000", 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5820000000000001e-06 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933889+0000", 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7452000000000002e-05 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110463 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972678+0000", 2024-09-12T22:11:46.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038678803999999997 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18631 4.3a 4:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.864293618, 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038845520000000001, 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:46.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933862+0000", 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0899999999999997e-07 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933864+0000", 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.858e-06 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933869+0000", 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2730000000000002e-06 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933876+0000", 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8279999999999997e-06 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936845+0000", 2024-09-12T22:11:46.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002969027 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936937+0000", 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2283999999999999e-05 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972707+0000", 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035769941 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18641 4.18 4:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.864167616, 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038895449999999998, 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933988+0000", 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9200000000000002e-07 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933990+0000", 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2330000000000001e-06 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933995+0000", 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1379999999999998e-06 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9020000000000001e-06 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934492+0000", 2024-09-12T22:11:46.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00049258699999999995 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934610+0000", 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118046 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038273252000000001 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18642 4.3c 4:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8641511340000001, 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038875940999999997, 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.15e-07 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934006+0000", 2024-09-12T22:11:46.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7740000000000001e-06 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934011+0000", 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934015+0000", 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0690000000000003e-06 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934180+0000", 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000165174 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8505999999999995e-05 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972880+0000", 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038601128999999998 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18653 4.38 4:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.864019876, 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038668936000000001, 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934136+0000", 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.51e-07 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934138+0000", 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0190000000000001e-06 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934143+0000", 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7379999999999999e-06 2024-09-12T22:11:46.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934148+0000", 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7849999999999999e-06 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934927+0000", 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077865900000000001 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935079+0000", 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015255600000000001 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972804+0000", 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037724727999999999 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18655 4.6 4:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.850 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8639819040000001, 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038394178000000001, 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:46.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934174+0000", 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1399999999999997e-07 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934176+0000", 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.962e-06 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934181+0000", 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6999999999999996e-06 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934186+0000", 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5739999999999997e-06 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5296000000000001e-05 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010753500000000001 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972567+0000", 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038228597000000003 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18659 4.3c 4:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.854 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8639366559999999, 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038770623999999997, 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934219+0000", 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1600000000000002e-07 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934221+0000", 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0499999999999999e-06 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934226+0000", 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3589999999999999e-06 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935492+0000", 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012608540000000001 2024-09-12T22:11:46.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936029+0000", 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053760600000000004 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036959576000000001 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18661 4.6 4:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8638948719999999, 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038480874999999998, 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:46.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934261+0000", 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9500000000000003e-07 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934263+0000", 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9759999999999998e-06 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934268+0000", 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934273+0000", 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2710000000000003e-06 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934845+0000", 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00057226900000000003 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934952+0000", 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107215 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972741+0000", 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037788927999999999 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.862 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18662 4.2c 4:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8638762460000002, 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038710241999999999, 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:11:46.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934281+0000", 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8959999999999999e-06 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934288+0000", 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934293+0000", 2024-09-12T22:11:46.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935485+0000", 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0011921 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935597+0000", 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112075 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037391498000000002 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18665 4.2b 4:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8638349509999999, 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038440224000000002, 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3500000000000002e-07 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934322+0000", 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.057e-06 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934328+0000", 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.852e-06 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934333+0000", 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0869999999999997e-06 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936530+0000", 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021970029999999999 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936631+0000", 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100939 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972760+0000", 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036128950999999999 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18666 4.6 4:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8638162779999998, 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038544538000000003, 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.871 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2099999999999998e-07 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934351+0000", 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1627999999999999e-05 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934357+0000", 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6259999999999997e-06 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934363+0000", 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7019999999999998e-06 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935430+0000", 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001067089 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935570+0000", 2024-09-12T22:11:46.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000139825 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037313346999999997 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18668 4.1a 4:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:46.875 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8637852439999998, 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038934431999999998, 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5499999999999998e-07 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934385+0000", 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4929000000000001e-05 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934393+0000", 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0690000000000002e-06 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934400+0000", 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7259999999999996e-06 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.939889+0000", 2024-09-12T22:11:46.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054895430000000004 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.940378+0000", 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048856500000000005 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973304+0000", 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.032926144999999997 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.879 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18690 4.18 4:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8636817159999999, 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038539486999999997, 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934474+0000", 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1100000000000002e-07 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934475+0000", 2024-09-12T22:11:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6050000000000001e-06 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934480+0000", 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0669999999999999e-06 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934484+0000", 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1300000000000003e-06 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937283+0000", 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027990160000000001 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937384+0000", 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100727 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973013+0000", 2024-09-12T22:11:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035628631000000001 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18692 4.30 4:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8636501509999999, 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038490674000000002, 2024-09-12T22:11:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.39e-07 2024-09-12T22:11:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934507+0000", 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.376e-06 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934511+0000", 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8539999999999996e-06 2024-09-12T22:11:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934515+0000", 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.811e-06 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937322+0000", 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028068609999999999 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937420+0000", 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7423999999999994e-05 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972995+0000", 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035575909000000003 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18695 4.2c 4:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 2.8636353960000003, 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038576371999999998, 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934521+0000", 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4810000000000001e-06 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934526+0000", 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1220000000000003e-06 2024-09-12T22:11:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934531+0000", 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1110000000000001e-06 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936813+0000", 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002282615 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936911+0000", 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8064000000000002e-05 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973096+0000", 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036184710000000002 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:46.898 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:46.900 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:46.899+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:46.900 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:47.000 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:46.999+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.004 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:47.004 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:47.004 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:47.004 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:47.012 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:47.100 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:47.100+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:47.157 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:47.157 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:47.165 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:47.209 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:47.208+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.268 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.547734340000002, 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.547133406, 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18680 4.16 4:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.934721+0000", 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3322796390000002, 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043391522000000002, 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934721+0000", 2024-09-12T22:11:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934721+0000", 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934722+0000", 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2599999999999998e-07 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934724+0000", 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2479999999999999e-06 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934730+0000", 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1009999999999997e-06 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934735+0000", 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6709999999999998e-06 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939017+0000", 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042821359999999998 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939117+0000", 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9714000000000001e-05 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978113+0000", 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038996226000000002 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18683 4.16 4:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3321949979999999, 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043437198000000003, 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934808+0000", 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0090000000000002e-06 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934815+0000", 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999999e-06 2024-09-12T22:11:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934821+0000", 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7470000000000002e-06 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939415+0000", 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045943440000000002 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939508+0000", 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3026e-05 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978243+0000", 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038735029999999997 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18699 4.26 4:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.936930+0000", 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3300709500000001, 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041317511000000001, 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936930+0000", 2024-09-12T22:11:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936930+0000", 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936931+0000", 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936933+0000", 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.503e-06 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936940+0000", 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0539999999999997e-06 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936947+0000", 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2940000000000002e-06 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.954061+0000", 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017114379999999998 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.955865+0000", 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00180364 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978248+0000", 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022383048999999999 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18710 4.11 4:88725faf:::1000000006e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.329908128, 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041071532000000001, 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6899999999999998e-07 2024-09-12T22:11:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937095+0000", 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.891e-06 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937101+0000", 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1229999999999997e-06 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937106+0000", 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7530000000000001e-06 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939632+0000", 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002526304 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939745+0000", 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112675 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978164+0000", 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038419416999999997 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18725 4.1e 4:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3297810239999999, 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041317114000000002, 2024-09-12T22:11:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8099999999999998e-07 2024-09-12T22:11:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937222+0000", 2024-09-12T22:11:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.821e-06 2024-09-12T22:11:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937228+0000", 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.229e-06 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937234+0000", 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2560000000000002e-06 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.953912+0000", 2024-09-12T22:11:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016678361999999999 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.954014+0000", 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101548 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978537+0000", 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024523517000000002 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18731 4.26 4:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3297610959999999, 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041212177000000003, 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6399999999999998e-07 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937242+0000", 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7999999999999999e-06 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937248+0000", 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3090000000000001e-06 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937254+0000", 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.13e-06 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957645+0000", 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020391922999999999 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957748+0000", 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102095 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978452+0000", 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020704555999999999 2024-09-12T22:11:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18741 4.26 4:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937347+0000", 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.329653945, 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041237969999999999, 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937347+0000", 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937347+0000", 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937348+0000", 2024-09-12T22:11:47.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9800000000000004e-07 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937350+0000", 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.041e-06 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937356+0000", 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0299999999999999e-06 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937361+0000", 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9400000000000001e-06 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959165+0000", 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021804227999999998 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959270+0000", 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105577 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978585+0000", 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019314655999999999 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18754 4.0 4:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.328483002, 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.040137748000000001, 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938520+0000", 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-06 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938527+0000", 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.708e-06 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938532+0000", 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3340000000000001e-06 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939640+0000", 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001107479 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.953423+0000", 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013783200000000001 2024-09-12T22:11:47.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978656+0000", 2024-09-12T22:11:47.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025232857000000001 2024-09-12T22:11:47.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.319 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.320 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18772 4.26 4:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.320 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.938815+0000", 2024-09-12T22:11:47.321 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3281857459999999, 2024-09-12T22:11:47.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039886373000000003, 2024-09-12T22:11:47.321 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.321 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.321 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.321 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938815+0000", 2024-09-12T22:11:47.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938815+0000", 2024-09-12T22:11:47.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938816+0000", 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6100000000000002e-07 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938817+0000", 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7999999999999999e-06 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938823+0000", 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938828+0000", 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.962215+0000", 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023386405999999998 2024-09-12T22:11:47.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.962398+0000", 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183287 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978702+0000", 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016303575000000001 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18781 4.29 4:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.328111357, 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039485732000000003, 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-09-12T22:11:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938892+0000", 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2460000000000002e-06 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938899+0000", 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:11:47.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938904+0000", 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7949999999999998e-06 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957317+0000", 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018413426 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957415+0000", 2024-09-12T22:11:47.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7413999999999999e-05 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978375+0000", 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020960823 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18797 4.16 4:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:47.331 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.327747397, 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039446611999999999, 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5400000000000001e-07 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939257+0000", 2024-09-12T22:11:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7089999999999998e-06 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939265+0000", 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0930000000000003e-06 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939271+0000", 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9240000000000004e-06 2024-09-12T22:11:47.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963243+0000", 2024-09-12T22:11:47.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023972448 2024-09-12T22:11:47.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963345+0000", 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010110799999999999 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978700+0000", 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015355776 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18798 4.17 4:eb7dd551:::100000000c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3277215070000001, 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038902288, 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6100000000000002e-07 2024-09-12T22:11:47.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939283+0000", 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8509999999999999e-06 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939289+0000", 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8220000000000003e-06 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939293+0000", 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959034+0000", 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019740603999999998 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959130+0000", 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6500000000000001e-05 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978182+0000", 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019051558999999999 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18801 4.11 4:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3275283889999998, 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038902484000000001, 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.342 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939483+0000", 2024-09-12T22:11:47.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8039999999999996e-06 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939490+0000", 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3780000000000003e-06 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939497+0000", 2024-09-12T22:11:47.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.387e-06 2024-09-12T22:11:47.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.958256+0000", 2024-09-12T22:11:47.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018759616 2024-09-12T22:11:47.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.958361+0000", 2024-09-12T22:11:47.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010419799999999999 2024-09-12T22:11:47.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978375+0000", 2024-09-12T22:11:47.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020014581 2024-09-12T22:11:47.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.348 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18806 4.11 4:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:47.349 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.327454999, 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038935406999999998, 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5900000000000003e-07 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939548+0000", 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.609e-06 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939555+0000", 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8050000000000001e-06 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939560+0000", 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0189999999999997e-06 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959997+0000", 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020436776 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963527+0000", 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035298780000000002 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978481+0000", 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014954960999999999 2024-09-12T22:11:47.354 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18811 4.17 4:e88d3223:::100000000d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939584+0000", 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.327416597, 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038712387000000001, 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.355 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939584+0000", 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939584+0000", 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939585+0000", 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.96e-07 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939587+0000", 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.742e-06 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939592+0000", 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4389999999999999e-06 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939597+0000", 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6500000000000004e-06 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963110+0000", 2024-09-12T22:11:47.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023513596000000001 2024-09-12T22:11:47.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963217+0000", 2024-09-12T22:11:47.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010666399999999999 2024-09-12T22:11:47.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978297+0000", 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0150799 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18813 4.29 4:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.360 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3271182509999999, 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038596819999999997, 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:47.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:47.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:11:47.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939886+0000", 2024-09-12T22:11:47.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1600000000000001e-06 2024-09-12T22:11:47.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939892+0000", 2024-09-12T22:11:47.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6669999999999999e-06 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939897+0000", 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9880000000000004e-06 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959211+0000", 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019313740999999999 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959311+0000", 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100498 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978480+0000", 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019168215999999998 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.366 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18816 4.1e 4:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939919+0000", 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3270816409999999, 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038889117000000001, 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939919+0000", 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939919+0000", 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939920+0000", 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5999999999999999e-07 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939921+0000", 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.53e-06 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939927+0000", 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.755e-06 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939931+0000", 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2719999999999999e-06 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965055+0000", 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025123458000000001 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965154+0000", 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9151e-05 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978809+0000", 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013654591000000001 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.371 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18821 4.26 4:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.940434+0000", 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3265672120000001, 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038398935000000002, 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940434+0000", 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940434+0000", 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940435+0000", 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940438+0000", 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-06 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940445+0000", 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5290000000000003e-06 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940451+0000", 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4979999999999997e-06 2024-09-12T22:11:47.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965529+0000", 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025077972 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965629+0000", 2024-09-12T22:11:47.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100602 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978833+0000", 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013203581000000001 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:47.376 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:47.378 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:47.378 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:47.377+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.478 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:47.477+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.483 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:47.483 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:47.483 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:47.483 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:47.492 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:47.579 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:47.578+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.595 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:47.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:47.595 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:47.595 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:47.595 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:47.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:47.681 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:47.680+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.987870139999998, 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 20.746215554999999, 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 20.729691791, 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18622 4.38 4:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7730845149999999, 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.03891592, 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:11:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933737+0000", 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9939999999999999e-06 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933743+0000", 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9449999999999998e-06 2024-09-12T22:11:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933748+0000", 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8250000000000004e-06 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933795+0000", 2024-09-12T22:11:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6817999999999998e-05 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933910+0000", 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011495899999999999 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972651+0000", 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038740987999999997 2024-09-12T22:11:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18624 4.1a 4:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7730612379999999, 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038978367, 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2e-07 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933761+0000", 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3290000000000001e-06 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933767+0000", 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1109999999999996e-06 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933772+0000", 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935594+0000", 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001821958 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936590+0000", 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0009959770000000001 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972736+0000", 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036146409999999997 2024-09-12T22:11:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18626 4.20 4:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7730409590000002, 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038899771999999999, 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933779+0000", 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933781+0000", 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5019999999999999e-06 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933796+0000", 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4586999999999999e-05 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933801+0000", 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5820000000000001e-06 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933889+0000", 2024-09-12T22:11:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7452000000000002e-05 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110463 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972678+0000", 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038678803999999997 2024-09-12T22:11:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18631 4.3a 4:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7729579490000003, 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038845520000000001, 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933862+0000", 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0899999999999997e-07 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933864+0000", 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.858e-06 2024-09-12T22:11:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933869+0000", 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2730000000000002e-06 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933876+0000", 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8279999999999997e-06 2024-09-12T22:11:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936845+0000", 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002969027 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936937+0000", 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2283999999999999e-05 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972707+0000", 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035769941 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18641 4.18 4:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7728319470000002, 2024-09-12T22:11:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038895449999999998, 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933988+0000", 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9200000000000002e-07 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933990+0000", 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2330000000000001e-06 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933995+0000", 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1379999999999998e-06 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9020000000000001e-06 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934492+0000", 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00049258699999999995 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934610+0000", 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118046 2024-09-12T22:11:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038273252000000001 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18642 4.3c 4:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7728154649999999, 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038875940999999997, 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.15e-07 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934006+0000", 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7740000000000001e-06 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934011+0000", 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934015+0000", 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0690000000000003e-06 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934180+0000", 2024-09-12T22:11:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000165174 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8505999999999995e-05 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972880+0000", 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038601128999999998 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18653 4.38 4:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7726842070000002, 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038668936000000001, 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934136+0000", 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.51e-07 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934138+0000", 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0190000000000001e-06 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934143+0000", 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7379999999999999e-06 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934148+0000", 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7849999999999999e-06 2024-09-12T22:11:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934927+0000", 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077865900000000001 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935079+0000", 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015255600000000001 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972804+0000", 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037724727999999999 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18655 4.6 4:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7726462349999998, 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038394178000000001, 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934174+0000", 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1399999999999997e-07 2024-09-12T22:11:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934176+0000", 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.962e-06 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934181+0000", 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6999999999999996e-06 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934186+0000", 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5739999999999997e-06 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5296000000000001e-05 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010753500000000001 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972567+0000", 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038228597000000003 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18659 4.3c 4:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7726009870000001, 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038770623999999997, 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934219+0000", 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1600000000000002e-07 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934221+0000", 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0499999999999999e-06 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934226+0000", 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3589999999999999e-06 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935492+0000", 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012608540000000001 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936029+0000", 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053760600000000004 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036959576000000001 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18661 4.6 4:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7725592030000001, 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038480874999999998, 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934261+0000", 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9500000000000003e-07 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934263+0000", 2024-09-12T22:11:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9759999999999998e-06 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934268+0000", 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934273+0000", 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2710000000000003e-06 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934845+0000", 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00057226900000000003 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934952+0000", 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107215 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972741+0000", 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037788927999999999 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18662 4.2c 4:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.772540577, 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038710241999999999, 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934281+0000", 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8959999999999999e-06 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934288+0000", 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934293+0000", 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935485+0000", 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0011921 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935597+0000", 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112075 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037391498000000002 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18665 4.2b 4:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7724992820000001, 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038440224000000002, 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3500000000000002e-07 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934322+0000", 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.057e-06 2024-09-12T22:11:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934328+0000", 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.852e-06 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934333+0000", 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0869999999999997e-06 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936530+0000", 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021970029999999999 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936631+0000", 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100939 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972760+0000", 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036128950999999999 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18666 4.6 4:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:47.792 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.772480609, 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038544538000000003, 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2099999999999998e-07 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934351+0000", 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1627999999999999e-05 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934357+0000", 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6259999999999997e-06 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934363+0000", 2024-09-12T22:11:47.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7019999999999998e-06 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935430+0000", 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001067089 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935570+0000", 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000139825 2024-09-12T22:11:47.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037313346999999997 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18668 4.1a 4:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.797 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.772449575, 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038934431999999998, 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:47.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5499999999999998e-07 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934385+0000", 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4929000000000001e-05 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934393+0000", 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0690000000000002e-06 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934400+0000", 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7259999999999996e-06 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.939889+0000", 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054895430000000004 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.940378+0000", 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048856500000000005 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973304+0000", 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.032926144999999997 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18690 4.18 4:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7723460470000001, 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038539486999999997, 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934474+0000", 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1100000000000002e-07 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934475+0000", 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6050000000000001e-06 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934480+0000", 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0669999999999999e-06 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934484+0000", 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1300000000000003e-06 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937283+0000", 2024-09-12T22:11:47.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027990160000000001 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937384+0000", 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100727 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973013+0000", 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035628631000000001 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18692 4.30 4:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7723144820000001, 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038490674000000002, 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.808 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.39e-07 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934507+0000", 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.376e-06 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934511+0000", 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8539999999999996e-06 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934515+0000", 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.811e-06 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937322+0000", 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028068609999999999 2024-09-12T22:11:47.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937420+0000", 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7423999999999994e-05 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972995+0000", 2024-09-12T22:11:47.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035575909000000003 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18695 4.2c 4:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.772299727, 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038576371999999998, 2024-09-12T22:11:47.813 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:47.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934521+0000", 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4810000000000001e-06 2024-09-12T22:11:47.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934526+0000", 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1220000000000003e-06 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934531+0000", 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1110000000000001e-06 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936813+0000", 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002282615 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936911+0000", 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8064000000000002e-05 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:47.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973096+0000", 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036184710000000002 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:47.818 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:47.820 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:47.820 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:47.818+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.921 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:47.920+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:47.925 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:47.925 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:47.934 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:48.022 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:48.021+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:48.076 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:48.076 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:48.076 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-09-12T22:11:48.077 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-09-12T22:11:48.077 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:48.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:48.126 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:48.125+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:48.224 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:48.223+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4487.0:5080 4.39 e49/17 4:9cf6956e:::100000017b6.00000000:head v 49'97, mlcod=49'95)", 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.507490722, 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042899860999999997, 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719267+0000", 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1199999999999998e-07 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719298+0000", 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0704000000000003e-05 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719304+0000", 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.178e-06 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719308+0000", 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0709999999999996e-06 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719347+0000", 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9316000000000001e-05 2024-09-12T22:11:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719359+0000", 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1742999999999999e-05 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762133+0000", 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042773640000000002 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762167+0000", 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3797000000000002e-05 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4487.0:5081 4.28 4:15a34d97:::100000017b7.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.506889787999999, 2024-09-12T22:11:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042207935000000002, 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4487", 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5081 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719868+0000", 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.92e-07 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.719877+0000", 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.969e-06 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759046+0000", 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039168654999999997 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759058+0000", 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.186e-05 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759106+0000", 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8294999999999998e-05 2024-09-12T22:11:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.759236+0000", 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012951999999999999 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761887+0000", 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026509530000000002 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.761988+0000", 2024-09-12T22:11:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101659 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:16.762076+0000", 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7331999999999997e-05 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18680 4.16 4:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.934721+0000", 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2920360210000004, 2024-09-12T22:11:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043391522000000002, 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934721+0000", 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934721+0000", 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934722+0000", 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2599999999999998e-07 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934724+0000", 2024-09-12T22:11:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2479999999999999e-06 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934730+0000", 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1009999999999997e-06 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934735+0000", 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6709999999999998e-06 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939017+0000", 2024-09-12T22:11:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042821359999999998 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939117+0000", 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9714000000000001e-05 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978113+0000", 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038996226000000002 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18683 4.16 4:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2919513800000004, 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043437198000000003, 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934806+0000", 2024-09-12T22:11:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8000000000000001e-07 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934808+0000", 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0090000000000002e-06 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934815+0000", 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999999e-06 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.934821+0000", 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7470000000000002e-06 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939415+0000", 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045943440000000002 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939508+0000", 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3026e-05 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978243+0000", 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038735029999999997 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18699 4.26 4:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.936930+0000", 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2898273319999998, 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041317511000000001, 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936930+0000", 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936930+0000", 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936931+0000", 2024-09-12T22:11:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936933+0000", 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.503e-06 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936940+0000", 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0539999999999997e-06 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.936947+0000", 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2940000000000002e-06 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.954061+0000", 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017114379999999998 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.955865+0000", 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00180364 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978248+0000", 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022383048999999999 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18710 4.11 4:88725faf:::1000000006e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2896645099999997, 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041071532000000001, 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937093+0000", 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6899999999999998e-07 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937095+0000", 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.891e-06 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937101+0000", 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1229999999999997e-06 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937106+0000", 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7530000000000001e-06 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939632+0000", 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002526304 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939745+0000", 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112675 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978164+0000", 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038419416999999997 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18725 4.1e 4:7ab9e14a:::1000000007d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.289537406, 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041317114000000002, 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937220+0000", 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8099999999999998e-07 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937222+0000", 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.821e-06 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937228+0000", 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.229e-06 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937234+0000", 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2560000000000002e-06 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.953912+0000", 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016678361999999999 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.954014+0000", 2024-09-12T22:11:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101548 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978537+0000", 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024523517000000002 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18731 4.26 4:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2895174779999996, 2024-09-12T22:11:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041212177000000003, 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937240+0000", 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6399999999999998e-07 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937242+0000", 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7999999999999999e-06 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937248+0000", 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3090000000000001e-06 2024-09-12T22:11:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937254+0000", 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.13e-06 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957645+0000", 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020391922999999999 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957748+0000", 2024-09-12T22:11:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102095 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978452+0000", 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020704555999999999 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18741 4.26 4:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.937347+0000", 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2894103269999997, 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041237969999999999, 2024-09-12T22:11:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937347+0000", 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937347+0000", 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937348+0000", 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9800000000000004e-07 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937350+0000", 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.041e-06 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937356+0000", 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0299999999999999e-06 2024-09-12T22:11:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.937361+0000", 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9400000000000001e-06 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959165+0000", 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021804227999999998 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959270+0000", 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105577 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978585+0000", 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019314655999999999 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18754 4.0 4:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2882393839999997, 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.040137748000000001, 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938518+0000", 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9000000000000002e-07 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938520+0000", 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-06 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938527+0000", 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.708e-06 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938532+0000", 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3340000000000001e-06 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939640+0000", 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001107479 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.953423+0000", 2024-09-12T22:11:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013783200000000001 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978656+0000", 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025232857000000001 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18772 4.26 4:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.938815+0000", 2024-09-12T22:11:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2879421280000001, 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039886373000000003, 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938815+0000", 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938815+0000", 2024-09-12T22:11:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938816+0000", 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6100000000000002e-07 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938817+0000", 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7999999999999999e-06 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938823+0000", 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9699999999999996e-06 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938828+0000", 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.962215+0000", 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023386405999999998 2024-09-12T22:11:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.962398+0000", 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183287 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978702+0000", 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016303575000000001 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18781 4.29 4:959d3147:::100000000b5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2878677390000002, 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039485732000000003, 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938890+0000", 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938892+0000", 2024-09-12T22:11:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2460000000000002e-06 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938899+0000", 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5969999999999997e-06 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.938904+0000", 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7949999999999998e-06 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957317+0000", 2024-09-12T22:11:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018413426 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.957415+0000", 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7413999999999999e-05 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978375+0000", 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020960823 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18797 4.16 4:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2875037789999997, 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039446611999999999, 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939254+0000", 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5400000000000001e-07 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939257+0000", 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7089999999999998e-06 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939265+0000", 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0930000000000003e-06 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939271+0000", 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9240000000000004e-06 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963243+0000", 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023972448 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963345+0000", 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010110799999999999 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978700+0000", 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015355776 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18798 4.17 4:eb7dd551:::100000000c6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2874778889999998, 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038902288, 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939280+0000", 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6100000000000002e-07 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939283+0000", 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8509999999999999e-06 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939289+0000", 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8220000000000003e-06 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939293+0000", 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959034+0000", 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019740603999999998 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959130+0000", 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6500000000000001e-05 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978182+0000", 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019051558999999999 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18801 4.11 4:8a614455:::100000000c9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2872847710000004, 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038902484000000001, 2024-09-12T22:11:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939473+0000", 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939483+0000", 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8039999999999996e-06 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939490+0000", 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3780000000000003e-06 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939497+0000", 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.387e-06 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.958256+0000", 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018759616 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.958361+0000", 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010419799999999999 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978375+0000", 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020014581 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18806 4.11 4:89a13bde:::100000000ce.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2872113809999997, 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038935406999999998, 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939546+0000", 2024-09-12T22:11:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5900000000000003e-07 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939548+0000", 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.609e-06 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939555+0000", 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8050000000000001e-06 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939560+0000", 2024-09-12T22:11:48.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0189999999999997e-06 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959997+0000", 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020436776 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963527+0000", 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035298780000000002 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978481+0000", 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014954960999999999 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18811 4.17 4:e88d3223:::100000000d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939584+0000", 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2871729790000002, 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038712387000000001, 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.295 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939584+0000", 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939584+0000", 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939585+0000", 2024-09-12T22:11:48.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.96e-07 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939587+0000", 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.742e-06 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939592+0000", 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4389999999999999e-06 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939597+0000", 2024-09-12T22:11:48.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6500000000000004e-06 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963110+0000", 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023513596000000001 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.963217+0000", 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010666399999999999 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978297+0000", 2024-09-12T22:11:48.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0150799 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18813 4.29 4:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.286874633, 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038596819999999997, 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939883+0000", 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5000000000000003e-07 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939886+0000", 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1600000000000001e-06 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939892+0000", 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6669999999999999e-06 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939897+0000", 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9880000000000004e-06 2024-09-12T22:11:48.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959211+0000", 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019313740999999999 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.959311+0000", 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100498 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978480+0000", 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019168215999999998 2024-09-12T22:11:48.302 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18816 4.1e 4:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.939919+0000", 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2868380229999996, 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038889117000000001, 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939919+0000", 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939919+0000", 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939920+0000", 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5999999999999999e-07 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939921+0000", 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.53e-06 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939927+0000", 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.755e-06 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.939931+0000", 2024-09-12T22:11:48.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2719999999999999e-06 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965055+0000", 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025123458000000001 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965154+0000", 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9151e-05 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978809+0000", 2024-09-12T22:11:48.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013654591000000001 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:18821 4.26 4:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-09-12T22:11:43.940434+0000", 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2863235939999997, 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038398935000000002, 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-09-12T22:11:48.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940434+0000", 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940434+0000", 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940435+0000", 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8299999999999996e-07 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940438+0000", 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-06 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940445+0000", 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5290000000000003e-06 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.940451+0000", 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4979999999999997e-06 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965529+0000", 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025077972 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.965629+0000", 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100602 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-09-12T22:11:43.978833+0000", 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013203581000000001 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T22:11:48.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T22:11:48.311 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:48.312 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:48.324 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:48.323+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:48.416 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:48.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:48.416 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:11:48.416 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:48.425 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:48.425 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:48.424+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:48.525 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:48.524+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:48.567 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:48.567 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:11:48.568 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:11:48.568 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:11:48.568 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:48.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:48.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:11:48.626 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:48.626+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:48.680 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:11:48.680 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:5080 4.39 4:9cf6956e:::100000017b6.00000000:head [write 0~6206] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.959799154999999, 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043433896, 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:48.681 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5080 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718949+0000", 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718950+0000", 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718959+0000", 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8079999999999994e-06 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718972+0000", 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2931e-05 2024-09-12T22:11:48.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.718979+0000", 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2219999999999996e-06 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719024+0000", 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719106+0000", 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2010999999999998e-05 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719182+0000", 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5808000000000003e-05 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.719777+0000", 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00059516400000000002 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762290+0000", 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042512408000000002 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762342+0000", 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2305000000000002e-05 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:16.762383+0000", 2024-09-12T22:11:48.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1121999999999997e-05 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4487.0:11620 4.3a 4:5ea984dc:::100000031d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.71814457, 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054992669000000001, 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:48.687 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4487", 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/3064988165", 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11620 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960604+0000", 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.960605+0000", 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964969+0000", 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043637440000000001 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964982+0000", 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2937e-05 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.964991+0000", 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2199999999999998e-06 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965077+0000", 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5665000000000001e-05 2024-09-12T22:11:48.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965157+0000", 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0069999999999997e-05 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.965291+0000", 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000134058 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.972544+0000", 2024-09-12T22:11:48.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072532940000000004 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015486+0000", 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042941480999999997 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015545+0000", 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9833000000000001e-05 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.015596+0000", 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0943999999999999e-05 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:968 3.0 3:07a02702:::200.0000000c:head [write 3911762~5949 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.701620806000001, 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041610525000000002, 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.693 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977128+0000", 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.78e-07 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:26.977138+0000", 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1859999999999998e-06 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007402+0000", 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030264834000000001 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007426+0000", 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3920000000000001e-05 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007506+0000", 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9486000000000004e-05 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.007609+0000", 2024-09-12T22:11:48.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103068 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018639+0000", 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011030481999999999 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018672+0000", 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2629999999999998e-05 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:27.018738+0000", 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6041e-05 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18622 4.38 4:1e20cbdb:::10000000016.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.698 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7450135299999996, 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.03891592, 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933735+0000", 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933737+0000", 2024-09-12T22:11:48.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9939999999999999e-06 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933743+0000", 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9449999999999998e-06 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933748+0000", 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8250000000000004e-06 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933795+0000", 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6817999999999998e-05 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933910+0000", 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011495899999999999 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972651+0000", 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038740987999999997 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.702 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18624 4.1a 4:5b3b19a5:::10000000018.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7449902530000001, 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038978367, 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933758+0000", 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2e-07 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933761+0000", 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3290000000000001e-06 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933767+0000", 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1109999999999996e-06 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933772+0000", 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:11:48.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935594+0000", 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001821958 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936590+0000", 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0009959770000000001 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972736+0000", 2024-09-12T22:11:48.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036146409999999997 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18626 4.20 4:072a8150:::1000000001a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.744969974, 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038899771999999999, 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933778+0000", 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933779+0000", 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933781+0000", 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5019999999999999e-06 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933796+0000", 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4586999999999999e-05 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933801+0000", 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5820000000000001e-06 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933889+0000", 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7452000000000002e-05 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:48.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110463 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972678+0000", 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038678803999999997 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18631 4.3a 4:5f13809d:::1000000001f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:48.711 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.744886964, 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038845520000000001, 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933861+0000", 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933862+0000", 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0899999999999997e-07 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933864+0000", 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.858e-06 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933869+0000", 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2730000000000002e-06 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933876+0000", 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8279999999999997e-06 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936845+0000", 2024-09-12T22:11:48.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002969027 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936937+0000", 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2283999999999999e-05 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972707+0000", 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035769941 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18641 4.18 4:19311010:::10000000029.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.744760962, 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038895449999999998, 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:48.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933987+0000", 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933988+0000", 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9200000000000002e-07 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933990+0000", 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2330000000000001e-06 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933995+0000", 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1379999999999998e-06 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.933999+0000", 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9020000000000001e-06 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934492+0000", 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00049258699999999995 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934610+0000", 2024-09-12T22:11:48.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118046 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038273252000000001 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18642 4.3c 4:3d4c06c4:::1000000002a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.720 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7447444799999996, 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038875940999999997, 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934004+0000", 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.15e-07 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934006+0000", 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7740000000000001e-06 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934011+0000", 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9740000000000001e-06 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934015+0000", 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0690000000000003e-06 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934180+0000", 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000165174 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8505999999999995e-05 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972880+0000", 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038601128999999998 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18653 4.38 4:1e1620c8:::10000000035.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7446132219999999, 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038668936000000001, 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934135+0000", 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934136+0000", 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.51e-07 2024-09-12T22:11:48.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934138+0000", 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0190000000000001e-06 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934143+0000", 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7379999999999999e-06 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934148+0000", 2024-09-12T22:11:48.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7849999999999999e-06 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934927+0000", 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077865900000000001 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935079+0000", 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015255600000000001 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972804+0000", 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037724727999999999 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18655 4.6 4:60a13eb4:::10000000037.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7445752500000005, 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038394178000000001, 2024-09-12T22:11:48.729 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934173+0000", 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934174+0000", 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1399999999999997e-07 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934176+0000", 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.962e-06 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934181+0000", 2024-09-12T22:11:48.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6999999999999996e-06 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934186+0000", 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5739999999999997e-06 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5296000000000001e-05 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00010753500000000001 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972567+0000", 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038228597000000003 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.733 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18659 4.3c 4:3c3d7520:::1000000003b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7445300020000003, 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038770623999999997, 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934218+0000", 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934219+0000", 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1600000000000002e-07 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934221+0000", 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0499999999999999e-06 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934226+0000", 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3589999999999999e-06 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934231+0000", 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8629999999999999e-06 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935492+0000", 2024-09-12T22:11:48.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012608540000000001 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936029+0000", 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053760600000000004 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036959576000000001 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18661 4.6 4:614fee2a:::1000000003d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7444882179999999, 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038480874999999998, 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934260+0000", 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934261+0000", 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9500000000000003e-07 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934263+0000", 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9759999999999998e-06 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934268+0000", 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934273+0000", 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2710000000000003e-06 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934845+0000", 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00057226900000000003 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934952+0000", 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107215 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972741+0000", 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037788927999999999 2024-09-12T22:11:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18662 4.2c 4:3665eb52:::1000000003e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7444695919999997, 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038710241999999999, 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934279+0000", 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6800000000000001e-07 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934281+0000", 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8959999999999999e-06 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934288+0000", 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934293+0000", 2024-09-12T22:11:48.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5890000000000002e-06 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935485+0000", 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0011921 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935597+0000", 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112075 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972989+0000", 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037391498000000002 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18665 4.2b 4:d4b9b687:::10000000041.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7444282969999998, 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038440224000000002, 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934320+0000", 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3500000000000002e-07 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934322+0000", 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.057e-06 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934328+0000", 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.852e-06 2024-09-12T22:11:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934333+0000", 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0869999999999997e-06 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936530+0000", 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021970029999999999 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936631+0000", 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100939 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972760+0000", 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036128950999999999 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18666 4.6 4:61404748:::10000000042.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.750 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7444096240000002, 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038544538000000003, 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934339+0000", 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2099999999999998e-07 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934351+0000", 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1627999999999999e-05 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934357+0000", 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6259999999999997e-06 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934363+0000", 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7019999999999998e-06 2024-09-12T22:11:48.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935430+0000", 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001067089 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.935570+0000", 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000139825 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972883+0000", 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037313346999999997 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18668 4.1a 4:5bd35317:::10000000044.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7443785900000002, 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038934431999999998, 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.755 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934370+0000", 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5499999999999998e-07 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934385+0000", 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4929000000000001e-05 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934393+0000", 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0690000000000002e-06 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934400+0000", 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7259999999999996e-06 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.939889+0000", 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054895430000000004 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.940378+0000", 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00048856500000000005 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973304+0000", 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.032926144999999997 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18690 4.18 4:1ae6cdf3:::1000000005a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:48.759 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7442750619999998, 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038539486999999997, 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934473+0000", 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934474+0000", 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1100000000000002e-07 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934475+0000", 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6050000000000001e-06 2024-09-12T22:11:48.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934480+0000", 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0669999999999999e-06 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934484+0000", 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1300000000000003e-06 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937283+0000", 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027990160000000001 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937384+0000", 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000100727 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973013+0000", 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035628631000000001 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18692 4.30 4:0cbf7f79:::1000000005c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7442434970000003, 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038490674000000002, 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:48.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934505+0000", 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.39e-07 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934507+0000", 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.376e-06 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934511+0000", 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8539999999999996e-06 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934515+0000", 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.811e-06 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937322+0000", 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028068609999999999 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.937420+0000", 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7423999999999994e-05 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.972995+0000", 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035575909000000003 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.767 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:18695 4.2c 4:34658595:::1000000005f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7442287419999998, 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038576371999999998, 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:11:48.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934520+0000", 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934521+0000", 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4810000000000001e-06 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934526+0000", 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1220000000000003e-06 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.934531+0000", 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1110000000000001e-06 2024-09-12T22:11:48.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936813+0000", 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002282615 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.936911+0000", 2024-09-12T22:11:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8064000000000002e-05 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:11:43.973096+0000", 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036184710000000002 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:11:48.772 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:11:48.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:11:48.774 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:48.773+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:48.775 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:48.874 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:48.873+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:48.890 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T22:11:48.890 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-09-12T22:11:48.890 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-09-12T22:11:48.890 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T22:11:48.898 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:11:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:11:48.900 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:48.916 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:11:48.916 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:11:48.916 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-12T22:11:48.920 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:11:48.920 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:11:48.985 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:48.984+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:49.044 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.044 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.053 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:49.094 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:49.093+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:49.177 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:49.177+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:49.195 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.195 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:49.279 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:49.278+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:49.313 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.313 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.322 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:49.379 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:49.378+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:49.425 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.425 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.434 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:49.480 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:49.478+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:49.577 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.577 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.581 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:49.579+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:49.586 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:49.608 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:11:49.681 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:11:49.681+0000 7fcb60d02640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30284) UID: 0 2024-09-12T22:11:49.702 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.702 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.711 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:49.782 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:49.781+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:49.814 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.815 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:49.908 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:49.907+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:49.968 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:49.968 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:49.977 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:50.018 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:50.017+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:50.069 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T22:11:50.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:11:50.069 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T22:11:50.081 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.081 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.085 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:50.084+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:50.090 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:50.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:11:50.103 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T22:11:50.162 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T22:11:50.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:11:50.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:11:50.186 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:50.185+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:50.192 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.192 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.201 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:50.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:11:50.234 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T22:11:50.288 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T22:11:50.286+0000 7f7d10e0e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30266) UID: 0 2024-09-12T22:11:50.304 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.304 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:11:50.324 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T22:11:50.334 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T22:11:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.427 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.436 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:11:50.539 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.539 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:11:50.649 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.649 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:11:50.763 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.763 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.771 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:11:50.875 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.875 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:50.884 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:11:50.988 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:11:50.988 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:11:51.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-09-12T22:11:51.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:11:52.619 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:11:52.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:11:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:11:57.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-09-12T22:12:03.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-09-12T22:12:08.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-09-12T22:12:14.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2024-09-12T22:12:20.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-09-12T22:12:26.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-09-12T22:12:32.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-09-12T22:12:37.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-09-12T22:12:43.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2024-09-12T22:12:49.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~134s 2024-09-12T22:12:55.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-09-12T22:12:57.227 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.164 M : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9         The selected entry will be started automatically in 4s.     Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.708 MHz processor [ 0.000411] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000415] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000416] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000744] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006405] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006414] Using GB pages for direct mapping [ 0.006527] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006529] ACPI: Early table checksum verification disabled [ 0.006531] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006535] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006539] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006543] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006546] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006548] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006550] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006552] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006554] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006556] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006559] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006561] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006563] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006565] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006568] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006570] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006572] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006574] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006577] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006579] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006581] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006583] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006586] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006587] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006588] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006589] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006590] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006590] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006591] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006591] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006592] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006593] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006593] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006594] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006594] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006595] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006596] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006596] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006597] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006597] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006598] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006598] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006599] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006600] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006646] No NUMA configuration found [ 0.006647] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006655] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006827] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006864] Zone ranges: [ 0.006864] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006866] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006867] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006868] Device empty [ 0.006869] Movable zone start for each node [ 0.006871] Early memory node ranges [ 0.006871] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006872] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006873] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006877] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006882] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006919] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011778] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011889] ACPI: PM-Timer IO Port: 0x408 [ 0.011898] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011899] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011900] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011901] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011901] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011902] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011902] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011903] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011912] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011916] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011918] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011919] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011923] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011924] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011927] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011932] CPU topo: Max. logical packages: 1 [ 0.011933] CPU topo: Max. logical dies: 1 [ 0.011933] CPU topo: Max. dies per package: 1 [ 0.011937] CPU topo: Max. threads per core: 2 [ 0.011938] CPU topo: Num. cores per package: 4 [ 0.011939] CPU topo: Num. threads per package: 8 [ 0.011939] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011948] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011949] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.011950] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011951] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.011952] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.011952] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.011953] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.011954] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011954] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011955] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011955] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011957] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011958] Booting paravirtualized kernel on bare hardware [ 0.011960] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016343] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016562] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016583] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016637] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016653] random: crng init done [ 0.018823] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019961] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020067] Fallback order for Node 0: 0 [ 0.020070] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.020071] Policy zone: Normal [ 0.020212] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020222] software IO TLB: area num 8. [ 0.041782] Memory: 1751596K/33438012K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989840K reserved, 0K cma-reserved) [ 0.041884] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041892] Kernel/User page tables isolation: enabled [ 0.041916] ftrace: allocating 48134 entries in 189 pages [ 0.048817] ftrace: allocated 189 pages with 6 groups [ 0.049347] Dynamic Preempt: voluntary [ 0.049389] rcu: Preemptible hierarchical RCU implementation. [ 0.049389] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.049390] Trampoline variant of Tasks RCU enabled. [ 0.049391] Rude variant of Tasks RCU enabled. [ 0.049391] Tracing variant of Tasks RCU enabled. [ 0.049392] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.049393] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052862] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.053023] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.053132] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.058384] Console: colour VGA+ 80x25 [ 0.058401] printk: console [ttyS1] enabled [ 1.128960] ACPI: Core revision 20230331 [ 1.133054] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.142181] APIC: Switch to symmetric I/O mode setup [ 1.147153] DMAR: Host address width 46 [ 1.150996] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.156313] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.164307] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.170573] DMAR: ATSR flags: 0x0 [ 1.173894] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.180161] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.186515] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.192868] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.198268] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.198269] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.213294] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.218594] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.224817] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.235188] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32723d995b0, max_idle_ns: 440795369662 ns [ 1.245692] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.41 BogoMIPS (lpj=3499708) [ 1.246710] CPU0: Thermal monitoring enabled (TM1) [ 1.247745] process: using mwait in idle threads [ 1.248692] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.249690] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.250692] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.251691] Spectre V2 : Mitigation: Retpolines [ 1.252690] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.253690] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.254691] Speculative Store Bypass: Vulnerable [ 1.255696] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.256691] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.257691] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.258694] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.259691] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.260690] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.261691] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.262691] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.275356] Freeing SMP alternatives memory: 40K [ 1.275691] pid_max: default: 32768 minimum: 301 [ 1.276709] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.277695] Yama: becoming mindful. [ 1.278696] SELinux: Initializing. [ 1.279707] LSM support for eBPF active [ 1.280748] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.281728] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.385772] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.387789] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.388703] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.389700] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.390699] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.391691] ... version: 3 [ 1.392691] ... bit width: 48 [ 1.393690] ... generic registers: 4 [ 1.394690] ... value mask: 0000ffffffffffff [ 1.395690] ... max period: 00007fffffffffff [ 1.396690] ... fixed-purpose events: 3 [ 1.397690] ... event mask: 000000070000000f [ 1.398774] signal: max sigframe size: 1776 [ 1.399702] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.400716] rcu: Hierarchical SRCU implementation. [ 1.400717] rcu: Max phase no-delay instances is 400. [ 1.404171] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.404758] smp: Bringing up secondary CPUs ... [ 1.405756] smpboot: x86: Booting SMP configuration: [ 1.405758] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.408947] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.408947] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.408947] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.413733] smp: Brought up 1 node, 8 CPUs [ 1.413733] smpboot: Total of 8 processors activated (55995.32 BogoMIPS) [ 1.455892] node 0 deferred pages initialised in 41ms [ 1.461759] devtmpfs: initialized [ 1.461759] x86/mm: Memory block size: 128MB [ 1.463800] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.463800] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.463800] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.463852] pinctrl core: initialized pinctrl subsystem [ 1.494613] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.494696] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.494700] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.494702] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.494709] audit: initializing netlink subsys (disabled) [ 1.494714] audit: type=2000 audit(1726179149.269:1): state=initialized audit_enabled=0 res=1 [ 1.494788] thermal_sys: Registered thermal governor 'fair_share' [ 1.494789] thermal_sys: Registered thermal governor 'step_wise' [ 1.494790] thermal_sys: Registered thermal governor 'user_space' [ 1.499693] cpuidle: using governor menu [ 1.505711] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.505712] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.505768] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.505778] PCI: Using configuration type 1 for base access [ 1.534721] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.534727] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.534727] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.534727] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.534727] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.542733] cryptd: max_cpu_qlen set to 1000 [ 1.542784] ACPI: Added _OSI(Module Device) [ 1.542785] ACPI: Added _OSI(Processor Device) [ 1.542786] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.542787] ACPI: Added _OSI(Processor Aggregator Device) [ 1.542788] ACPI: Added _OSI(Linux-Dell-Video) [ 1.542789] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.542790] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.573953] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.576123] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.577780] ACPI: Dynamic OEM Table Load: [ 1.591181] ACPI: _OSC evaluated successfully for all CPUs [ 1.591441] ACPI: Interpreter enabled [ 1.591450] ACPI: PM: (supports S0 S4 S5) [ 1.591451] ACPI: Using IOAPIC for interrupt routing [ 1.592949] HEST: Enabling Firmware First mode for corrected errors. [ 1.633356] HEST: Table parsing has been initialized. [ 1.633493] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.633495] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.633496] PCI: Using E820 reservations for host bridge windows [ 1.634108] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.663760] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.663765] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.664885] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.665421] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.665422] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.665449] PCI host bridge to bus 0000:ff [ 1.665451] pci_bus 0000:ff: root bus resource [bus ff] [ 1.665461] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.665505] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.665536] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.665567] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.665598] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.665629] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.665658] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.665688] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.665722] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.665751] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.665781] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.665810] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.665840] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.665870] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.665900] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.665931] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.665960] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.665989] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.666018] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.666040] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.666076] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666139] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666199] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666259] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666319] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666371] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666412] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.666444] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.666477] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666520] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666563] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666605] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666646] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.666678] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.666712] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.666745] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.666779] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666822] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666864] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666906] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666951] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.666986] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.667017] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.667050] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.667085] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.667116] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.667148] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.667179] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.667214] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.667244] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.667277] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.667308] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.667330] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.667364] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.667395] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.669646] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.669649] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.669785] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.670028] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.670029] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.670442] PCI host bridge to bus 0000:00 [ 1.670443] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.670445] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.670446] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.670447] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.670448] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.670449] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.670450] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.670469] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.670574] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.670585] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.670623] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.670720] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.670731] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.670734] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.670769] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.670860] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.670872] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.670874] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.670876] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.670880] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.670911] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.670998] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671005] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.671084] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671091] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.671168] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671176] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.671250] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671258] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.671333] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671341] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.671416] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671424] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.671499] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671507] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.671582] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671590] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.671662] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671727] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671812] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671871] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.671877] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.671957] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.672197] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.672216] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.672227] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.672238] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.672250] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.672262] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.672273] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.672330] pci 0000:00:11.4: PME# supported from D3hot [ 1.672412] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.672437] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.672524] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.672615] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.672639] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.672727] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.672795] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.672818] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.672906] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.672991] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.673012] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.673126] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.673208] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.673246] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.673338] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.673441] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.673479] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673483] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.673487] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673575] pci 0000:00:1c.2: PME# d [ 1.673678pe 01 class 0x060400 PCIe Root Port [ 1.673716] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.673721] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.673724] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.673812] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.673920] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.673941] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.674054] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.674136] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.674339] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.674357] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.674367] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.674378] pci 0000:00:1f.2: ] [ 1.674388 0xf040-0xf043] BAR 4 [io 0xf000-0xf01f] [ 1.674409] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.674467] pci 0000:00:1f.2: PME# supported from D3hot [ 1.674528] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.674551] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.674580] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.674747] acpiphp: Slot [1] registered [ 1.674759] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.674863] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.674872] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.674888] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.674892] pci 0000:02:00.0: enabling Extended Tags [ 1.675001] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.675107] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.675117] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.675122] pci 0000:03:00.0: B 1.675132] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.675174] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.675190] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675191] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.675200] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675201] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.675356] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint 1.675366] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.675371] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.675381] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.675386] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.675423] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.675437] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675438] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.675447] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675447] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.675588] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.675634] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.675731] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.675803] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.675816] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.675822] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.675875] pci 0000:05:00.0: enabling Extended Tags [ 1.676013] pci 0000:05:00.0: supports D1 D2 [ 1.676013] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.676197] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.676285] pci_bus 0000:06: extended config space not accessible [ 1.676318] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.676355] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.676375] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.676395] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.676494] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.676564] pci 0000:06:00.0: supports D1 D2 [ 1.676565] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.676719] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.676869] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.676903] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.676940] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.676957] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.677195] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.677256] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.677257] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.677290] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.677291] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.677635] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.677669] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.677705] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.677724] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.677953] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.678013] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.678014] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.678047] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.678047] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.678358] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.678369] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.679034] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.679066] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.679096] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.679127] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.679157] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.679157] ACPI: PCI: Interrupt link LNKE disabled [ 1.679187] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.679187] ACPI: PCI: Interrupt link LNKF disabled [ 1.679217] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.679218] ACPI: PCI: Interrupt link LNKG disabled [ 1.679248] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.679248] ACPI: PCI: Interrupt link LNKH disabled [ 1.679414] iommu: Default domain type: Translated [ 1.679414] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.679414] SCSI subsystem initialized [ 1.679414] ACPI: bus type USB registered [ 1.679414] usbcore: registered new interface driver usbfs [ 1.679414] usbcore: registered new interface driver hub [ 1.679414] usbcore: registered new device driver usb [ 1.679414] pps_core: LinuxPPS API ver. 1 registered [ 1.679414] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.679414] PTP clock support registered [ 1.679700] EDAC MC: Ver: 3.0.0 [ 1.679849] NetLabel: Initializing [ 1.679850] NetLabel: domain hash size = 128 [ 1.679850] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.679862] NetLabel: unlabeled traffic allowed by default [ 1.679863] PCI: Using ACPI for IRQ routing [ 1.690712] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.690714] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.690714] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.690716] vgaarb: loaded [ 1.690722] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.690726] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.693568] clocksource: Switched to clocksource tsc-early [ 1.703677] VFS: Disk quotas dquot_6.6.0 [ 1.703686] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.703734] pnp: PnP ACPI init [ 1.704050] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.704053] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.704055] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.704056] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.704056] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.704057] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.704059] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.704060] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.704061] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.704062] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.704063] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.704064] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.704064] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.704211] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.704213] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.704214] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.704215] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.704215] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.704878] pnp: PnP ACPI: found 5 devices [ 1.710317] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.710365] NET: Registered PF_INET protocol family [ 1.710531] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.712797] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.712830] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.712837] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.713069] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.713184] TCP: Hash tables configured (established 262144 bind 65536) [ 1.713304] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.713387] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.713444] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.713529] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.713533] NET: Registered PF_XDP protocol family [ 1.713554] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.713565] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.713567] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.713572] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.713574] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.713580] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713581] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713583] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713584] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713585] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713586] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713587] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713588] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713590] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713590] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713592] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713592] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713594] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713595] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713596] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713597] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713598] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.713599] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.713601] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.713603] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.713606] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.713620] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.713622] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.713630] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.713651] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.713653] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.713659] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.713668] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.713676] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.713682] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.713688] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.713694] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.713696] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.713703] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.713706] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.713712] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.713713] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.713714] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.713715] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.713716] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.713717] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.713717] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.713719] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.713719] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.713720] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.713721] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.713722] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.713723] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.713724] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.713725] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.713726] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.713726] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.713727] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.713885] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.729683] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15257 usecs [ 1.741680] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11700 usecs [ 1.741695] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.741729] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.741730] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.741735] ACPI: bus type thunderbolt registered [ 1.741737] Trying to unpack rootfs image as initramfs... [ 1.955894] Initialise system trusted keyrings [ 1.955906] Key type blacklist registered [ 1.955947] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.955963] zbud: loaded [ 2.063992] integrity: Platform Keyring initialized [ 2.064001] integrity: Machine keyring initialized [ 2.067353] Freeing initrd memory: 31720K [ 2.072260] NET: Registered PF_ALG protocol family [ 2.072263] xor: automatically using best checksumming function avx [ 2.072266] Key type asymmetric registered [ 2.072267] Asymmetric key parser 'x509' registered [ 2.072268] Running certificate verification selftests [ 2.073415] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 2.073898] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 2.073921] io scheduler mq-deadline registered [ 2.073922] io scheduler kyber registered [ 2.073928] io scheduler bfq registered [ 2.134188] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.134528] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 2.134693] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 2.134838] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 2.134972] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 2.135135] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 2.135281] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 2.135436] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.151713] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 2.160451] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 2.160471] ACPI: button: Power Button [PWRB] [ 2.160492] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.168265] ACPI: button: Power Button [PWRF] [ 2.177286] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.177288] pstore: Registered erst as persistent store backend [ 2.177380] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.177483] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.184837] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.193465] Non-volatile memory driver v1.3 [ 2.201632] rdac: device handler registered [ 2.201656] hp_sw: device handler registered [ 2.201657] emc: device handler registered [ 2.201675] alua: device handler registered [ 2.201939] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.201968] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.201980] ehci-pci 0000:00:1d.0: debug port 2 [ 2.205887] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.212671] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.212709] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.212710] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.212712] usb usb1: Product: EHCI Host Controller [ 2.212713] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.212713] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.212798] hub 1-0:1.0: USB hub found [ 2.212802] hub 1-0:1.0: 2 ports detected [ 2.212928] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.212958] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.214045] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.214292] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.214294] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.214328] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.214330] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.214332] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 2.214348] ehci-pci 0000:00:1a.0: debug port 2 [ 2.214359] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.214361] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.214362] usb usb2: Product: xHCI Host Controller [ 2.214362] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.214363] usb usb2: SerialNumber: 0000:00:14.0 [ 2.214459] hub 2-0:1.0: USB hub found [ 2.214492] hub 2-0:1.0: 15 ports detected [ 2.216249] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.216251] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.216252] usb usb3: Product: xHCI Host Controller [ 2.216253] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.216254] usb usb3: SerialNumber: 0000:00:14.0 [ 2.216316] hub 3-0:1.0: USB hub found [ 2.216333] hub 3-0:1.0: 6 ports detected [ 2.217266] usbcore: registered new interface driver usbserial_generic [ 2.217271] usbserial: USB Serial support registered for generic [ 2.217304] i8042: PNP: No PS/2 controller found. [ 2.217329] mousedev: PS/2 mouse device common for all mice [ 2.217388] rtc_cmos 00:00: RTC can wake from S4 [ 2.217709] rtc_cmos 00:00: registered as rtc0 [ 2.217761] rtc_cmos 00:00: setting system clock to 2024-09-12T22:12:32 UTC (1726179152) [ 2.217786] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.218272] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.218364] intel_pstate: Intel P-state driver initializing [ 2.224669] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.224698] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.224700] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.224701] usb usb4: Product: EHCI Host Controller [ 2.224702] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.224702] usb usb4: SerialNumber: 0000:00:1a.0 [ 2.224776] hub 4-0:1.0: USB hub found [ 2.224780] hub 4-0:1.0: 2 ports detected [ 2.243354] hid: raw HID events driver (C) Jiri Kosina [ 2.243385] usbcore: registered new interface driver usbhid [ 2.243386] usbhid: USB HID core driver [ 2.243406] drop_monitor: Initializing network drop monitor service [ 2.252877] Initializing XFRM netlink socket [ 2.252894] NET: Registered PF_INET6 protocol family [ 2.257970] Segment Routing with IPv6 [ 2.257986] NET: Registered PF_PACKET protocol family [ 2.258011] mpls_gso: MPLS GSO support [ 2.267608] microcode: Current revision: 0x0b00001b [ 2.283153] resctrl: L3 allocation detected [ 2.283155] resctrl: L3 monitoring detected [ 2.283172] IPI shorthand broadcast: enabled [ 2.283176] AVX2 version of gcm_enc/dec engaged. [ 2.324497] AES CTR mode by8 optimization enabled [ 2.324538] sched_clock: Marking stable (1151000459, 1172638374)->(2715293372, -391654539) [ 2.339609] registered taskstats version 1 [ 2.354661] Loading compiled-in X.509 certificates [ 2.355153] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.355433] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.355712] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.355854] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.355864] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.357594] page_owner is disabled [ 2.357791] pstore: Using crash dump compression: deflate [ 2.357801] Key type big_key registered [ 2.451671] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.460673] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.467644] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.476946] Key type encrypted registered [ 2.476953] ima: No TPM chip found, activating TPM-bypass! [ 2.476956] Loading compiled-in module X.509 certificates [ 2.477244] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.477247] ima: Allocated hash algorithm: sha256 [ 2.477255] ima: No architecture policies found [ 2.477262] evm: Initialising EVM extended attributes: [ 2.477263] evm: security.selinux [ 2.477263] evm: security.SMACK64 (disabled) [ 2.477264] evm: security.SMACK64EXEC (disabled) [ 2.477264] evm: security.SMACK64TRANSMUTE (disabled) [ 2.477265] evm: security.SMACK64MMAP (disabled) [ 2.477265] evm: security.apparmor (disabled) [ 2.477265] evm: security.ima [ 2.477266] evm: security.capability [ 2.477266] evm: HMAC attrs: 0x1 [ 2.580085] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.580088] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.580241] hub 1-1:1.0: USB hub found [ 2.580335] hub 1-1:1.0: 8 ports detected [ 2.588861] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.588864] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.589278] hub 2-12:1.0: USB hub found [ 2.589366] hub 2-12:1.0: 4 ports detected [ 2.596084] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.596087] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.596237] hub 4-1:1.0: USB hub found [ 2.596334] hub 4-1:1.0: 6 ports detected [ 2.793666] tsc: Refined TSC clocksource calibration: 3499.992 MHz [ 2.793670] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns [ 2.799643] clocksource: Switched to clocksource tsc [ 2.885679] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.990020] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.990022] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.994948] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.046749] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.049399] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.049449] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.193887] clk: Disabling unused clocks [ 5.198707] Freeing unused decrypted memory: 2028K [ 5.203949] Freeing unused kernel image (initmem) memory: 3980K [ 5.203999] Write protecting the kernel read-only data: 30720k [ 5.215975] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.260340] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.260342] x86/mm: Checking user space page tables [ 5.296975] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.296983] Run /init as init process [ 5.309780] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.309887] systemd[1]: Detected architecture x86-64. [ 5.309889] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.360747] systemd[1]: Hostname set to . [ 5.418019] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.418128] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.439739] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.453802] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.465782] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.476724] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ OK [[ 5.488834] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ 5.503777] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.517976] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ OK [[ 5.529973] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ 5.543756] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.556777] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.575311] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.590771] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.603354] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.616279] systemd[1]: Starting Create System Users... Starting Creat[ 5.622998] fuse: init (API version 7.36) e System Users... [ 5.633275] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.646408] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 6.055555] dca service started, version 1.12.1 [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reached target [0;1[ 6.090357] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode ;39mPath Units[[ 6.090362] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.090365] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst 0m. [ [ 6.101732] scsi host0: ahci [ 6.101916] scsi host1: ahci OK ] Reache[ 6.102044] scsi host2: ahci [ 6.102141] scsi host3: ahci d target [0;1;3[ 6.102185] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 41 lpm-pol 0 9mBasic System[[ 6.102188] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 41 lpm-pol 0 [ 6.102190] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 41 lpm-pol 0 [ 6.102193] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 41 lpm-pol 0 [ 6.102476] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode 0m. [ 6.102479] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.102481] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.128739] scsi host4: ahci [ 6.128930] scsi host5: ahci [ 6.129310] scsi host6: ahci [ 6.129488] scsi host7: ahci [ 6.129865] scsi host8: ahci [ 6.130033] scsi host9: ahci [ 6.130078] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 42 lpm-pol 0 [ 6.130081] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 42 lpm-pol 0 [ 6.130082] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 42 lpm-pol 0 [ 6.130085] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 42 lpm-pol 0 [ 6.130088] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 42 lpm-pol 0 [ 6.130090] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 42 lpm-pol 0 [ 6.220857] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.220859] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.265156] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.265161] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.275849] igb 0000:07:00.0: added PHC on eth0 [ 6.275877] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.275878] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 6.275954] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.275955] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.308467] nvme nvme0: pci function 0000:02:00.0 [ 6.310154] nvme nvme0: 8/0/0 default/read/poll queues [ 6.318325] ACPI: bus type drm_connector registered [ 6.329135] igb 0000:07:00.1: added PHC on eth1 [ 6.329161] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.329162] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 6.329239] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.329240] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.415227] ata3: SATA link down (SStatus 0 SControl 300) [ 6.415262] ata2: SATA link down (SStatus 0 SControl 300) [ 6.415290] ata1: SATA link down (SStatus 0 SControl 300) [ 6.415316] ata4: SATA link down (SStatus 0 SControl 300) [ 6.439209] ata6: SATA link down (SStatus 0 SControl 300) [ 6.439315] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.439365] ata7: SATA link down (SStatus 0 SControl 300) [ 6.439389] ata10: SATA link down (SStatus 0 SControl 300) [ 6.439409] ata9: SATA link down (SStatus 0 SControl 300) [ 6.439430] ata8: SATA link down (SStatus 0 SControl 300) [ 6.440322] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.440811] ata5.00: NCQ Send/Recv Log not supported [ 6.440812] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.442180] ata5.00: NCQ Send/Recv Log not supported [ 6.442184] ata5.00: configured for UDMA/133 [ 6.442310] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.458460] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.513716] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.513877] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.530003] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.530020] sd 4:0:0:0: [sda] Write Protect is off [ 6.530044] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.530072] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.542967] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.545318] sda: sda1 [ 6.545417] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.554572] Console: switching to colour dummy device 80x25 [ 6.554723] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.554725] ast 0000:06:00.0: AST 2400 detected [ 6.554778] ast 0000:06:00.0: [drm] Using analog VGA [ 6.554787] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.558021] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.563842] fbcon: astdrmfb (fb0) is primary device [ 6.594008] Console: switching to colour frame buffer device 128x48 [ 6.611892] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.407044] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.407336] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.407419] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.407420] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 7.409676] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.566997] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.567286] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.567369] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.567370] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 7.570365] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.586584] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.615534] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.843257] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root[ 8.190917] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). ... [ 8.727806] SELinux: policy capability network_peer_controls=1 [ 8.727813] SELinux: policy capability open_perms=1 [ 8.727815] SELinux: policy capability extended_socket_class=1 [ 8.727815] SELinux: policy capability always_check_network=0 [ 8.727816] SELinux: policy capability cgroup_seclabel=1 [ 8.727817] SELinux: policy capability nnp_nosuid_transition=1 [ 8.727818] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.771989] audit: type=1403 audit(1726179159.052:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.774598] systemd[1]: Successfully loaded SELinux policy in 125.014ms. [ 8.841628] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.318ms. [ 8.853386] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.853520] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.793660] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.793787] systemd[1]: Stopped Switch Root. [ 9.801195] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.801589] systemd[1]: Created slice Slice /system/getty. [ 9.805544] systemd[1]: Created slice Slice /system/modprobe. [ 9.814384] systemd[1]: Created slice Slice /system/serial-getty. [ 9.819788] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.825495] systemd[1]: Created slice User and Session Slice. [ 9.831345] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.831449] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.837699] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.843088] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.858699] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.865557] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.874929] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.885261] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.895608] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.905924] systemd[1]: Reached target Local Encrypted Volumes. [ 9.916263] systemd[1]: Stopped target Switch Root. [ 9.926931] systemd[1]: Stopped target Initrd File Systems. [ 9.937870] systemd[1]: Stopped target Initrd Root File System. [ 9.943776] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.948668] systemd[1]: Reached target Path Units. [ OK [[ 9.954215] systemd[1]: Reached target Slice Units. [ 9.960127] systemd[1]: Reached target Swaps. [ 9.966904] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.972061] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.978900] systemd[1]: Listening on LVM2 poll daemon socket. 0m] Stopped Switch Root. [ OK ] Crea[ 10.005894] systemd[1]: Listening on RPCbind Server Activation Socket. ted slice [0;1;[ 10.013260] systemd[1]: Reached target RPC Port Mapper. 39mSlice /system/getty. [[ 10.021151] systemd[1]: Listening on Process Core Dump Socket. [ 10.021287] systemd[1]: Listening on initctl Compatibility Named Pipe. [0;32m OK [ 10.035957] systemd[1]: Listening on udev Control Socket. [ 10.036210] systemd[1]: Listening on udev Kernel Socket. ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 10.055738] systemd[1]: Mounting Huge Pages File System... serial-getty[ 10.063217] systemd[1]: Mounting POSIX Message Queue File System... . [ OK[ 10.070634] systemd[1]: Mounting Kernel Debug File System... ] Created [ 10.077684] systemd[1]: Mounting Kernel Trace File System... slice S[ 10.084038] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Sta[ 10.109473] systemd[1]: Starting Create List of Static Device Nodes... [ 10.110542] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... rted Fo[ 10.117324] systemd[1]: Starting Load Kernel Module configfs... [ 10.127551] systemd[1]: Starting Load Kernel Module drm... [ 10.134794] systemd[1]: Starting Load Kernel Module fuse... rward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK [ 10.159060] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... ] Reached t[ 10.168495] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.168547] systemd[1]: Stopped Plymouth switch root service. [ 10.177250] systemd[1]: Stopped Journal Service. arget c[ 10.188050] systemd[1]: Starting Journal Service... [ 10.192804] systemd[1]: Starting Load Kernel Modules... [ 10.194552] systemd[1]: Starting Generate network units from Kernel command line... [ 10.198985] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.200170] systemd[1]: Starting Remount Root and Kernel File Systems... eph target allow[ 10.206631] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.207447] systemd[1]: Starting Coldplug All udev Devices... [ 10.226758] systemd[1]: Mounted Huge Pages File System. [ 10.231993] systemd[1]: Mounted POSIX Message Queue File System. [ 10.242706] systemd[1]: Mounted Kernel Debug File System. [ 10.248415] systemd[1]: Mounted Kernel Trace File System. [ 10.253856] systemd[1]: Finished Create List of Static Device Nodes. [ 10.259854] systemd[1]: Finished Read and set NIS domainname from /etc/sysconfig/network. [ 10.265170] systemd[1]: Finished Generate network units from Kernel command line. in…eph-mon@.se[ 10.270472] systemd[1]: Started Journal Service. [ 10.283720] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. rvice instances at once. [ OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances [ 10.344683] systemd-journald[581]: Received client request to flush runtime journal. at once. [ OK [0[ 10.356223] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.356248] device-mapper: uevent: version 1.0.3 m] Reached targe[ 10.356357] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com t ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Started Journal Service. [ OK ] Reached target Preparation for Network. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module c[ 10.836633] IPMI message handler: version 39.2 onfigfs. [ OK [0[ 10.844675] ipmi device interface m] Finished Load Kernel Module fuse. [ 10.855875] ipmi_si: IPMI System Interface driver [ 10.855899] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.855902] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.855904] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.855980] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.856066] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.857107] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ OK [[ 10.857111] ipmi_si: Adding ACPI-specified kcs state machine 0m] Finished [0[ 10.857196] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 ;1;39mTell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader[ 10.929497] ioatdma: Intel(R) QuickData Technology Driver 5.00 Update. [ 10.931655] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.940563] igb 0000:07:00.0: DCA enabled [ 10.940582] igb 0000:07:00.1: DCA enabled [ 10.958042] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.968832] power_meter ACPI000D:00: Found ACPI power meter. [ 10.968856] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.968863] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.996879] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 11.004106] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.005202] i2c i2c-3: 2/8 memory slots populated (from DMI) [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... [ 11.036057] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.036651] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.064707] ipmi_ssif: IPMI SSIF Interface driver Starting RPC Bind... [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ 11.094378] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.094383] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.094387] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.113909] iTCO_vendor_support: vendor-support=0 [ 11.121035] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.121241] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ OK ] Started RPC Bind. [ 11.438631] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.438637] EDAC sbridge: Ver: 1.1.2 [ 11.482874] RPC: Registered named UNIX socket transport module. [ 11.482880] RPC: Registered udp transport module. [ 11.482884] RPC: Registered tcp transport module. [ 11.482885] RPC: Registered tcp-with-tls transport module. [ 11.482886] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Security Auditing Service. [ 11.653385] intel_rapl_common: Found RAPL domain package [ 11.653395] intel_rapl_common: Found RAPL domain dram Starting Record System Boot/Shutdown in UTMP... [ 11.671537] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.679794] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.679906] XFS (dm-4): Mounting V4 Filesystem 85701639-ca36-424b-9085-47d40ccac6f9 [ 11.684574] XFS (dm-4): Ending clean mount [ 11.684617] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.277177] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.436005] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.661773] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK [ 13.849725] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.849835] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (6s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.164 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... [ 20.561842] block sda: the capability attribute has been deprecated. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.164 smithi164.front.sepia.ceph.com smithi164/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-09-12T22:12:57.228 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-09-12T22:12:57.282 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.164 M : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9              The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9         The selected entry will be started automatically in 4s.     Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.708 MHz processor [ 0.000411] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000415] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000416] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000744] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006405] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006414] Using GB pages for direct mapping [ 0.006527] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006529] ACPI: Early table checksum verification disabled [ 0.006531] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006535] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006539] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006543] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006546] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006548] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006550] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006552] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006554] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006556] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006559] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006561] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006563] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006565] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006568] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006570] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006572] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006574] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006577] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006579] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006581] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006583] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006586] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006587] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006588] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006589] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006590] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006590] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006591] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006591] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006592] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006593] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006593] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006594] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006594] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006595] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006596] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006596] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006597] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006597] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006598] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006598] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006599] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006600] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006646] No NUMA configuration found [ 0.006647] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006655] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006827] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006864] Zone ranges: [ 0.006864] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006866] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006867] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006868] Device empty [ 0.006869] Movable zone start for each node [ 0.006871] Early memory node ranges [ 0.006871] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006872] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006873] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006877] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006882] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006919] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011778] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011889] ACPI: PM-Timer IO Port: 0x408 [ 0.011898] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011899] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011900] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011901] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011901] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011902] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011902] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011903] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011912] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011916] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011918] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011919] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011923] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011924] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011927] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011932] CPU topo: Max. logical packages: 1 [ 0.011933] CPU topo: Max. logical dies: 1 [ 0.011933] CPU topo: Max. dies per package: 1 [ 0.011937] CPU topo: Max. threads per core: 2 [ 0.011938] CPU topo: Num. cores per package: 4 [ 0.011939] CPU topo: Num. threads per package: 8 [ 0.011939] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011948] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011949] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.011950] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011951] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.011952] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.011952] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.011953] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.011954] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011954] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011955] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011955] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011957] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011958] Booting paravirtualized kernel on bare hardware [ 0.011960] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016343] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016562] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016583] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016637] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016653] random: crng init done [ 0.018823] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019961] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020067] Fallback order for Node 0: 0 [ 0.020070] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.020071] Policy zone: Normal [ 0.020212] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020222] software IO TLB: area num 8. [ 0.041782] Memory: 1751596K/33438012K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989840K reserved, 0K cma-reserved) [ 0.041884] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041892] Kernel/User page tables isolation: enabled [ 0.041916] ftrace: allocating 48134 entries in 189 pages [ 0.048817] ftrace: allocated 189 pages with 6 groups [ 0.049347] Dynamic Preempt: voluntary [ 0.049389] rcu: Preemptible hierarchical RCU implementation. [ 0.049389] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.049390] Trampoline variant of Tasks RCU enabled. [ 0.049391] Rude variant of Tasks RCU enabled. [ 0.049391] Tracing variant of Tasks RCU enabled. [ 0.049392] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.049393] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052862] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.053023] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.053132] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.058384] Console: colour VGA+ 80x25 [ 0.058401] printk: console [ttyS1] enabled [ 1.128960] ACPI: Core revision 20230331 [ 1.133054] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.142181] APIC: Switch to symmetric I/O mode setup [ 1.147153] DMAR: Host address width 46 [ 1.150996] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.156313] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.164307] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.170573] DMAR: ATSR flags: 0x0 [ 1.173894] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.180161] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.186515] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.192868] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.198268] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.198269] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.213294] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.218594] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.224817] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.235188] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32723d995b0, max_idle_ns: 440795369662 ns [ 1.245692] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.41 BogoMIPS (lpj=3499708) [ 1.246710] CPU0: Thermal monitoring enabled (TM1) [ 1.247745] process: using mwait in idle threads [ 1.248692] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.249690] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.250692] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.251691] Spectre V2 : Mitigation: Retpolines [ 1.252690] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.253690] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.254691] Speculative Store Bypass: Vulnerable [ 1.255696] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.256691] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.257691] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.258694] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.259691] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.260690] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.261691] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.262691] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.275356] Freeing SMP alternatives memory: 40K [ 1.275691] pid_max: default: 32768 minimum: 301 [ 1.276709] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.277695] Yama: becoming mindful. [ 1.278696] SELinux: Initializing. [ 1.279707] LSM support for eBPF active [ 1.280748] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.281728] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.385772] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.387789] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.388703] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.389700] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.390699] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.391691] ... version: 3 [ 1.392691] ... bit width: 48 [ 1.393690] ... generic registers: 4 [ 1.394690] ... value mask: 0000ffffffffffff [ 1.395690] ... max period: 00007fffffffffff [ 1.396690] ... fixed-purpose events: 3 [ 1.397690] ... event mask: 000000070000000f [ 1.398774] signal: max sigframe size: 1776 [ 1.399702] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.400716] rcu: Hierarchical SRCU implementation. [ 1.400717] rcu: Max phase no-delay instances is 400. [ 1.404171] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.404758] smp: Bringing up secondary CPUs ... [ 1.405756] smpboot: x86: Booting SMP configuration: [ 1.405758] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.408947] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.408947] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.408947] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.413733] smp: Brought up 1 node, 8 CPUs [ 1.413733] smpboot: Total of 8 processors activated (55995.32 BogoMIPS) [ 1.455892] node 0 deferred pages initialised in 41ms [ 1.461759] devtmpfs: initialized [ 1.461759] x86/mm: Memory block size: 128MB [ 1.463800] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.463800] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.463800] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.463852] pinctrl core: initialized pinctrl subsystem [ 1.494613] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.494696] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.494700] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.494702] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.494709] audit: initializing netlink subsys (disabled) [ 1.494714] audit: type=2000 audit(1726179149.269:1): state=initialized audit_enabled=0 res=1 [ 1.494788] thermal_sys: Registered thermal governor 'fair_share' [ 1.494789] thermal_sys: Registered thermal governor 'step_wise' [ 1.494790] thermal_sys: Registered thermal governor 'user_space' [ 1.499693] cpuidle: using governor menu [ 1.505711] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.505712] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.505768] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.505778] PCI: Using configuration type 1 for base access [ 1.534721] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.534727] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.534727] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.534727] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.534727] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.542733] cryptd: max_cpu_qlen set to 1000 [ 1.542784] ACPI: Added _OSI(Module Device) [ 1.542785] ACPI: Added _OSI(Processor Device) [ 1.542786] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.542787] ACPI: Added _OSI(Processor Aggregator Device) [ 1.542788] ACPI: Added _OSI(Linux-Dell-Video) [ 1.542789] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.542790] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.573953] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.576123] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.577780] ACPI: Dynamic OEM Table Load: [ 1.591181] ACPI: _OSC evaluated successfully for all CPUs [ 1.591441] ACPI: Interpreter enabled [ 1.591450] ACPI: PM: (supports S0 S4 S5) [ 1.591451] ACPI: Using IOAPIC for interrupt routing [ 1.592949] HEST: Enabling Firmware First mode for corrected errors. [ 1.633356] HEST: Table parsing has been initialized. [ 1.633493] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.633495] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.633496] PCI: Using E820 reservations for host bridge windows [ 1.634108] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.663760] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.663765] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.664885] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.665421] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.665422] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.665449] PCI host bridge to bus 0000:ff [ 1.665451] pci_bus 0000:ff: root bus resource [bus ff] [ 1.665461] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.665505] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.665536] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.665567] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.665598] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.665629] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.665658] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.665688] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.665722] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.665751] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.665781] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.665810] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.665840] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.665870] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.665900] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.665931] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.665960] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.665989] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.666018] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.666040] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.666076] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666139] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666199] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666259] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666319] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666371] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666412] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.666444] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.666477] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666520] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666563] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666605] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666646] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.666678] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.666712] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.666745] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.666779] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666822] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666864] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666906] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.666951] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.666986] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.667017] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.667050] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.667085] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.667116] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.667148] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.667179] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.667214] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.667244] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.667277] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.667308] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.667330] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.667364] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.667395] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.669646] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.669649] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.669785] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.670028] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.670029] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.670442] PCI host bridge to bus 0000:00 [ 1.670443] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.670445] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.670446] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.670447] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.670448] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.670449] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.670450] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.670469] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.670574] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.670585] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.670623] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.670720] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.670731] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.670734] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.670769] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.670860] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.670872] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.670874] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.670876] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.670880] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.670911] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.670998] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671005] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.671084] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671091] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.671168] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671176] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.671250] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671258] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.671333] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671341] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.671416] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671424] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.671499] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671507] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.671582] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671590] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.671662] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671727] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671812] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.671871] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.671877] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.671957] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.672197] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.672216] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.672227] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.672238] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.672250] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.672262] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.672273] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.672330] pci 0000:00:11.4: PME# supported from D3hot [ 1.672412] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.672437] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.672524] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.672615] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.672639] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.672727] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.672795] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.672818] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.672906] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.672991] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.673012] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.673126] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.673208] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.673246] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.673338] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.673441] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.673479] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673483] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.673487] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673575] pci 0000:00:1c.2: PME# d [ 1.673678pe 01 class 0x060400 PCIe Root Port [ 1.673716] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.673721] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.673724] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.673812] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.673920] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.673941] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.674054] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.674136] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.674339] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.674357] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.674367] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.674378] pci 0000:00:1f.2: ] [ 1.674388 0xf040-0xf043] BAR 4 [io 0xf000-0xf01f] [ 1.674409] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.674467] pci 0000:00:1f.2: PME# supported from D3hot [ 1.674528] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.674551] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.674580] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.674747] acpiphp: Slot [1] registered [ 1.674759] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.674863] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.674872] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.674888] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.674892] pci 0000:02:00.0: enabling Extended Tags [ 1.675001] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.675107] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.675117] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.675122] pci 0000:03:00.0: B 1.675132] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.675174] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.675190] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675191] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.675200] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675201] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.675356] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint 1.675366] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.675371] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.675381] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.675386] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.675423] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.675437] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675438] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.675447] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.675447] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.675588] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.675634] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.675731] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.675803] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.675816] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.675822] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.675875] pci 0000:05:00.0: enabling Extended Tags [ 1.676013] pci 0000:05:00.0: supports D1 D2 [ 1.676013] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.676197] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.676285] pci_bus 0000:06: extended config space not accessible [ 1.676318] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.676355] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.676375] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.676395] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.676494] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.676564] pci 0000:06:00.0: supports D1 D2 [ 1.676565] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.676719] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.676869] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.676903] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.676940] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.676957] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.677195] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.677256] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.677257] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.677290] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.677291] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.677635] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.677669] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.677705] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.677724] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.677953] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.678013] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.678014] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.678047] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.678047] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.678358] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.678369] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.679034] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.679066] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.679096] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.679127] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.679157] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.679157] ACPI: PCI: Interrupt link LNKE disabled [ 1.679187] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.679187] ACPI: PCI: Interrupt link LNKF disabled [ 1.679217] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.679218] ACPI: PCI: Interrupt link LNKG disabled [ 1.679248] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.679248] ACPI: PCI: Interrupt link LNKH disabled [ 1.679414] iommu: Default domain type: Translated [ 1.679414] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.679414] SCSI subsystem initialized [ 1.679414] ACPI: bus type USB registered [ 1.679414] usbcore: registered new interface driver usbfs [ 1.679414] usbcore: registered new interface driver hub [ 1.679414] usbcore: registered new device driver usb [ 1.679414] pps_core: LinuxPPS API ver. 1 registered [ 1.679414] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.679414] PTP clock support registered [ 1.679700] EDAC MC: Ver: 3.0.0 [ 1.679849] NetLabel: Initializing [ 1.679850] NetLabel: domain hash size = 128 [ 1.679850] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.679862] NetLabel: unlabeled traffic allowed by default [ 1.679863] PCI: Using ACPI for IRQ routing [ 1.690712] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.690714] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.690714] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.690716] vgaarb: loaded [ 1.690722] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.690726] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.693568] clocksource: Switched to clocksource tsc-early [ 1.703677] VFS: Disk quotas dquot_6.6.0 [ 1.703686] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.703734] pnp: PnP ACPI init [ 1.704050] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.704053] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.704055] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.704056] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.704056] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.704057] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.704059] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.704060] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.704061] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.704062] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.704063] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.704064] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.704064] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.704211] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.704213] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.704214] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.704215] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.704215] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.704878] pnp: PnP ACPI: found 5 devices [ 1.710317] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.710365] NET: Registered PF_INET protocol family [ 1.710531] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.712797] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.712830] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.712837] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.713069] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.713184] TCP: Hash tables configured (established 262144 bind 65536) [ 1.713304] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.713387] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.713444] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.713529] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.713533] NET: Registered PF_XDP protocol family [ 1.713554] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.713565] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.713567] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.713572] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.713574] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.713580] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713581] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713583] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713584] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713585] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713586] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713587] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713588] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713590] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713590] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713592] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713592] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713594] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713595] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713596] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.713597] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.713598] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.713599] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.713601] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.713603] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.713606] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.713620] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.713622] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.713630] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.713651] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.713653] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.713659] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.713668] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.713676] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.713682] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.713688] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.713694] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.713696] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.713703] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.713706] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.713712] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.713713] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.713714] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.713715] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.713716] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.713717] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.713717] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.713719] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.713719] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.713720] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.713721] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.713722] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.713723] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.713724] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.713725] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.713726] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.713726] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.713727] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.713885] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.729683] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15257 usecs [ 1.741680] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11700 usecs [ 1.741695] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.741729] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.741730] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.741735] ACPI: bus type thunderbolt registered [ 1.741737] Trying to unpack rootfs image as initramfs... [ 1.955894] Initialise system trusted keyrings [ 1.955906] Key type blacklist registered [ 1.955947] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.955963] zbud: loaded [ 2.063992] integrity: Platform Keyring initialized [ 2.064001] integrity: Machine keyring initialized [ 2.067353] Freeing initrd memory: 31720K [ 2.072260] NET: Registered PF_ALG protocol family [ 2.072263] xor: automatically using best checksumming function avx [ 2.072266] Key type asymmetric registered [ 2.072267] Asymmetric key parser 'x509' registered [ 2.072268] Running certificate verification selftests [ 2.073415] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 2.073898] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 2.073921] io scheduler mq-deadline registered [ 2.073922] io scheduler kyber registered [ 2.073928] io scheduler bfq registered [ 2.134188] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.134528] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 2.134693] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 2.134838] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 2.134972] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 2.135135] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 2.135281] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 2.135436] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.151713] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 2.160451] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 2.160471] ACPI: button: Power Button [PWRB] [ 2.160492] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.168265] ACPI: button: Power Button [PWRF] [ 2.177286] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.177288] pstore: Registered erst as persistent store backend [ 2.177380] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.177483] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.184837] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.193465] Non-volatile memory driver v1.3 [ 2.201632] rdac: device handler registered [ 2.201656] hp_sw: device handler registered [ 2.201657] emc: device handler registered [ 2.201675] alua: device handler registered [ 2.201939] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.201968] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.201980] ehci-pci 0000:00:1d.0: debug port 2 [ 2.205887] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.212671] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.212709] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.212710] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.212712] usb usb1: Product: EHCI Host Controller [ 2.212713] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.212713] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.212798] hub 1-0:1.0: USB hub found [ 2.212802] hub 1-0:1.0: 2 ports detected [ 2.212928] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.212958] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.214045] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.214292] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.214294] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.214328] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.214330] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.214332] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 2.214348] ehci-pci 0000:00:1a.0: debug port 2 [ 2.214359] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.214361] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.214362] usb usb2: Product: xHCI Host Controller [ 2.214362] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.214363] usb usb2: SerialNumber: 0000:00:14.0 [ 2.214459] hub 2-0:1.0: USB hub found [ 2.214492] hub 2-0:1.0: 15 ports detected [ 2.216249] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.216251] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.216252] usb usb3: Product: xHCI Host Controller [ 2.216253] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.216254] usb usb3: SerialNumber: 0000:00:14.0 [ 2.216316] hub 3-0:1.0: USB hub found [ 2.216333] hub 3-0:1.0: 6 ports detected [ 2.217266] usbcore: registered new interface driver usbserial_generic [ 2.217271] usbserial: USB Serial support registered for generic [ 2.217304] i8042: PNP: No PS/2 controller found. [ 2.217329] mousedev: PS/2 mouse device common for all mice [ 2.217388] rtc_cmos 00:00: RTC can wake from S4 [ 2.217709] rtc_cmos 00:00: registered as rtc0 [ 2.217761] rtc_cmos 00:00: setting system clock to 2024-09-12T22:12:32 UTC (1726179152) [ 2.217786] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.218272] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.218364] intel_pstate: Intel P-state driver initializing [ 2.224669] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.224698] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.224700] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.224701] usb usb4: Product: EHCI Host Controller [ 2.224702] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.224702] usb usb4: SerialNumber: 0000:00:1a.0 [ 2.224776] hub 4-0:1.0: USB hub found [ 2.224780] hub 4-0:1.0: 2 ports detected [ 2.243354] hid: raw HID events driver (C) Jiri Kosina [ 2.243385] usbcore: registered new interface driver usbhid [ 2.243386] usbhid: USB HID core driver [ 2.243406] drop_monitor: Initializing network drop monitor service [ 2.252877] Initializing XFRM netlink socket [ 2.252894] NET: Registered PF_INET6 protocol family [ 2.257970] Segment Routing with IPv6 [ 2.257986] NET: Registered PF_PACKET protocol family [ 2.258011] mpls_gso: MPLS GSO support [ 2.267608] microcode: Current revision: 0x0b00001b [ 2.283153] resctrl: L3 allocation detected [ 2.283155] resctrl: L3 monitoring detected [ 2.283172] IPI shorthand broadcast: enabled [ 2.283176] AVX2 version of gcm_enc/dec engaged. [ 2.324497] AES CTR mode by8 optimization enabled [ 2.324538] sched_clock: Marking stable (1151000459, 1172638374)->(2715293372, -391654539) [ 2.339609] registered taskstats version 1 [ 2.354661] Loading compiled-in X.509 certificates [ 2.355153] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.355433] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.355712] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.355854] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.355864] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.357594] page_owner is disabled [ 2.357791] pstore: Using crash dump compression: deflate [ 2.357801] Key type big_key registered [ 2.451671] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.460673] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.467644] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.476946] Key type encrypted registered [ 2.476953] ima: No TPM chip found, activating TPM-bypass! [ 2.476956] Loading compiled-in module X.509 certificates [ 2.477244] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.477247] ima: Allocated hash algorithm: sha256 [ 2.477255] ima: No architecture policies found [ 2.477262] evm: Initialising EVM extended attributes: [ 2.477263] evm: security.selinux [ 2.477263] evm: security.SMACK64 (disabled) [ 2.477264] evm: security.SMACK64EXEC (disabled) [ 2.477264] evm: security.SMACK64TRANSMUTE (disabled) [ 2.477265] evm: security.SMACK64MMAP (disabled) [ 2.477265] evm: security.apparmor (disabled) [ 2.477265] evm: security.ima [ 2.477266] evm: security.capability [ 2.477266] evm: HMAC attrs: 0x1 [ 2.580085] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.580088] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.580241] hub 1-1:1.0: USB hub found [ 2.580335] hub 1-1:1.0: 8 ports detected [ 2.588861] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.588864] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.589278] hub 2-12:1.0: USB hub found [ 2.589366] hub 2-12:1.0: 4 ports detected [ 2.596084] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.596087] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.596237] hub 4-1:1.0: USB hub found [ 2.596334] hub 4-1:1.0: 6 ports detected [ 2.793666] tsc: Refined TSC clocksource calibration: 3499.992 MHz [ 2.793670] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns [ 2.799643] clocksource: Switched to clocksource tsc [ 2.885679] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.990020] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.990022] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.994948] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.046749] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.049399] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.049449] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.193887] clk: Disabling unused clocks [ 5.198707] Freeing unused decrypted memory: 2028K [ 5.203949] Freeing unused kernel image (initmem) memory: 3980K [ 5.203999] Write protecting the kernel read-only data: 30720k [ 5.215975] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.260340] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.260342] x86/mm: Checking user space page tables [ 5.296975] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.296983] Run /init as init process [ 5.309780] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.309887] systemd[1]: Detected architecture x86-64. [ 5.309889] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.360747] systemd[1]: Hostname set to . [ 5.418019] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.418128] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.439739] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.453802] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.465782] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.476724] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ OK [[ 5.488834] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ 5.503777] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.517976] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ OK [[ 5.529973] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ 5.543756] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.556777] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.575311] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.590771] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.603354] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.616279] systemd[1]: Starting Create System Users... Starting Creat[ 5.622998] fuse: init (API version 7.36) e System Users... [ 5.633275] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.646408] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 6.055555] dca service started, version 1.12.1 [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reached target [0;1[ 6.090357] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode ;39mPath Units[[ 6.090362] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 6.090365] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst 0m. [ [ 6.101732] scsi host0: ahci [ 6.101916] scsi host1: ahci OK ] Reache[ 6.102044] scsi host2: ahci [ 6.102141] scsi host3: ahci d target [0;1;3[ 6.102185] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 41 lpm-pol 0 9mBasic System[[ 6.102188] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 41 lpm-pol 0 [ 6.102190] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 41 lpm-pol 0 [ 6.102193] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 41 lpm-pol 0 [ 6.102476] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode 0m. [ 6.102479] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 6.102481] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.128739] scsi host4: ahci [ 6.128930] scsi host5: ahci [ 6.129310] scsi host6: ahci [ 6.129488] scsi host7: ahci [ 6.129865] scsi host8: ahci [ 6.130033] scsi host9: ahci [ 6.130078] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 42 lpm-pol 0 [ 6.130081] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 42 lpm-pol 0 [ 6.130082] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 42 lpm-pol 0 [ 6.130085] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 42 lpm-pol 0 [ 6.130088] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 42 lpm-pol 0 [ 6.130090] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 42 lpm-pol 0 [ 6.220857] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.220859] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.265156] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.265161] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.275849] igb 0000:07:00.0: added PHC on eth0 [ 6.275877] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.275878] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 6.275954] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.275955] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.308467] nvme nvme0: pci function 0000:02:00.0 [ 6.310154] nvme nvme0: 8/0/0 default/read/poll queues [ 6.318325] ACPI: bus type drm_connector registered [ 6.329135] igb 0000:07:00.1: added PHC on eth1 [ 6.329161] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.329162] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 6.329239] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.329240] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.415227] ata3: SATA link down (SStatus 0 SControl 300) [ 6.415262] ata2: SATA link down (SStatus 0 SControl 300) [ 6.415290] ata1: SATA link down (SStatus 0 SControl 300) [ 6.415316] ata4: SATA link down (SStatus 0 SControl 300) [ 6.439209] ata6: SATA link down (SStatus 0 SControl 300) [ 6.439315] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.439365] ata7: SATA link down (SStatus 0 SControl 300) [ 6.439389] ata10: SATA link down (SStatus 0 SControl 300) [ 6.439409] ata9: SATA link down (SStatus 0 SControl 300) [ 6.439430] ata8: SATA link down (SStatus 0 SControl 300) [ 6.440322] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.440811] ata5.00: NCQ Send/Recv Log not supported [ 6.440812] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.442180] ata5.00: NCQ Send/Recv Log not supported [ 6.442184] ata5.00: configured for UDMA/133 [ 6.442310] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.458460] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.513716] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.513877] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.530003] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.530020] sd 4:0:0:0: [sda] Write Protect is off [ 6.530044] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.530072] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.542967] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.545318] sda: sda1 [ 6.545417] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.554572] Console: switching to colour dummy device 80x25 [ 6.554723] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.554725] ast 0000:06:00.0: AST 2400 detected [ 6.554778] ast 0000:06:00.0: [drm] Using analog VGA [ 6.554787] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.558021] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.563842] fbcon: astdrmfb (fb0) is primary device [ 6.594008] Console: switching to colour frame buffer device 128x48 [ 6.611892] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.407044] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.407336] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.407419] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.407420] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 7.409676] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.566997] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.567286] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.567369] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.567370] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 7.570365] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.586584] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.615534] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.843257] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root[ 8.190917] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). ... [ 8.727806] SELinux: policy capability network_peer_controls=1 [ 8.727813] SELinux: policy capability open_perms=1 [ 8.727815] SELinux: policy capability extended_socket_class=1 [ 8.727815] SELinux: policy capability always_check_network=0 [ 8.727816] SELinux: policy capability cgroup_seclabel=1 [ 8.727817] SELinux: policy capability nnp_nosuid_transition=1 [ 8.727818] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.771989] audit: type=1403 audit(1726179159.052:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.774598] systemd[1]: Successfully loaded SELinux policy in 125.014ms. [ 8.841628] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.318ms. [ 8.853386] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.853520] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.793660] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.793787] systemd[1]: Stopped Switch Root. [ 9.801195] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.801589] systemd[1]: Created slice Slice /system/getty. [ 9.805544] systemd[1]: Created slice Slice /system/modprobe. [ 9.814384] systemd[1]: Created slice Slice /system/serial-getty. [ 9.819788] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.825495] systemd[1]: Created slice User and Session Slice. [ 9.831345] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.831449] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.837699] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.843088] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.858699] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.865557] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.874929] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.885261] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.895608] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.905924] systemd[1]: Reached target Local Encrypted Volumes. [ 9.916263] systemd[1]: Stopped target Switch Root. [ 9.926931] systemd[1]: Stopped target Initrd File Systems. [ 9.937870] systemd[1]: Stopped target Initrd Root File System. [ 9.943776] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.948668] systemd[1]: Reached target Path Units. [ OK [[ 9.954215] systemd[1]: Reached target Slice Units. [ 9.960127] systemd[1]: Reached target Swaps. [ 9.966904] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.972061] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.978900] systemd[1]: Listening on LVM2 poll daemon socket. 0m] Stopped Switch Root. [ OK ] Crea[ 10.005894] systemd[1]: Listening on RPCbind Server Activation Socket. ted slice [0;1;[ 10.013260] systemd[1]: Reached target RPC Port Mapper. 39mSlice /system/getty. [[ 10.021151] systemd[1]: Listening on Process Core Dump Socket. [ 10.021287] systemd[1]: Listening on initctl Compatibility Named Pipe. [0;32m OK [ 10.035957] systemd[1]: Listening on udev Control Socket. [ 10.036210] systemd[1]: Listening on udev Kernel Socket. ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 10.055738] systemd[1]: Mounting Huge Pages File System... serial-getty[ 10.063217] systemd[1]: Mounting POSIX Message Queue File System... . [ OK[ 10.070634] systemd[1]: Mounting Kernel Debug File System... ] Created [ 10.077684] systemd[1]: Mounting Kernel Trace File System... slice S[ 10.084038] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Sta[ 10.109473] systemd[1]: Starting Create List of Static Device Nodes... [ 10.110542] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... rted Fo[ 10.117324] systemd[1]: Starting Load Kernel Module configfs... [ 10.127551] systemd[1]: Starting Load Kernel Module drm... [ 10.134794] systemd[1]: Starting Load Kernel Module fuse... rward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK [ 10.159060] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... ] Reached t[ 10.168495] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.168547] systemd[1]: Stopped Plymouth switch root service. [ 10.177250] systemd[1]: Stopped Journal Service. arget c[ 10.188050] systemd[1]: Starting Journal Service... [ 10.192804] systemd[1]: Starting Load Kernel Modules... [ 10.194552] systemd[1]: Starting Generate network units from Kernel command line... [ 10.198985] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.200170] systemd[1]: Starting Remount Root and Kernel File Systems... eph target allow[ 10.206631] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.207447] systemd[1]: Starting Coldplug All udev Devices... [ 10.226758] systemd[1]: Mounted Huge Pages File System. [ 10.231993] systemd[1]: Mounted POSIX Message Queue File System. [ 10.242706] systemd[1]: Mounted Kernel Debug File System. [ 10.248415] systemd[1]: Mounted Kernel Trace File System. [ 10.253856] systemd[1]: Finished Create List of Static Device Nodes. [ 10.259854] systemd[1]: Finished Read and set NIS domainname from /etc/sysconfig/network. [ 10.265170] systemd[1]: Finished Generate network units from Kernel command line. in…eph-mon@.se[ 10.270472] systemd[1]: Started Journal Service. [ 10.283720] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. rvice instances at once. [ OK ] Reached target ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph-mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances [ 10.344683] systemd-journald[581]: Received client request to flush runtime journal. at once. [ OK [0[ 10.356223] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.356248] device-mapper: uevent: version 1.0.3 m] Reached targe[ 10.356357] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com t ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Started Journal Service. [ OK ] Reached target Preparation for Network. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module c[ 10.836633] IPMI message handler: version 39.2 onfigfs. [ OK [0[ 10.844675] ipmi device interface m] Finished Load Kernel Module fuse. [ 10.855875] ipmi_si: IPMI System Interface driver [ 10.855899] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.855902] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.855904] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.855980] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.856066] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.857107] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ OK [[ 10.857111] ipmi_si: Adding ACPI-specified kcs state machine 0m] Finished [0[ 10.857196] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 ;1;39mTell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader[ 10.929497] ioatdma: Intel(R) QuickData Technology Driver 5.00 Update. [ 10.931655] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.940563] igb 0000:07:00.0: DCA enabled [ 10.940582] igb 0000:07:00.1: DCA enabled [ 10.958042] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.968832] power_meter ACPI000D:00: Found ACPI power meter. [ 10.968856] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.968863] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.996879] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 11.004106] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.005202] i2c i2c-3: 2/8 memory slots populated (from DMI) [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... [ 11.036057] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.036651] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.064707] ipmi_ssif: IPMI SSIF Interface driver Starting RPC Bind... [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ 11.094378] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.094383] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.094387] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.113909] iTCO_vendor_support: vendor-support=0 [ 11.121035] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.121241] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ OK ] Started RPC Bind. [ 11.438631] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.438637] EDAC sbridge: Ver: 1.1.2 [ 11.482874] RPC: Registered named UNIX socket transport module. [ 11.482880] RPC: Registered udp transport module. [ 11.482884] RPC: Registered tcp transport module. [ 11.482885] RPC: Registered tcp-with-tls transport module. [ 11.482886] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Security Auditing Service. [ 11.653385] intel_rapl_common: Found RAPL domain package [ 11.653395] intel_rapl_common: Found RAPL domain dram Starting Record System Boot/Shutdown in UTMP... [ 11.671537] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.679794] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 [ 11.679906] XFS (dm-4): Mounting V4 Filesystem 85701639-ca36-424b-9085-47d40ccac6f9 [ 11.684574] XFS (dm-4): Ending clean mount [ 11.684617] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.277177] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.436005] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.661773] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK [ 13.849725] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.849835] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (6s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.164 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... [ 20.561842] block sda: the capability attribute has been deprecated. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.164 smithi164.front.sepia.ceph.com smithi164/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi164 login: [disconnect] 2024-09-12T22:12:57.385 INFO:teuthology.misc:Re-opening connections... 2024-09-12T22:12:57.385 INFO:teuthology.misc:trying to connect to ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:12:57.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:12:57.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:12:57.656 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-12T22:12:58.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-12T22:12:58.237 DEBUG:teuthology.misc:waited 0.8525307178497314 2024-09-12T22:12:59.238 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:12:59.239 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi164.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-09-12T22:12:59.239 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T22:12:59.343 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:12:59.551 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T22:12:59.551 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T22:12:59.554 INFO:tasks.ceph.osd.2:Started 2024-09-12T22:12:59.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:12:59.745 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-12T22:12:59.748 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:12:59.748 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-12T22:13:01.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T22:13:01.397 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:13:01.396+0000 7f0adffb0640 -1 Falling back to public interface 2024-09-12T22:13:04.749 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:no valid command found; 10 closest matches: 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:0 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:1 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:2 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:abort 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:assert 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:config diff 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:config diff get 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:config get 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:config help [] 2024-09-12T22:13:04.849 INFO:teuthology.orchestra.run.smithi164.stderr:config set ... 2024-09-12T22:13:04.850 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: invalid command 2024-09-12T22:13:04.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:13:04.852 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-12T22:13:05.337 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:13:05.336+0000 7f0adffb0640 -1 osd.2 30 log_to_monitors true 2024-09-12T22:13:05.738 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-12T22:13:05.737+0000 7f0ad3d5f640 -1 osd.2 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:13:09.853 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:13:09.962 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "MOSDPGRecoveryDelete(4.31 e67,65 4:8e46e186:::10000000cfb.00000000:head,56'333)", 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-09-12T22:13:09.961924+0000", 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.2994e-05, 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8873e-05, 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-09-12T22:13:09.963 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "queued for pg", 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:13:09.961924+0000", 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:13:09.961924+0000", 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:13:09.964 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:13:09.961925+0000", 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6499999999999999e-07 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:13:09.961928+0000", 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0189999999999998e-06 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:13:09.965 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:13:09.961935+0000", 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5059999999999998e-06 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-09-12T22:13:09.961940+0000", 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3140000000000003e-06 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-09-12T22:13:09.966 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 1 2024-09-12T22:13:09.967 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-12T22:13:14.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T22:13:15.107 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a: {} 2024-09-12T22:13:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:13:15.115 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b: {} 2024-09-12T22:13:15.116 INFO:teuthology.orchestra.run.smithi019.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:13:15.125 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c: {} 2024-09-12T22:13:15.125 INFO:teuthology.orchestra.run.smithi019.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:13:15.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T22:13:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T22:13:15.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T22:13:16.785 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T22:13:16.803 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T22:13:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T22:13:17.804 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T22:13:18.778 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T22:13:18.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T22:13:19.781 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T22:13:19.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T22:13:20.780 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T22:13:20.796 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T22:13:20.796 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T22:13:20.796 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T22:13:20.796 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T22:13:20.796 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:13:20.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:13:21.094 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:21.094 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:13:20.775043+0000","last_up_change":"2024-09-12T22:13:06.714165+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":64,"up_thru":77,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6801","nonce":29356918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6803","nonce":29356918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6807","nonce":29356918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6805","nonce":29356918}]},"public_addr":"172.21.15.164:6801/29356918","cluster_addr":"172.21.15.164:6803/29356918","heartbeat_back_addr":"172.21.15.164:6807/29356918","heartbeat_front_addr":"172.21.15.164:6805/29356918","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":30}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":0,"to":1}]},{"pgid":"3.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.a","mappings":[{"from":1,"to":2}]},{"pgid":"3.16","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":1,"to":0}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.1a","mappings":[{"from":0,"to":2}]},{"pgid":"4.20","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.5","osds":[1]},{"pgid":"4.9","osds":[0]},{"pgid":"4.10","osds":[0]},{"pgid":"4.1a","osds":[1]},{"pgid":"4.20","osds":[1]},{"pgid":"4.32","osds":[1]},{"pgid":"4.3f","osds":[0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:13:21.108 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:13:21.108 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:13:21.401 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:21.401 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":78,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:13:20.775043+0000","last_up_change":"2024-09-12T22:13:06.714165+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":64,"up_thru":77,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6801","nonce":29356918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6803","nonce":29356918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6807","nonce":29356918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6805","nonce":29356918}]},"public_addr":"172.21.15.164:6801/29356918","cluster_addr":"172.21.15.164:6803/29356918","heartbeat_back_addr":"172.21.15.164:6807/29356918","heartbeat_front_addr":"172.21.15.164:6805/29356918","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":30}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":0,"to":1}]},{"pgid":"3.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.a","mappings":[{"from":1,"to":2}]},{"pgid":"3.16","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":1,"to":0}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.1a","mappings":[{"from":0,"to":2}]},{"pgid":"4.20","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.5","osds":[1]},{"pgid":"4.9","osds":[0]},{"pgid":"4.10","osds":[0]},{"pgid":"4.1a","osds":[1]},{"pgid":"4.20","osds":[1]},{"pgid":"4.32","osds":[1]},{"pgid":"4.3f","osds":[0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:13:21.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:13:21.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:13:21.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:13:21.559 INFO:teuthology.orchestra.run.smithi019.stdout:34359738417 2024-09-12T22:13:21.559 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:13:21.564 INFO:teuthology.orchestra.run.smithi019.stdout:34359738417 2024-09-12T22:13:21.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:13:21.565 INFO:teuthology.orchestra.run.smithi019.stdout:274877906949 2024-09-12T22:13:21.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:13:21.862 INFO:teuthology.orchestra.run.smithi019.stdout:34359738416 2024-09-12T22:13:21.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738416 for osd.0 2024-09-12T22:13:21.907 INFO:teuthology.orchestra.run.smithi019.stdout:274877906948 2024-09-12T22:13:21.916 INFO:teuthology.orchestra.run.smithi019.stdout:34359738416 2024-09-12T22:13:21.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906949 got 274877906948 for osd.2 2024-09-12T22:13:21.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738416 for osd.1 2024-09-12T22:13:22.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:13:22.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:13:22.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:13:23.193 INFO:teuthology.orchestra.run.smithi019.stdout:34359738416 2024-09-12T22:13:23.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738416 for osd.0 2024-09-12T22:13:23.237 INFO:teuthology.orchestra.run.smithi019.stdout:274877906948 2024-09-12T22:13:23.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906949 got 274877906948 for osd.2 2024-09-12T22:13:23.272 INFO:teuthology.orchestra.run.smithi019.stdout:34359738416 2024-09-12T22:13:23.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738416 for osd.1 2024-09-12T22:13:24.208 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:13:24.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:13:24.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:13:24.548 INFO:teuthology.orchestra.run.smithi019.stdout:34359738417 2024-09-12T22:13:24.554 INFO:teuthology.orchestra.run.smithi019.stdout:274877906949 2024-09-12T22:13:24.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738417 for osd.0 2024-09-12T22:13:24.562 DEBUG:teuthology.parallel:result is None 2024-09-12T22:13:24.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906949 got 274877906949 for osd.2 2024-09-12T22:13:24.568 DEBUG:teuthology.parallel:result is None 2024-09-12T22:13:24.617 INFO:teuthology.orchestra.run.smithi019.stdout:34359738417 2024-09-12T22:13:24.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738417 got 34359738417 for osd.1 2024-09-12T22:13:24.630 DEBUG:teuthology.parallel:result is None 2024-09-12T22:13:24.630 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T22:13:24.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:24.929 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:24.931 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:24.939 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-12T22:13:24.778764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":384,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7184,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":301576,"kb_used_data":72964,"kb_used_omap":9,"kb_used_meta":228534,"kb_avail":282813944,"statfs":{"total":289910292480,"available":289601478656,"internally_reserved":0,"allocated":74715136,"data_stored":256743111,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":234019828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1625,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001124"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":594,"reported_epoch":78,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T22:13:20.780164+0000","last_change":"2024-09-12T22:13:08.831030+0000","last_active":"2024-09-12T22:13:20.780164+0000","last_peered":"2024-09-12T22:13:20.780164+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:13:08.829847+0000","last_became_peered":"2024-09-12T22:13:08.829847+0000","last_unstale":"2024-09-12T22:13:20.780164+0000","last_undegraded":"2024-09-12T22:13:08.741073+0000","last_fullsized":"2024-09-12T22:13:08.735993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":522,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786359+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:20.786359+0000","last_peered":"2024-09-12T22:13:20.786359+0000","last_clean":"2024-09-12T22:13:20.786359+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:20.786359+0000","last_undegraded":"2024-09-12T22:13:20.786359+0000","last_fullsized":"2024-09-12T22:13:20.786359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":864,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836163+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:23.836163+0000","last_peered":"2024-09-12T22:13:23.836163+0000","last_clean":"2024-09-12T22:13:23.836163+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:23.836163+0000","last_undegraded":"2024-09-12T22:13:23.836163+0000","last_fullsized":"2024-09-12T22:13:23.836163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":597,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835507+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:23.835507+0000","last_peered":"2024-09-12T22:13:23.835507+0000","last_clean":"2024-09-12T22:13:23.835507+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:23.835507+0000","last_undegraded":"2024-09-12T22:13:23.835507+0000","last_fullsized":"2024-09-12T22:13:23.835507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":615,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785728+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:20.785728+0000","last_peered":"2024-09-12T22:13:20.785728+0000","last_clean":"2024-09-12T22:13:20.785728+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:20.785728+0000","last_undegraded":"2024-09-12T22:13:20.785728+0000","last_fullsized":"2024-09-12T22:13:20.785728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":594,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835004+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:23.835004+0000","last_peered":"2024-09-12T22:13:23.835004+0000","last_clean":"2024-09-12T22:13:23.835004+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:23.835004+0000","last_undegraded":"2024-09-12T22:13:23.835004+0000","last_fullsized":"2024-09-12T22:13:23.835004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":684,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.834996+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:23.834996+0000","last_peered":"2024-09-12T22:13:23.834996+0000","last_clean":"2024-09-12T22:13:23.834996+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:23.834996+0000","last_undegraded":"2024-09-12T22:13:23.834996+0000","last_fullsized":"2024-09-12T22:13:23.834996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835812+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:23.835812+0000","last_peered":"2024-09-12T22:13:23.835812+0000","last_clean":"2024-09-12T22:13:23.835812+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:23.835812+0000","last_undegraded":"2024-09-12T22:13:23.835812+0000","last_fullsized":"2024-09-12T22:13:23.835812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":980,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777689+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:23.777689+0000","last_peered":"2024-09-12T22:13:23.777689+0000","last_clean":"2024-09-12T22:13:23.777689+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:23.777689+0000","last_undegraded":"2024-09-12T22:13:23.777689+0000","last_fullsized":"2024-09-12T22:13:23.777689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":518,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786269+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:20.786269+0000","last_peered":"2024-09-12T22:13:20.786269+0000","last_clean":"2024-09-12T22:13:20.786269+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:20.786269+0000","last_undegraded":"2024-09-12T22:13:20.786269+0000","last_fullsized":"2024-09-12T22:13:20.786269+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":547,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836207+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:23.836207+0000","last_peered":"2024-09-12T22:13:23.836207+0000","last_clean":"2024-09-12T22:13:23.836207+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:23.836207+0000","last_undegraded":"2024-09-12T22:13:23.836207+0000","last_fullsized":"2024-09-12T22:13:23.836207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":477,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786393+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:20.786393+0000","last_peered":"2024-09-12T22:13:20.786393+0000","last_clean":"2024-09-12T22:13:20.786393+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:20.786393+0000","last_undegraded":"2024-09-12T22:13:20.786393+0000","last_fullsized":"2024-09-12T22:13:20.786393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":567,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785922+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:20.785922+0000","last_peered":"2024-09-12T22:13:20.785922+0000","last_clean":"2024-09-12T22:13:20.785922+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:20.785922+0000","last_undegraded":"2024-09-12T22:13:20.785922+0000","last_fullsized":"2024-09-12T22:13:20.785922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":938,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835035+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:23.835035+0000","last_peered":"2024-09-12T22:13:23.835035+0000","last_clean":"2024-09-12T22:13:23.835035+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:23.835035+0000","last_undegraded":"2024-09-12T22:13:23.835035+0000","last_fullsized":"2024-09-12T22:13:23.835035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1037,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835074+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:23.835074+0000","last_peered":"2024-09-12T22:13:23.835074+0000","last_clean":"2024-09-12T22:13:23.835074+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:23.835074+0000","last_undegraded":"2024-09-12T22:13:23.835074+0000","last_fullsized":"2024-09-12T22:13:23.835074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835931+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:23.835931+0000","last_peered":"2024-09-12T22:13:23.835931+0000","last_clean":"2024-09-12T22:13:23.835931+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:23.835931+0000","last_undegraded":"2024-09-12T22:13:23.835931+0000","last_fullsized":"2024-09-12T22:13:23.835931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":937,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778204+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:23.778204+0000","last_peered":"2024-09-12T22:13:23.778204+0000","last_clean":"2024-09-12T22:13:23.778204+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:23.778204+0000","last_undegraded":"2024-09-12T22:13:23.778204+0000","last_fullsized":"2024-09-12T22:13:23.778204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":525,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786234+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:20.786234+0000","last_peered":"2024-09-12T22:13:20.786234+0000","last_clean":"2024-09-12T22:13:20.786234+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:20.786234+0000","last_undegraded":"2024-09-12T22:13:20.786234+0000","last_fullsized":"2024-09-12T22:13:20.786234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":974,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777724+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:23.777724+0000","last_peered":"2024-09-12T22:13:23.777724+0000","last_clean":"2024-09-12T22:13:23.777724+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:23.777724+0000","last_undegraded":"2024-09-12T22:13:23.777724+0000","last_fullsized":"2024-09-12T22:13:23.777724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":615,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835644+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:23.835644+0000","last_peered":"2024-09-12T22:13:23.835644+0000","last_clean":"2024-09-12T22:13:23.835644+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:23.835644+0000","last_undegraded":"2024-09-12T22:13:23.835644+0000","last_fullsized":"2024-09-12T22:13:23.835644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":667,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835263+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:23.835263+0000","last_peered":"2024-09-12T22:13:23.835263+0000","last_clean":"2024-09-12T22:13:23.835263+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:23.835263+0000","last_undegraded":"2024-09-12T22:13:23.835263+0000","last_fullsized":"2024-09-12T22:13:23.835263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":595,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787110+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:20.787110+0000","last_peered":"2024-09-12T22:13:20.787110+0000","last_clean":"2024-09-12T22:13:20.787110+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:20.787110+0000","last_undegraded":"2024-09-12T22:13:20.787110+0000","last_fullsized":"2024-09-12T22:13:20.787110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.776887+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:23.776887+0000","last_peered":"2024-09-12T22:13:23.776887+0000","last_clean":"2024-09-12T22:13:23.776887+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:23.776887+0000","last_undegraded":"2024-09-12T22:13:23.776887+0000","last_fullsized":"2024-09-12T22:13:23.776887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":552,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-12T22:13:20.785771+0000","last_change":"2024-09-12T22:13:20.785771+0000","last_active":"2024-09-12T22:13:07.722596+0000","last_peered":"2024-09-12T22:13:05.716300+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:10:32.246451+0000","last_became_peered":"2024-09-12T22:10:32.246451+0000","last_unstale":"2024-09-12T22:13:20.785771+0000","last_undegraded":"2024-09-12T22:13:20.785771+0000","last_fullsized":"2024-09-12T22:13:20.785771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":510,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786254+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:20.786254+0000","last_peered":"2024-09-12T22:13:20.786254+0000","last_clean":"2024-09-12T22:13:20.786254+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:20.786254+0000","last_undegraded":"2024-09-12T22:13:20.786254+0000","last_fullsized":"2024-09-12T22:13:20.786254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":657,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777867+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:23.777867+0000","last_peered":"2024-09-12T22:13:23.777867+0000","last_clean":"2024-09-12T22:13:23.777867+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:23.777867+0000","last_undegraded":"2024-09-12T22:13:23.777867+0000","last_fullsized":"2024-09-12T22:13:23.777867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":868,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836292+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:23.836292+0000","last_peered":"2024-09-12T22:13:23.836292+0000","last_clean":"2024-09-12T22:13:23.836292+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:23.836292+0000","last_undegraded":"2024-09-12T22:13:23.836292+0000","last_fullsized":"2024-09-12T22:13:23.836292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":537,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786370+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:20.786370+0000","last_peered":"2024-09-12T22:13:20.786370+0000","last_clean":"2024-09-12T22:13:20.786370+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:20.786370+0000","last_undegraded":"2024-09-12T22:13:20.786370+0000","last_fullsized":"2024-09-12T22:13:20.786370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":977,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777457+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:23.777457+0000","last_peered":"2024-09-12T22:13:23.777457+0000","last_clean":"2024-09-12T22:13:23.777457+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:23.777457+0000","last_undegraded":"2024-09-12T22:13:23.777457+0000","last_fullsized":"2024-09-12T22:13:23.777457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":627,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787027+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:20.787027+0000","last_peered":"2024-09-12T22:13:20.787027+0000","last_clean":"2024-09-12T22:13:20.787027+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:20.787027+0000","last_undegraded":"2024-09-12T22:13:20.787027+0000","last_fullsized":"2024-09-12T22:13:20.787027+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.776914+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:23.776914+0000","last_peered":"2024-09-12T22:13:23.776914+0000","last_clean":"2024-09-12T22:13:23.776914+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:23.776914+0000","last_undegraded":"2024-09-12T22:13:23.776914+0000","last_fullsized":"2024-09-12T22:13:23.776914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":994,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-12T22:13:23.713319+0000","last_change":"2024-09-12T22:13:23.835234+0000","last_active":"2024-09-12T22:13:23.835234+0000","last_peered":"2024-09-12T22:13:23.713319+0000","last_clean":"2024-09-12T22:13:05.717151+0000","last_became_active":"2024-09-12T22:13:08.827687+0000","last_became_peered":"2024-09-12T22:13:08.827687+0000","last_unstale":"2024-09-12T22:13:23.713319+0000","last_undegraded":"2024-09-12T22:13:23.713319+0000","last_fullsized":"2024-09-12T22:13:08.735102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":552,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786299+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:20.786299+0000","last_peered":"2024-09-12T22:13:20.786299+0000","last_clean":"2024-09-12T22:13:20.786299+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:20.786299+0000","last_undegraded":"2024-09-12T22:13:20.786299+0000","last_fullsized":"2024-09-12T22:13:20.786299+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":450,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835628+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:23.835628+0000","last_peered":"2024-09-12T22:13:23.835628+0000","last_clean":"2024-09-12T22:13:23.835628+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:23.835628+0000","last_undegraded":"2024-09-12T22:13:23.835628+0000","last_fullsized":"2024-09-12T22:13:23.835628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":553,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785940+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:20.785940+0000","last_peered":"2024-09-12T22:13:20.785940+0000","last_clean":"2024-09-12T22:13:20.785940+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:20.785940+0000","last_undegraded":"2024-09-12T22:13:20.785940+0000","last_fullsized":"2024-09-12T22:13:20.785940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":197,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777137+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:23.777137+0000","last_peered":"2024-09-12T22:13:23.777137+0000","last_clean":"2024-09-12T22:13:23.777137+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:23.777137+0000","last_undegraded":"2024-09-12T22:13:23.777137+0000","last_fullsized":"2024-09-12T22:13:23.777137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778165+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:23.778165+0000","last_peered":"2024-09-12T22:13:23.778165+0000","last_clean":"2024-09-12T22:13:23.778165+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:23.778165+0000","last_undegraded":"2024-09-12T22:13:23.778165+0000","last_fullsized":"2024-09-12T22:13:23.778165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785963+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:20.785963+0000","last_peered":"2024-09-12T22:13:20.785963+0000","last_clean":"2024-09-12T22:13:20.785963+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:20.785963+0000","last_undegraded":"2024-09-12T22:13:20.785963+0000","last_fullsized":"2024-09-12T22:13:20.785963+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777734+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:23.777734+0000","last_peered":"2024-09-12T22:13:23.777734+0000","last_clean":"2024-09-12T22:13:23.777734+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:23.777734+0000","last_undegraded":"2024-09-12T22:13:23.777734+0000","last_fullsized":"2024-09-12T22:13:23.777734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":217,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835978+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:23.835978+0000","last_peered":"2024-09-12T22:13:23.835978+0000","last_clean":"2024-09-12T22:13:23.835978+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:23.835978+0000","last_undegraded":"2024-09-12T22:13:23.835978+0000","last_fullsized":"2024-09-12T22:13:23.835978+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":309,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836633+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:23.836633+0000","last_peered":"2024-09-12T22:13:23.836633+0000","last_clean":"2024-09-12T22:13:23.836633+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:23.836633+0000","last_undegraded":"2024-09-12T22:13:23.836633+0000","last_fullsized":"2024-09-12T22:13:23.836633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":522,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786247+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:20.786247+0000","last_peered":"2024-09-12T22:13:20.786247+0000","last_clean":"2024-09-12T22:13:20.786247+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:20.786247+0000","last_undegraded":"2024-09-12T22:13:20.786247+0000","last_fullsized":"2024-09-12T22:13:20.786247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":330,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786098+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:20.786098+0000","last_peered":"2024-09-12T22:13:20.786098+0000","last_clean":"2024-09-12T22:13:20.786098+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:20.786098+0000","last_undegraded":"2024-09-12T22:13:20.786098+0000","last_fullsized":"2024-09-12T22:13:20.786098+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":575,"reported_epoch":78,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T22:13:20.779113+0000","last_change":"2024-09-12T22:13:09.232257+0000","last_active":"2024-09-12T22:13:20.779113+0000","last_peered":"2024-09-12T22:13:20.779113+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:13:08.796593+0000","last_became_peered":"2024-09-12T22:13:08.796593+0000","last_unstale":"2024-09-12T22:13:20.779113+0000","last_undegraded":"2024-09-12T22:13:09.232125+0000","last_fullsized":"2024-09-12T22:13:08.724199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":204,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":625,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836424+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:23.836424+0000","last_peered":"2024-09-12T22:13:23.836424+0000","last_clean":"2024-09-12T22:13:23.836424+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:23.836424+0000","last_undegraded":"2024-09-12T22:13:23.836424+0000","last_fullsized":"2024-09-12T22:13:23.836424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835204+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:23.835204+0000","last_peered":"2024-09-12T22:13:23.835204+0000","last_clean":"2024-09-12T22:13:23.835204+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:23.835204+0000","last_undegraded":"2024-09-12T22:13:23.835204+0000","last_fullsized":"2024-09-12T22:13:23.835204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835943+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:23.835943+0000","last_peered":"2024-09-12T22:13:23.835943+0000","last_clean":"2024-09-12T22:13:23.835943+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:23.835943+0000","last_undegraded":"2024-09-12T22:13:23.835943+0000","last_fullsized":"2024-09-12T22:13:23.835943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777333+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:23.777333+0000","last_peered":"2024-09-12T22:13:23.777333+0000","last_clean":"2024-09-12T22:13:23.777333+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:23.777333+0000","last_undegraded":"2024-09-12T22:13:23.777333+0000","last_fullsized":"2024-09-12T22:13:23.777333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":310,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777904+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:23.777904+0000","last_peered":"2024-09-12T22:13:23.777904+0000","last_clean":"2024-09-12T22:13:23.777904+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:23.777904+0000","last_undegraded":"2024-09-12T22:13:23.777904+0000","last_fullsized":"2024-09-12T22:13:23.777904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":667,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835751+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:23.835751+0000","last_peered":"2024-09-12T22:13:23.835751+0000","last_clean":"2024-09-12T22:13:23.835751+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:23.835751+0000","last_undegraded":"2024-09-12T22:13:23.835751+0000","last_fullsized":"2024-09-12T22:13:23.835751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":213,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786937+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:20.786937+0000","last_peered":"2024-09-12T22:13:20.786937+0000","last_clean":"2024-09-12T22:13:20.786937+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:20.786937+0000","last_undegraded":"2024-09-12T22:13:20.786937+0000","last_fullsized":"2024-09-12T22:13:20.786937+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":894,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836462+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:23.836462+0000","last_peered":"2024-09-12T22:13:23.836462+0000","last_clean":"2024-09-12T22:13:23.836462+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:23.836462+0000","last_undegraded":"2024-09-12T22:13:23.836462+0000","last_fullsized":"2024-09-12T22:13:23.836462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785472+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:20.785472+0000","last_peered":"2024-09-12T22:13:20.785472+0000","last_clean":"2024-09-12T22:13:20.785472+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:20.785472+0000","last_undegraded":"2024-09-12T22:13:20.785472+0000","last_fullsized":"2024-09-12T22:13:20.785472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":839,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836366+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:23.836366+0000","last_peered":"2024-09-12T22:13:23.836366+0000","last_clean":"2024-09-12T22:13:23.836366+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:23.836366+0000","last_undegraded":"2024-09-12T22:13:23.836366+0000","last_fullsized":"2024-09-12T22:13:23.836366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":596,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786663+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:20.786663+0000","last_peered":"2024-09-12T22:13:20.786663+0000","last_clean":"2024-09-12T22:13:20.786663+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:20.786663+0000","last_undegraded":"2024-09-12T22:13:20.786663+0000","last_fullsized":"2024-09-12T22:13:20.786663+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":974,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777808+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:23.777808+0000","last_peered":"2024-09-12T22:13:23.777808+0000","last_clean":"2024-09-12T22:13:23.777808+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:23.777808+0000","last_undegraded":"2024-09-12T22:13:23.777808+0000","last_fullsized":"2024-09-12T22:13:23.777808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":356,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836438+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:23.836438+0000","last_peered":"2024-09-12T22:13:23.836438+0000","last_clean":"2024-09-12T22:13:23.836438+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:23.836438+0000","last_undegraded":"2024-09-12T22:13:23.836438+0000","last_fullsized":"2024-09-12T22:13:23.836438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835750+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:23.835750+0000","last_peered":"2024-09-12T22:13:23.835750+0000","last_clean":"2024-09-12T22:13:23.835750+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:23.835750+0000","last_undegraded":"2024-09-12T22:13:23.835750+0000","last_fullsized":"2024-09-12T22:13:23.835750+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":762,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777274+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:23.777274+0000","last_peered":"2024-09-12T22:13:23.777274+0000","last_clean":"2024-09-12T22:13:23.777274+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:23.777274+0000","last_undegraded":"2024-09-12T22:13:23.777274+0000","last_fullsized":"2024-09-12T22:13:23.777274+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.837820+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:23.837820+0000","last_peered":"2024-09-12T22:13:23.837820+0000","last_clean":"2024-09-12T22:13:23.837820+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:23.837820+0000","last_undegraded":"2024-09-12T22:13:23.837820+0000","last_fullsized":"2024-09-12T22:13:23.837820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836385+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:23.836385+0000","last_peered":"2024-09-12T22:13:23.836385+0000","last_clean":"2024-09-12T22:13:23.836385+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:23.836385+0000","last_undegraded":"2024-09-12T22:13:23.836385+0000","last_fullsized":"2024-09-12T22:13:23.836385+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":296,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777322+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:23.777322+0000","last_peered":"2024-09-12T22:13:23.777322+0000","last_clean":"2024-09-12T22:13:23.777322+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:23.777322+0000","last_undegraded":"2024-09-12T22:13:23.777322+0000","last_fullsized":"2024-09-12T22:13:23.777322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":605,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786446+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:20.786446+0000","last_peered":"2024-09-12T22:13:20.786446+0000","last_clean":"2024-09-12T22:13:20.786446+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:20.786446+0000","last_undegraded":"2024-09-12T22:13:20.786446+0000","last_fullsized":"2024-09-12T22:13:20.786446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777581+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:23.777581+0000","last_peered":"2024-09-12T22:13:23.777581+0000","last_clean":"2024-09-12T22:13:23.777581+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:23.777581+0000","last_undegraded":"2024-09-12T22:13:23.777581+0000","last_fullsized":"2024-09-12T22:13:23.777581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":501,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785630+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:20.785630+0000","last_peered":"2024-09-12T22:13:20.785630+0000","last_clean":"2024-09-12T22:13:20.785630+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:20.785630+0000","last_undegraded":"2024-09-12T22:13:20.785630+0000","last_fullsized":"2024-09-12T22:13:20.785630+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":822,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777975+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:23.777975+0000","last_peered":"2024-09-12T22:13:23.777975+0000","last_clean":"2024-09-12T22:13:23.777975+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:23.777975+0000","last_undegraded":"2024-09-12T22:13:23.777975+0000","last_fullsized":"2024-09-12T22:13:23.777975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835252+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:23.835252+0000","last_peered":"2024-09-12T22:13:23.835252+0000","last_clean":"2024-09-12T22:13:23.835252+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:23.835252+0000","last_undegraded":"2024-09-12T22:13:23.835252+0000","last_fullsized":"2024-09-12T22:13:23.835252+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785942+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:20.785942+0000","last_peered":"2024-09-12T22:13:20.785942+0000","last_clean":"2024-09-12T22:13:20.785942+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:20.785942+0000","last_undegraded":"2024-09-12T22:13:20.785942+0000","last_fullsized":"2024-09-12T22:13:20.785942+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":933,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777624+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:23.777624+0000","last_peered":"2024-09-12T22:13:23.777624+0000","last_clean":"2024-09-12T22:13:23.777624+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:23.777624+0000","last_undegraded":"2024-09-12T22:13:23.777624+0000","last_fullsized":"2024-09-12T22:13:23.777624+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":421,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836546+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:23.836546+0000","last_peered":"2024-09-12T22:13:23.836546+0000","last_clean":"2024-09-12T22:13:23.836546+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:23.836546+0000","last_undegraded":"2024-09-12T22:13:23.836546+0000","last_fullsized":"2024-09-12T22:13:23.836546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835132+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:23.835132+0000","last_peered":"2024-09-12T22:13:23.835132+0000","last_clean":"2024-09-12T22:13:23.835132+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:23.835132+0000","last_undegraded":"2024-09-12T22:13:23.835132+0000","last_fullsized":"2024-09-12T22:13:23.835132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":493,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787086+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:20.787086+0000","last_peered":"2024-09-12T22:13:20.787086+0000","last_clean":"2024-09-12T22:13:20.787086+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:20.787086+0000","last_undegraded":"2024-09-12T22:13:20.787086+0000","last_fullsized":"2024-09-12T22:13:20.787086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":205,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777752+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:23.777752+0000","last_peered":"2024-09-12T22:13:23.777752+0000","last_clean":"2024-09-12T22:13:23.777752+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:23.777752+0000","last_undegraded":"2024-09-12T22:13:23.777752+0000","last_fullsized":"2024-09-12T22:13:23.777752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786507+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:20.786507+0000","last_peered":"2024-09-12T22:13:20.786507+0000","last_clean":"2024-09-12T22:13:20.786507+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:20.786507+0000","last_undegraded":"2024-09-12T22:13:20.786507+0000","last_fullsized":"2024-09-12T22:13:20.786507+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":532,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785841+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:20.785841+0000","last_peered":"2024-09-12T22:13:20.785841+0000","last_clean":"2024-09-12T22:13:20.785841+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:20.785841+0000","last_undegraded":"2024-09-12T22:13:20.785841+0000","last_fullsized":"2024-09-12T22:13:20.785841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":212,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778207+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:23.778207+0000","last_peered":"2024-09-12T22:13:23.778207+0000","last_clean":"2024-09-12T22:13:23.778207+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:23.778207+0000","last_undegraded":"2024-09-12T22:13:23.778207+0000","last_fullsized":"2024-09-12T22:13:23.778207+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778206+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:23.778206+0000","last_peered":"2024-09-12T22:13:23.778206+0000","last_clean":"2024-09-12T22:13:23.778206+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:23.778206+0000","last_undegraded":"2024-09-12T22:13:23.778206+0000","last_fullsized":"2024-09-12T22:13:23.778206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":564,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777133+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:23.777133+0000","last_peered":"2024-09-12T22:13:23.777133+0000","last_clean":"2024-09-12T22:13:23.777133+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:23.777133+0000","last_undegraded":"2024-09-12T22:13:23.777133+0000","last_fullsized":"2024-09-12T22:13:23.777133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":234,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785942+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:20.785942+0000","last_peered":"2024-09-12T22:13:20.785942+0000","last_clean":"2024-09-12T22:13:20.785942+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:20.785942+0000","last_undegraded":"2024-09-12T22:13:20.785942+0000","last_fullsized":"2024-09-12T22:13:20.785942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836638+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:23.836638+0000","last_peered":"2024-09-12T22:13:23.836638+0000","last_clean":"2024-09-12T22:13:23.836638+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:23.836638+0000","last_undegraded":"2024-09-12T22:13:23.836638+0000","last_fullsized":"2024-09-12T22:13:23.836638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":666,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785995+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:20.785995+0000","last_peered":"2024-09-12T22:13:20.785995+0000","last_clean":"2024-09-12T22:13:20.785995+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:20.785995+0000","last_undegraded":"2024-09-12T22:13:20.785995+0000","last_fullsized":"2024-09-12T22:13:20.785995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":904,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835626+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:23.835626+0000","last_peered":"2024-09-12T22:13:23.835626+0000","last_clean":"2024-09-12T22:13:23.835626+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:23.835626+0000","last_undegraded":"2024-09-12T22:13:23.835626+0000","last_fullsized":"2024-09-12T22:13:23.835626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835882+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:23.835882+0000","last_peered":"2024-09-12T22:13:23.835882+0000","last_clean":"2024-09-12T22:13:23.835882+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:23.835882+0000","last_undegraded":"2024-09-12T22:13:23.835882+0000","last_fullsized":"2024-09-12T22:13:23.835882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1022,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777004+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:23.777004+0000","last_peered":"2024-09-12T22:13:23.777004+0000","last_clean":"2024-09-12T22:13:23.777004+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:23.777004+0000","last_undegraded":"2024-09-12T22:13:23.777004+0000","last_fullsized":"2024-09-12T22:13:23.777004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786406+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:20.786406+0000","last_peered":"2024-09-12T22:13:20.786406+0000","last_clean":"2024-09-12T22:13:20.786406+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:20.786406+0000","last_undegraded":"2024-09-12T22:13:20.786406+0000","last_fullsized":"2024-09-12T22:13:20.786406+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":319,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785828+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:20.785828+0000","last_peered":"2024-09-12T22:13:20.785828+0000","last_clean":"2024-09-12T22:13:20.785828+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:20.785828+0000","last_undegraded":"2024-09-12T22:13:20.785828+0000","last_fullsized":"2024-09-12T22:13:20.785828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":686,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777020+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:23.777020+0000","last_peered":"2024-09-12T22:13:23.777020+0000","last_clean":"2024-09-12T22:13:23.777020+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:23.777020+0000","last_undegraded":"2024-09-12T22:13:23.777020+0000","last_fullsized":"2024-09-12T22:13:23.777020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":190,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778094+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:23.778094+0000","last_peered":"2024-09-12T22:13:23.778094+0000","last_clean":"2024-09-12T22:13:23.778094+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:23.778094+0000","last_undegraded":"2024-09-12T22:13:23.778094+0000","last_fullsized":"2024-09-12T22:13:23.778094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1018,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777007+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:23.777007+0000","last_peered":"2024-09-12T22:13:23.777007+0000","last_clean":"2024-09-12T22:13:23.777007+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:23.777007+0000","last_undegraded":"2024-09-12T22:13:23.777007+0000","last_fullsized":"2024-09-12T22:13:23.777007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":509,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786569+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:20.786569+0000","last_peered":"2024-09-12T22:13:20.786569+0000","last_clean":"2024-09-12T22:13:20.786569+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:20.786569+0000","last_undegraded":"2024-09-12T22:13:20.786569+0000","last_fullsized":"2024-09-12T22:13:20.786569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":920,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777224+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:23.777224+0000","last_peered":"2024-09-12T22:13:23.777224+0000","last_clean":"2024-09-12T22:13:23.777224+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:23.777224+0000","last_undegraded":"2024-09-12T22:13:23.777224+0000","last_fullsized":"2024-09-12T22:13:23.777224+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":577,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777906+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:23.777906+0000","last_peered":"2024-09-12T22:13:23.777906+0000","last_clean":"2024-09-12T22:13:23.777906+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:23.777906+0000","last_undegraded":"2024-09-12T22:13:23.777906+0000","last_fullsized":"2024-09-12T22:13:23.777906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":324,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777172+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:23.777172+0000","last_peered":"2024-09-12T22:13:23.777172+0000","last_clean":"2024-09-12T22:13:23.777172+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:23.777172+0000","last_undegraded":"2024-09-12T22:13:23.777172+0000","last_fullsized":"2024-09-12T22:13:23.777172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":515,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.792676+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:20.792676+0000","last_peered":"2024-09-12T22:13:20.792676+0000","last_clean":"2024-09-12T22:13:20.792676+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:20.792676+0000","last_undegraded":"2024-09-12T22:13:20.792676+0000","last_fullsized":"2024-09-12T22:13:20.792676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":275,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786999+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:20.786999+0000","last_peered":"2024-09-12T22:13:20.786999+0000","last_clean":"2024-09-12T22:13:20.786999+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:20.786999+0000","last_undegraded":"2024-09-12T22:13:20.786999+0000","last_fullsized":"2024-09-12T22:13:20.786999+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":525,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786251+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:20.786251+0000","last_peered":"2024-09-12T22:13:20.786251+0000","last_clean":"2024-09-12T22:13:20.786251+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:20.786251+0000","last_undegraded":"2024-09-12T22:13:20.786251+0000","last_fullsized":"2024-09-12T22:13:20.786251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785622+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:20.785622+0000","last_peered":"2024-09-12T22:13:20.785622+0000","last_clean":"2024-09-12T22:13:20.785622+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:20.785622+0000","last_undegraded":"2024-09-12T22:13:20.785622+0000","last_fullsized":"2024-09-12T22:13:20.785622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":525,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835500+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:23.835500+0000","last_peered":"2024-09-12T22:13:23.835500+0000","last_clean":"2024-09-12T22:13:23.835500+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:23.835500+0000","last_undegraded":"2024-09-12T22:13:23.835500+0000","last_fullsized":"2024-09-12T22:13:23.835500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":326,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835808+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:23.835808+0000","last_peered":"2024-09-12T22:13:23.835808+0000","last_clean":"2024-09-12T22:13:23.835808+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:23.835808+0000","last_undegraded":"2024-09-12T22:13:23.835808+0000","last_fullsized":"2024-09-12T22:13:23.835808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":892,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835151+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:23.835151+0000","last_peered":"2024-09-12T22:13:23.835151+0000","last_clean":"2024-09-12T22:13:23.835151+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:23.835151+0000","last_undegraded":"2024-09-12T22:13:23.835151+0000","last_fullsized":"2024-09-12T22:13:23.835151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":300,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785838+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:20.785838+0000","last_peered":"2024-09-12T22:13:20.785838+0000","last_clean":"2024-09-12T22:13:20.785838+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:20.785838+0000","last_undegraded":"2024-09-12T22:13:20.785838+0000","last_fullsized":"2024-09-12T22:13:20.785838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":567,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785854+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:20.785854+0000","last_peered":"2024-09-12T22:13:20.785854+0000","last_clean":"2024-09-12T22:13:20.785854+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:20.785854+0000","last_undegraded":"2024-09-12T22:13:20.785854+0000","last_fullsized":"2024-09-12T22:13:20.785854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778104+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:23.778104+0000","last_peered":"2024-09-12T22:13:23.778104+0000","last_clean":"2024-09-12T22:13:23.778104+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:23.778104+0000","last_undegraded":"2024-09-12T22:13:23.778104+0000","last_fullsized":"2024-09-12T22:13:23.778104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836162+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:23.836162+0000","last_peered":"2024-09-12T22:13:23.836162+0000","last_clean":"2024-09-12T22:13:23.836162+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:23.836162+0000","last_undegraded":"2024-09-12T22:13:23.836162+0000","last_fullsized":"2024-09-12T22:13:23.836162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":250,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777930+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:23.777930+0000","last_peered":"2024-09-12T22:13:23.777930+0000","last_clean":"2024-09-12T22:13:23.777930+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:23.777930+0000","last_undegraded":"2024-09-12T22:13:23.777930+0000","last_fullsized":"2024-09-12T22:13:23.777930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":384,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68456,"kb_used_data":18708,"kb_used_omap":5,"kb_used_meta":49722,"kb_avail":94303384,"statfs":{"total":96636764160,"available":96566665216,"internally_reserved":0,"allocated":19156992,"data_stored":93167796,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":50915434},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114640,"kb_used_data":25208,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257200,"statfs":{"total":96636764160,"available":96519372800,"internally_reserved":0,"allocated":25812992,"data_stored":77908297,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118480,"kb_used_data":29048,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253360,"statfs":{"total":96636764160,"available":96515440640,"internally_reserved":0,"allocated":29745152,"data_stored":85667018,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:24.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:25.274 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:25.285 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-12T22:13:25.126328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":384,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7184,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":301576,"kb_used_data":72964,"kb_used_omap":9,"kb_used_meta":228534,"kb_avail":282813944,"statfs":{"total":289910292480,"available":289601478656,"internally_reserved":0,"allocated":74715136,"data_stored":256743111,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":234019828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1625,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":594,"reported_epoch":78,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T22:13:20.780164+0000","last_change":"2024-09-12T22:13:08.831030+0000","last_active":"2024-09-12T22:13:20.780164+0000","last_peered":"2024-09-12T22:13:20.780164+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:13:08.829847+0000","last_became_peered":"2024-09-12T22:13:08.829847+0000","last_unstale":"2024-09-12T22:13:20.780164+0000","last_undegraded":"2024-09-12T22:13:08.741073+0000","last_fullsized":"2024-09-12T22:13:08.735993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":522,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786359+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:20.786359+0000","last_peered":"2024-09-12T22:13:20.786359+0000","last_clean":"2024-09-12T22:13:20.786359+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:20.786359+0000","last_undegraded":"2024-09-12T22:13:20.786359+0000","last_fullsized":"2024-09-12T22:13:20.786359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":864,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836163+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:23.836163+0000","last_peered":"2024-09-12T22:13:23.836163+0000","last_clean":"2024-09-12T22:13:23.836163+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:23.836163+0000","last_undegraded":"2024-09-12T22:13:23.836163+0000","last_fullsized":"2024-09-12T22:13:23.836163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":597,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835507+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:23.835507+0000","last_peered":"2024-09-12T22:13:23.835507+0000","last_clean":"2024-09-12T22:13:23.835507+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:23.835507+0000","last_undegraded":"2024-09-12T22:13:23.835507+0000","last_fullsized":"2024-09-12T22:13:23.835507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":615,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785728+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:20.785728+0000","last_peered":"2024-09-12T22:13:20.785728+0000","last_clean":"2024-09-12T22:13:20.785728+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:20.785728+0000","last_undegraded":"2024-09-12T22:13:20.785728+0000","last_fullsized":"2024-09-12T22:13:20.785728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":594,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835004+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:23.835004+0000","last_peered":"2024-09-12T22:13:23.835004+0000","last_clean":"2024-09-12T22:13:23.835004+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:23.835004+0000","last_undegraded":"2024-09-12T22:13:23.835004+0000","last_fullsized":"2024-09-12T22:13:23.835004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":684,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.834996+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:23.834996+0000","last_peered":"2024-09-12T22:13:23.834996+0000","last_clean":"2024-09-12T22:13:23.834996+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:23.834996+0000","last_undegraded":"2024-09-12T22:13:23.834996+0000","last_fullsized":"2024-09-12T22:13:23.834996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835812+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:23.835812+0000","last_peered":"2024-09-12T22:13:23.835812+0000","last_clean":"2024-09-12T22:13:23.835812+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:23.835812+0000","last_undegraded":"2024-09-12T22:13:23.835812+0000","last_fullsized":"2024-09-12T22:13:23.835812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":980,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777689+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:23.777689+0000","last_peered":"2024-09-12T22:13:23.777689+0000","last_clean":"2024-09-12T22:13:23.777689+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:23.777689+0000","last_undegraded":"2024-09-12T22:13:23.777689+0000","last_fullsized":"2024-09-12T22:13:23.777689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":518,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786269+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:20.786269+0000","last_peered":"2024-09-12T22:13:20.786269+0000","last_clean":"2024-09-12T22:13:20.786269+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:20.786269+0000","last_undegraded":"2024-09-12T22:13:20.786269+0000","last_fullsized":"2024-09-12T22:13:20.786269+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":547,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836207+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:23.836207+0000","last_peered":"2024-09-12T22:13:23.836207+0000","last_clean":"2024-09-12T22:13:23.836207+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:23.836207+0000","last_undegraded":"2024-09-12T22:13:23.836207+0000","last_fullsized":"2024-09-12T22:13:23.836207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":477,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786393+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:20.786393+0000","last_peered":"2024-09-12T22:13:20.786393+0000","last_clean":"2024-09-12T22:13:20.786393+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:20.786393+0000","last_undegraded":"2024-09-12T22:13:20.786393+0000","last_fullsized":"2024-09-12T22:13:20.786393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":567,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785922+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:20.785922+0000","last_peered":"2024-09-12T22:13:20.785922+0000","last_clean":"2024-09-12T22:13:20.785922+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:20.785922+0000","last_undegraded":"2024-09-12T22:13:20.785922+0000","last_fullsized":"2024-09-12T22:13:20.785922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":938,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835035+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:23.835035+0000","last_peered":"2024-09-12T22:13:23.835035+0000","last_clean":"2024-09-12T22:13:23.835035+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:23.835035+0000","last_undegraded":"2024-09-12T22:13:23.835035+0000","last_fullsized":"2024-09-12T22:13:23.835035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1037,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835074+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:23.835074+0000","last_peered":"2024-09-12T22:13:23.835074+0000","last_clean":"2024-09-12T22:13:23.835074+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:23.835074+0000","last_undegraded":"2024-09-12T22:13:23.835074+0000","last_fullsized":"2024-09-12T22:13:23.835074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835931+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:23.835931+0000","last_peered":"2024-09-12T22:13:23.835931+0000","last_clean":"2024-09-12T22:13:23.835931+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:23.835931+0000","last_undegraded":"2024-09-12T22:13:23.835931+0000","last_fullsized":"2024-09-12T22:13:23.835931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":937,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778204+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:23.778204+0000","last_peered":"2024-09-12T22:13:23.778204+0000","last_clean":"2024-09-12T22:13:23.778204+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:23.778204+0000","last_undegraded":"2024-09-12T22:13:23.778204+0000","last_fullsized":"2024-09-12T22:13:23.778204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":525,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786234+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:20.786234+0000","last_peered":"2024-09-12T22:13:20.786234+0000","last_clean":"2024-09-12T22:13:20.786234+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:20.786234+0000","last_undegraded":"2024-09-12T22:13:20.786234+0000","last_fullsized":"2024-09-12T22:13:20.786234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":974,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777724+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:23.777724+0000","last_peered":"2024-09-12T22:13:23.777724+0000","last_clean":"2024-09-12T22:13:23.777724+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:23.777724+0000","last_undegraded":"2024-09-12T22:13:23.777724+0000","last_fullsized":"2024-09-12T22:13:23.777724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":615,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835644+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:23.835644+0000","last_peered":"2024-09-12T22:13:23.835644+0000","last_clean":"2024-09-12T22:13:23.835644+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:23.835644+0000","last_undegraded":"2024-09-12T22:13:23.835644+0000","last_fullsized":"2024-09-12T22:13:23.835644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":667,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835263+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:23.835263+0000","last_peered":"2024-09-12T22:13:23.835263+0000","last_clean":"2024-09-12T22:13:23.835263+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:23.835263+0000","last_undegraded":"2024-09-12T22:13:23.835263+0000","last_fullsized":"2024-09-12T22:13:23.835263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":595,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787110+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:20.787110+0000","last_peered":"2024-09-12T22:13:20.787110+0000","last_clean":"2024-09-12T22:13:20.787110+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:20.787110+0000","last_undegraded":"2024-09-12T22:13:20.787110+0000","last_fullsized":"2024-09-12T22:13:20.787110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.776887+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:23.776887+0000","last_peered":"2024-09-12T22:13:23.776887+0000","last_clean":"2024-09-12T22:13:23.776887+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:23.776887+0000","last_undegraded":"2024-09-12T22:13:23.776887+0000","last_fullsized":"2024-09-12T22:13:23.776887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":552,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-12T22:13:20.785771+0000","last_change":"2024-09-12T22:13:20.785771+0000","last_active":"2024-09-12T22:13:07.722596+0000","last_peered":"2024-09-12T22:13:05.716300+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:10:32.246451+0000","last_became_peered":"2024-09-12T22:10:32.246451+0000","last_unstale":"2024-09-12T22:13:20.785771+0000","last_undegraded":"2024-09-12T22:13:20.785771+0000","last_fullsized":"2024-09-12T22:13:20.785771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":510,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786254+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:20.786254+0000","last_peered":"2024-09-12T22:13:20.786254+0000","last_clean":"2024-09-12T22:13:20.786254+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:20.786254+0000","last_undegraded":"2024-09-12T22:13:20.786254+0000","last_fullsized":"2024-09-12T22:13:20.786254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":657,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777867+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:23.777867+0000","last_peered":"2024-09-12T22:13:23.777867+0000","last_clean":"2024-09-12T22:13:23.777867+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:23.777867+0000","last_undegraded":"2024-09-12T22:13:23.777867+0000","last_fullsized":"2024-09-12T22:13:23.777867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":868,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836292+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:23.836292+0000","last_peered":"2024-09-12T22:13:23.836292+0000","last_clean":"2024-09-12T22:13:23.836292+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:23.836292+0000","last_undegraded":"2024-09-12T22:13:23.836292+0000","last_fullsized":"2024-09-12T22:13:23.836292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":537,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786370+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:20.786370+0000","last_peered":"2024-09-12T22:13:20.786370+0000","last_clean":"2024-09-12T22:13:20.786370+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:20.786370+0000","last_undegraded":"2024-09-12T22:13:20.786370+0000","last_fullsized":"2024-09-12T22:13:20.786370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":977,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777457+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:23.777457+0000","last_peered":"2024-09-12T22:13:23.777457+0000","last_clean":"2024-09-12T22:13:23.777457+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:23.777457+0000","last_undegraded":"2024-09-12T22:13:23.777457+0000","last_fullsized":"2024-09-12T22:13:23.777457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":627,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787027+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:20.787027+0000","last_peered":"2024-09-12T22:13:20.787027+0000","last_clean":"2024-09-12T22:13:20.787027+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:20.787027+0000","last_undegraded":"2024-09-12T22:13:20.787027+0000","last_fullsized":"2024-09-12T22:13:20.787027+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.776914+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:23.776914+0000","last_peered":"2024-09-12T22:13:23.776914+0000","last_clean":"2024-09-12T22:13:23.776914+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:23.776914+0000","last_undegraded":"2024-09-12T22:13:23.776914+0000","last_fullsized":"2024-09-12T22:13:23.776914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":994,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-12T22:13:23.713319+0000","last_change":"2024-09-12T22:13:23.835234+0000","last_active":"2024-09-12T22:13:23.835234+0000","last_peered":"2024-09-12T22:13:23.713319+0000","last_clean":"2024-09-12T22:13:05.717151+0000","last_became_active":"2024-09-12T22:13:08.827687+0000","last_became_peered":"2024-09-12T22:13:08.827687+0000","last_unstale":"2024-09-12T22:13:23.713319+0000","last_undegraded":"2024-09-12T22:13:23.713319+0000","last_fullsized":"2024-09-12T22:13:08.735102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":552,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786299+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:20.786299+0000","last_peered":"2024-09-12T22:13:20.786299+0000","last_clean":"2024-09-12T22:13:20.786299+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:20.786299+0000","last_undegraded":"2024-09-12T22:13:20.786299+0000","last_fullsized":"2024-09-12T22:13:20.786299+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":450,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835628+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:23.835628+0000","last_peered":"2024-09-12T22:13:23.835628+0000","last_clean":"2024-09-12T22:13:23.835628+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:23.835628+0000","last_undegraded":"2024-09-12T22:13:23.835628+0000","last_fullsized":"2024-09-12T22:13:23.835628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":553,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785940+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:20.785940+0000","last_peered":"2024-09-12T22:13:20.785940+0000","last_clean":"2024-09-12T22:13:20.785940+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:20.785940+0000","last_undegraded":"2024-09-12T22:13:20.785940+0000","last_fullsized":"2024-09-12T22:13:20.785940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":197,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777137+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:23.777137+0000","last_peered":"2024-09-12T22:13:23.777137+0000","last_clean":"2024-09-12T22:13:23.777137+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:23.777137+0000","last_undegraded":"2024-09-12T22:13:23.777137+0000","last_fullsized":"2024-09-12T22:13:23.777137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778165+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:23.778165+0000","last_peered":"2024-09-12T22:13:23.778165+0000","last_clean":"2024-09-12T22:13:23.778165+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:23.778165+0000","last_undegraded":"2024-09-12T22:13:23.778165+0000","last_fullsized":"2024-09-12T22:13:23.778165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785963+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:20.785963+0000","last_peered":"2024-09-12T22:13:20.785963+0000","last_clean":"2024-09-12T22:13:20.785963+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:20.785963+0000","last_undegraded":"2024-09-12T22:13:20.785963+0000","last_fullsized":"2024-09-12T22:13:20.785963+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777734+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:23.777734+0000","last_peered":"2024-09-12T22:13:23.777734+0000","last_clean":"2024-09-12T22:13:23.777734+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:23.777734+0000","last_undegraded":"2024-09-12T22:13:23.777734+0000","last_fullsized":"2024-09-12T22:13:23.777734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":217,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835978+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:23.835978+0000","last_peered":"2024-09-12T22:13:23.835978+0000","last_clean":"2024-09-12T22:13:23.835978+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:23.835978+0000","last_undegraded":"2024-09-12T22:13:23.835978+0000","last_fullsized":"2024-09-12T22:13:23.835978+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":309,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836633+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:23.836633+0000","last_peered":"2024-09-12T22:13:23.836633+0000","last_clean":"2024-09-12T22:13:23.836633+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:23.836633+0000","last_undegraded":"2024-09-12T22:13:23.836633+0000","last_fullsized":"2024-09-12T22:13:23.836633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":522,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786247+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:20.786247+0000","last_peered":"2024-09-12T22:13:20.786247+0000","last_clean":"2024-09-12T22:13:20.786247+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:20.786247+0000","last_undegraded":"2024-09-12T22:13:20.786247+0000","last_fullsized":"2024-09-12T22:13:20.786247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":330,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786098+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:20.786098+0000","last_peered":"2024-09-12T22:13:20.786098+0000","last_clean":"2024-09-12T22:13:20.786098+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:20.786098+0000","last_undegraded":"2024-09-12T22:13:20.786098+0000","last_fullsized":"2024-09-12T22:13:20.786098+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":575,"reported_epoch":78,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T22:13:20.779113+0000","last_change":"2024-09-12T22:13:09.232257+0000","last_active":"2024-09-12T22:13:20.779113+0000","last_peered":"2024-09-12T22:13:20.779113+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:13:08.796593+0000","last_became_peered":"2024-09-12T22:13:08.796593+0000","last_unstale":"2024-09-12T22:13:20.779113+0000","last_undegraded":"2024-09-12T22:13:09.232125+0000","last_fullsized":"2024-09-12T22:13:08.724199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":204,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":625,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836424+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:23.836424+0000","last_peered":"2024-09-12T22:13:23.836424+0000","last_clean":"2024-09-12T22:13:23.836424+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:23.836424+0000","last_undegraded":"2024-09-12T22:13:23.836424+0000","last_fullsized":"2024-09-12T22:13:23.836424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835204+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:23.835204+0000","last_peered":"2024-09-12T22:13:23.835204+0000","last_clean":"2024-09-12T22:13:23.835204+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:23.835204+0000","last_undegraded":"2024-09-12T22:13:23.835204+0000","last_fullsized":"2024-09-12T22:13:23.835204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835943+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:23.835943+0000","last_peered":"2024-09-12T22:13:23.835943+0000","last_clean":"2024-09-12T22:13:23.835943+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:23.835943+0000","last_undegraded":"2024-09-12T22:13:23.835943+0000","last_fullsized":"2024-09-12T22:13:23.835943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777333+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:23.777333+0000","last_peered":"2024-09-12T22:13:23.777333+0000","last_clean":"2024-09-12T22:13:23.777333+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:23.777333+0000","last_undegraded":"2024-09-12T22:13:23.777333+0000","last_fullsized":"2024-09-12T22:13:23.777333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":310,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777904+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:23.777904+0000","last_peered":"2024-09-12T22:13:23.777904+0000","last_clean":"2024-09-12T22:13:23.777904+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:23.777904+0000","last_undegraded":"2024-09-12T22:13:23.777904+0000","last_fullsized":"2024-09-12T22:13:23.777904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":667,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835751+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:23.835751+0000","last_peered":"2024-09-12T22:13:23.835751+0000","last_clean":"2024-09-12T22:13:23.835751+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:23.835751+0000","last_undegraded":"2024-09-12T22:13:23.835751+0000","last_fullsized":"2024-09-12T22:13:23.835751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":213,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786937+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:20.786937+0000","last_peered":"2024-09-12T22:13:20.786937+0000","last_clean":"2024-09-12T22:13:20.786937+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:20.786937+0000","last_undegraded":"2024-09-12T22:13:20.786937+0000","last_fullsized":"2024-09-12T22:13:20.786937+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":894,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836462+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:23.836462+0000","last_peered":"2024-09-12T22:13:23.836462+0000","last_clean":"2024-09-12T22:13:23.836462+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:23.836462+0000","last_undegraded":"2024-09-12T22:13:23.836462+0000","last_fullsized":"2024-09-12T22:13:23.836462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785472+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:20.785472+0000","last_peered":"2024-09-12T22:13:20.785472+0000","last_clean":"2024-09-12T22:13:20.785472+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:20.785472+0000","last_undegraded":"2024-09-12T22:13:20.785472+0000","last_fullsized":"2024-09-12T22:13:20.785472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":839,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836366+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:23.836366+0000","last_peered":"2024-09-12T22:13:23.836366+0000","last_clean":"2024-09-12T22:13:23.836366+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:23.836366+0000","last_undegraded":"2024-09-12T22:13:23.836366+0000","last_fullsized":"2024-09-12T22:13:23.836366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":596,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786663+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:20.786663+0000","last_peered":"2024-09-12T22:13:20.786663+0000","last_clean":"2024-09-12T22:13:20.786663+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:20.786663+0000","last_undegraded":"2024-09-12T22:13:20.786663+0000","last_fullsized":"2024-09-12T22:13:20.786663+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":974,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777808+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:23.777808+0000","last_peered":"2024-09-12T22:13:23.777808+0000","last_clean":"2024-09-12T22:13:23.777808+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:23.777808+0000","last_undegraded":"2024-09-12T22:13:23.777808+0000","last_fullsized":"2024-09-12T22:13:23.777808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":356,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836438+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:23.836438+0000","last_peered":"2024-09-12T22:13:23.836438+0000","last_clean":"2024-09-12T22:13:23.836438+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:23.836438+0000","last_undegraded":"2024-09-12T22:13:23.836438+0000","last_fullsized":"2024-09-12T22:13:23.836438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835750+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:23.835750+0000","last_peered":"2024-09-12T22:13:23.835750+0000","last_clean":"2024-09-12T22:13:23.835750+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:23.835750+0000","last_undegraded":"2024-09-12T22:13:23.835750+0000","last_fullsized":"2024-09-12T22:13:23.835750+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":762,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777274+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:23.777274+0000","last_peered":"2024-09-12T22:13:23.777274+0000","last_clean":"2024-09-12T22:13:23.777274+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:23.777274+0000","last_undegraded":"2024-09-12T22:13:23.777274+0000","last_fullsized":"2024-09-12T22:13:23.777274+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.837820+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:23.837820+0000","last_peered":"2024-09-12T22:13:23.837820+0000","last_clean":"2024-09-12T22:13:23.837820+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:23.837820+0000","last_undegraded":"2024-09-12T22:13:23.837820+0000","last_fullsized":"2024-09-12T22:13:23.837820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836385+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:23.836385+0000","last_peered":"2024-09-12T22:13:23.836385+0000","last_clean":"2024-09-12T22:13:23.836385+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:23.836385+0000","last_undegraded":"2024-09-12T22:13:23.836385+0000","last_fullsized":"2024-09-12T22:13:23.836385+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":296,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777322+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:23.777322+0000","last_peered":"2024-09-12T22:13:23.777322+0000","last_clean":"2024-09-12T22:13:23.777322+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:23.777322+0000","last_undegraded":"2024-09-12T22:13:23.777322+0000","last_fullsized":"2024-09-12T22:13:23.777322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":605,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786446+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:20.786446+0000","last_peered":"2024-09-12T22:13:20.786446+0000","last_clean":"2024-09-12T22:13:20.786446+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:20.786446+0000","last_undegraded":"2024-09-12T22:13:20.786446+0000","last_fullsized":"2024-09-12T22:13:20.786446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777581+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:23.777581+0000","last_peered":"2024-09-12T22:13:23.777581+0000","last_clean":"2024-09-12T22:13:23.777581+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:23.777581+0000","last_undegraded":"2024-09-12T22:13:23.777581+0000","last_fullsized":"2024-09-12T22:13:23.777581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":501,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785630+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:20.785630+0000","last_peered":"2024-09-12T22:13:20.785630+0000","last_clean":"2024-09-12T22:13:20.785630+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:20.785630+0000","last_undegraded":"2024-09-12T22:13:20.785630+0000","last_fullsized":"2024-09-12T22:13:20.785630+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":822,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777975+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:23.777975+0000","last_peered":"2024-09-12T22:13:23.777975+0000","last_clean":"2024-09-12T22:13:23.777975+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:23.777975+0000","last_undegraded":"2024-09-12T22:13:23.777975+0000","last_fullsized":"2024-09-12T22:13:23.777975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835252+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:23.835252+0000","last_peered":"2024-09-12T22:13:23.835252+0000","last_clean":"2024-09-12T22:13:23.835252+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:23.835252+0000","last_undegraded":"2024-09-12T22:13:23.835252+0000","last_fullsized":"2024-09-12T22:13:23.835252+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785942+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:20.785942+0000","last_peered":"2024-09-12T22:13:20.785942+0000","last_clean":"2024-09-12T22:13:20.785942+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:20.785942+0000","last_undegraded":"2024-09-12T22:13:20.785942+0000","last_fullsized":"2024-09-12T22:13:20.785942+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":933,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777624+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:23.777624+0000","last_peered":"2024-09-12T22:13:23.777624+0000","last_clean":"2024-09-12T22:13:23.777624+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:23.777624+0000","last_undegraded":"2024-09-12T22:13:23.777624+0000","last_fullsized":"2024-09-12T22:13:23.777624+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":421,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836546+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:23.836546+0000","last_peered":"2024-09-12T22:13:23.836546+0000","last_clean":"2024-09-12T22:13:23.836546+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:23.836546+0000","last_undegraded":"2024-09-12T22:13:23.836546+0000","last_fullsized":"2024-09-12T22:13:23.836546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835132+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:23.835132+0000","last_peered":"2024-09-12T22:13:23.835132+0000","last_clean":"2024-09-12T22:13:23.835132+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:23.835132+0000","last_undegraded":"2024-09-12T22:13:23.835132+0000","last_fullsized":"2024-09-12T22:13:23.835132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":493,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787086+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:20.787086+0000","last_peered":"2024-09-12T22:13:20.787086+0000","last_clean":"2024-09-12T22:13:20.787086+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:20.787086+0000","last_undegraded":"2024-09-12T22:13:20.787086+0000","last_fullsized":"2024-09-12T22:13:20.787086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":205,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777752+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:23.777752+0000","last_peered":"2024-09-12T22:13:23.777752+0000","last_clean":"2024-09-12T22:13:23.777752+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:23.777752+0000","last_undegraded":"2024-09-12T22:13:23.777752+0000","last_fullsized":"2024-09-12T22:13:23.777752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786507+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:20.786507+0000","last_peered":"2024-09-12T22:13:20.786507+0000","last_clean":"2024-09-12T22:13:20.786507+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:20.786507+0000","last_undegraded":"2024-09-12T22:13:20.786507+0000","last_fullsized":"2024-09-12T22:13:20.786507+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":532,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785841+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:20.785841+0000","last_peered":"2024-09-12T22:13:20.785841+0000","last_clean":"2024-09-12T22:13:20.785841+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:20.785841+0000","last_undegraded":"2024-09-12T22:13:20.785841+0000","last_fullsized":"2024-09-12T22:13:20.785841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":212,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778207+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:23.778207+0000","last_peered":"2024-09-12T22:13:23.778207+0000","last_clean":"2024-09-12T22:13:23.778207+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:23.778207+0000","last_undegraded":"2024-09-12T22:13:23.778207+0000","last_fullsized":"2024-09-12T22:13:23.778207+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778206+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:23.778206+0000","last_peered":"2024-09-12T22:13:23.778206+0000","last_clean":"2024-09-12T22:13:23.778206+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:23.778206+0000","last_undegraded":"2024-09-12T22:13:23.778206+0000","last_fullsized":"2024-09-12T22:13:23.778206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":564,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777133+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:23.777133+0000","last_peered":"2024-09-12T22:13:23.777133+0000","last_clean":"2024-09-12T22:13:23.777133+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:23.777133+0000","last_undegraded":"2024-09-12T22:13:23.777133+0000","last_fullsized":"2024-09-12T22:13:23.777133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":234,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785942+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:20.785942+0000","last_peered":"2024-09-12T22:13:20.785942+0000","last_clean":"2024-09-12T22:13:20.785942+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:20.785942+0000","last_undegraded":"2024-09-12T22:13:20.785942+0000","last_fullsized":"2024-09-12T22:13:20.785942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836638+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:23.836638+0000","last_peered":"2024-09-12T22:13:23.836638+0000","last_clean":"2024-09-12T22:13:23.836638+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:23.836638+0000","last_undegraded":"2024-09-12T22:13:23.836638+0000","last_fullsized":"2024-09-12T22:13:23.836638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":666,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785995+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:20.785995+0000","last_peered":"2024-09-12T22:13:20.785995+0000","last_clean":"2024-09-12T22:13:20.785995+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:20.785995+0000","last_undegraded":"2024-09-12T22:13:20.785995+0000","last_fullsized":"2024-09-12T22:13:20.785995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":904,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835626+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:23.835626+0000","last_peered":"2024-09-12T22:13:23.835626+0000","last_clean":"2024-09-12T22:13:23.835626+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:23.835626+0000","last_undegraded":"2024-09-12T22:13:23.835626+0000","last_fullsized":"2024-09-12T22:13:23.835626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835882+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:23.835882+0000","last_peered":"2024-09-12T22:13:23.835882+0000","last_clean":"2024-09-12T22:13:23.835882+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:23.835882+0000","last_undegraded":"2024-09-12T22:13:23.835882+0000","last_fullsized":"2024-09-12T22:13:23.835882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1022,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777004+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:23.777004+0000","last_peered":"2024-09-12T22:13:23.777004+0000","last_clean":"2024-09-12T22:13:23.777004+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:23.777004+0000","last_undegraded":"2024-09-12T22:13:23.777004+0000","last_fullsized":"2024-09-12T22:13:23.777004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786406+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:20.786406+0000","last_peered":"2024-09-12T22:13:20.786406+0000","last_clean":"2024-09-12T22:13:20.786406+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:20.786406+0000","last_undegraded":"2024-09-12T22:13:20.786406+0000","last_fullsized":"2024-09-12T22:13:20.786406+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":319,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785828+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:20.785828+0000","last_peered":"2024-09-12T22:13:20.785828+0000","last_clean":"2024-09-12T22:13:20.785828+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:20.785828+0000","last_undegraded":"2024-09-12T22:13:20.785828+0000","last_fullsized":"2024-09-12T22:13:20.785828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":686,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777020+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:23.777020+0000","last_peered":"2024-09-12T22:13:23.777020+0000","last_clean":"2024-09-12T22:13:23.777020+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:23.777020+0000","last_undegraded":"2024-09-12T22:13:23.777020+0000","last_fullsized":"2024-09-12T22:13:23.777020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":190,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778094+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:23.778094+0000","last_peered":"2024-09-12T22:13:23.778094+0000","last_clean":"2024-09-12T22:13:23.778094+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:23.778094+0000","last_undegraded":"2024-09-12T22:13:23.778094+0000","last_fullsized":"2024-09-12T22:13:23.778094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1018,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777007+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:23.777007+0000","last_peered":"2024-09-12T22:13:23.777007+0000","last_clean":"2024-09-12T22:13:23.777007+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:23.777007+0000","last_undegraded":"2024-09-12T22:13:23.777007+0000","last_fullsized":"2024-09-12T22:13:23.777007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":509,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786569+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:20.786569+0000","last_peered":"2024-09-12T22:13:20.786569+0000","last_clean":"2024-09-12T22:13:20.786569+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:20.786569+0000","last_undegraded":"2024-09-12T22:13:20.786569+0000","last_fullsized":"2024-09-12T22:13:20.786569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":920,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777224+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:23.777224+0000","last_peered":"2024-09-12T22:13:23.777224+0000","last_clean":"2024-09-12T22:13:23.777224+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:23.777224+0000","last_undegraded":"2024-09-12T22:13:23.777224+0000","last_fullsized":"2024-09-12T22:13:23.777224+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":577,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777906+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:23.777906+0000","last_peered":"2024-09-12T22:13:23.777906+0000","last_clean":"2024-09-12T22:13:23.777906+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:23.777906+0000","last_undegraded":"2024-09-12T22:13:23.777906+0000","last_fullsized":"2024-09-12T22:13:23.777906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":324,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777172+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:23.777172+0000","last_peered":"2024-09-12T22:13:23.777172+0000","last_clean":"2024-09-12T22:13:23.777172+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:23.777172+0000","last_undegraded":"2024-09-12T22:13:23.777172+0000","last_fullsized":"2024-09-12T22:13:23.777172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":515,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.792676+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:20.792676+0000","last_peered":"2024-09-12T22:13:20.792676+0000","last_clean":"2024-09-12T22:13:20.792676+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:20.792676+0000","last_undegraded":"2024-09-12T22:13:20.792676+0000","last_fullsized":"2024-09-12T22:13:20.792676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":275,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786999+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:20.786999+0000","last_peered":"2024-09-12T22:13:20.786999+0000","last_clean":"2024-09-12T22:13:20.786999+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:20.786999+0000","last_undegraded":"2024-09-12T22:13:20.786999+0000","last_fullsized":"2024-09-12T22:13:20.786999+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":525,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786251+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:20.786251+0000","last_peered":"2024-09-12T22:13:20.786251+0000","last_clean":"2024-09-12T22:13:20.786251+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:20.786251+0000","last_undegraded":"2024-09-12T22:13:20.786251+0000","last_fullsized":"2024-09-12T22:13:20.786251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785622+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:20.785622+0000","last_peered":"2024-09-12T22:13:20.785622+0000","last_clean":"2024-09-12T22:13:20.785622+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:20.785622+0000","last_undegraded":"2024-09-12T22:13:20.785622+0000","last_fullsized":"2024-09-12T22:13:20.785622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":525,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835500+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:23.835500+0000","last_peered":"2024-09-12T22:13:23.835500+0000","last_clean":"2024-09-12T22:13:23.835500+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:23.835500+0000","last_undegraded":"2024-09-12T22:13:23.835500+0000","last_fullsized":"2024-09-12T22:13:23.835500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":326,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835808+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:23.835808+0000","last_peered":"2024-09-12T22:13:23.835808+0000","last_clean":"2024-09-12T22:13:23.835808+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:23.835808+0000","last_undegraded":"2024-09-12T22:13:23.835808+0000","last_fullsized":"2024-09-12T22:13:23.835808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":892,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835151+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:23.835151+0000","last_peered":"2024-09-12T22:13:23.835151+0000","last_clean":"2024-09-12T22:13:23.835151+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:23.835151+0000","last_undegraded":"2024-09-12T22:13:23.835151+0000","last_fullsized":"2024-09-12T22:13:23.835151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":300,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785838+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:20.785838+0000","last_peered":"2024-09-12T22:13:20.785838+0000","last_clean":"2024-09-12T22:13:20.785838+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:20.785838+0000","last_undegraded":"2024-09-12T22:13:20.785838+0000","last_fullsized":"2024-09-12T22:13:20.785838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":567,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785854+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:20.785854+0000","last_peered":"2024-09-12T22:13:20.785854+0000","last_clean":"2024-09-12T22:13:20.785854+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:20.785854+0000","last_undegraded":"2024-09-12T22:13:20.785854+0000","last_fullsized":"2024-09-12T22:13:20.785854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778104+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:23.778104+0000","last_peered":"2024-09-12T22:13:23.778104+0000","last_clean":"2024-09-12T22:13:23.778104+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:23.778104+0000","last_undegraded":"2024-09-12T22:13:23.778104+0000","last_fullsized":"2024-09-12T22:13:23.778104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836162+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:23.836162+0000","last_peered":"2024-09-12T22:13:23.836162+0000","last_clean":"2024-09-12T22:13:23.836162+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:23.836162+0000","last_undegraded":"2024-09-12T22:13:23.836162+0000","last_fullsized":"2024-09-12T22:13:23.836162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":250,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777930+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:23.777930+0000","last_peered":"2024-09-12T22:13:23.777930+0000","last_clean":"2024-09-12T22:13:23.777930+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:23.777930+0000","last_undegraded":"2024-09-12T22:13:23.777930+0000","last_fullsized":"2024-09-12T22:13:23.777930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":384,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68456,"kb_used_data":18708,"kb_used_omap":5,"kb_used_meta":49722,"kb_avail":94303384,"statfs":{"total":96636764160,"available":96566665216,"internally_reserved":0,"allocated":19156992,"data_stored":93167796,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":50915434},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114640,"kb_used_data":25208,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257200,"statfs":{"total":96636764160,"available":96519372800,"internally_reserved":0,"allocated":25812992,"data_stored":77908297,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118480,"kb_used_data":29048,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253360,"statfs":{"total":96636764160,"available":96515440640,"internally_reserved":0,"allocated":29745152,"data_stored":85667018,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:25.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T22:13:25.683 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:25.683 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 759/112 objects degraded (677.679%), 4 pgs degraded","count":4},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":236,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":82,"num_osds":3,"num_up_osds":3,"osd_up_since":1726179186,"num_in_osds":3,"osd_in_since":1726178970,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"peering","count":3},{"state_name":"active+undersized+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":56,"data_bytes":127842362,"bytes_used":312201216,"bytes_avail":289598091264,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":759,"degraded_total":112,"degraded_ratio":6.7767857142857144,"recovering_objects_per_sec":666,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":2666,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4204}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-12T22:10:59.083836+0000","services":{}},"progress_events":{}} 2024-09-12T22:13:25.696 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-12T22:13:25.697 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:25.992 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:25.993 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:26.003 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-12T22:13:25.126328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":384,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7184,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":301576,"kb_used_data":72964,"kb_used_omap":9,"kb_used_meta":228534,"kb_avail":282813944,"statfs":{"total":289910292480,"available":289601478656,"internally_reserved":0,"allocated":74715136,"data_stored":256743111,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":234019828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1625,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":594,"reported_epoch":78,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T22:13:20.780164+0000","last_change":"2024-09-12T22:13:08.831030+0000","last_active":"2024-09-12T22:13:20.780164+0000","last_peered":"2024-09-12T22:13:20.780164+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:13:08.829847+0000","last_became_peered":"2024-09-12T22:13:08.829847+0000","last_unstale":"2024-09-12T22:13:20.780164+0000","last_undegraded":"2024-09-12T22:13:08.741073+0000","last_fullsized":"2024-09-12T22:13:08.735993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":522,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786359+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:20.786359+0000","last_peered":"2024-09-12T22:13:20.786359+0000","last_clean":"2024-09-12T22:13:20.786359+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:20.786359+0000","last_undegraded":"2024-09-12T22:13:20.786359+0000","last_fullsized":"2024-09-12T22:13:20.786359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":864,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836163+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:23.836163+0000","last_peered":"2024-09-12T22:13:23.836163+0000","last_clean":"2024-09-12T22:13:23.836163+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:23.836163+0000","last_undegraded":"2024-09-12T22:13:23.836163+0000","last_fullsized":"2024-09-12T22:13:23.836163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":597,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835507+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:23.835507+0000","last_peered":"2024-09-12T22:13:23.835507+0000","last_clean":"2024-09-12T22:13:23.835507+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:23.835507+0000","last_undegraded":"2024-09-12T22:13:23.835507+0000","last_fullsized":"2024-09-12T22:13:23.835507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":615,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785728+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:20.785728+0000","last_peered":"2024-09-12T22:13:20.785728+0000","last_clean":"2024-09-12T22:13:20.785728+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:20.785728+0000","last_undegraded":"2024-09-12T22:13:20.785728+0000","last_fullsized":"2024-09-12T22:13:20.785728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":594,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835004+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:23.835004+0000","last_peered":"2024-09-12T22:13:23.835004+0000","last_clean":"2024-09-12T22:13:23.835004+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:23.835004+0000","last_undegraded":"2024-09-12T22:13:23.835004+0000","last_fullsized":"2024-09-12T22:13:23.835004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":684,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.834996+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:23.834996+0000","last_peered":"2024-09-12T22:13:23.834996+0000","last_clean":"2024-09-12T22:13:23.834996+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:23.834996+0000","last_undegraded":"2024-09-12T22:13:23.834996+0000","last_fullsized":"2024-09-12T22:13:23.834996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":582,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835812+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:23.835812+0000","last_peered":"2024-09-12T22:13:23.835812+0000","last_clean":"2024-09-12T22:13:23.835812+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:23.835812+0000","last_undegraded":"2024-09-12T22:13:23.835812+0000","last_fullsized":"2024-09-12T22:13:23.835812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":980,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777689+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:23.777689+0000","last_peered":"2024-09-12T22:13:23.777689+0000","last_clean":"2024-09-12T22:13:23.777689+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:23.777689+0000","last_undegraded":"2024-09-12T22:13:23.777689+0000","last_fullsized":"2024-09-12T22:13:23.777689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":518,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786269+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:20.786269+0000","last_peered":"2024-09-12T22:13:20.786269+0000","last_clean":"2024-09-12T22:13:20.786269+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:20.786269+0000","last_undegraded":"2024-09-12T22:13:20.786269+0000","last_fullsized":"2024-09-12T22:13:20.786269+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":547,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836207+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:23.836207+0000","last_peered":"2024-09-12T22:13:23.836207+0000","last_clean":"2024-09-12T22:13:23.836207+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:23.836207+0000","last_undegraded":"2024-09-12T22:13:23.836207+0000","last_fullsized":"2024-09-12T22:13:23.836207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":477,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786393+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:20.786393+0000","last_peered":"2024-09-12T22:13:20.786393+0000","last_clean":"2024-09-12T22:13:20.786393+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:20.786393+0000","last_undegraded":"2024-09-12T22:13:20.786393+0000","last_fullsized":"2024-09-12T22:13:20.786393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":567,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785922+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:20.785922+0000","last_peered":"2024-09-12T22:13:20.785922+0000","last_clean":"2024-09-12T22:13:20.785922+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:20.785922+0000","last_undegraded":"2024-09-12T22:13:20.785922+0000","last_fullsized":"2024-09-12T22:13:20.785922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":938,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835035+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:23.835035+0000","last_peered":"2024-09-12T22:13:23.835035+0000","last_clean":"2024-09-12T22:13:23.835035+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:23.835035+0000","last_undegraded":"2024-09-12T22:13:23.835035+0000","last_fullsized":"2024-09-12T22:13:23.835035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1037,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835074+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:23.835074+0000","last_peered":"2024-09-12T22:13:23.835074+0000","last_clean":"2024-09-12T22:13:23.835074+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:23.835074+0000","last_undegraded":"2024-09-12T22:13:23.835074+0000","last_fullsized":"2024-09-12T22:13:23.835074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":622,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835931+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:23.835931+0000","last_peered":"2024-09-12T22:13:23.835931+0000","last_clean":"2024-09-12T22:13:23.835931+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:23.835931+0000","last_undegraded":"2024-09-12T22:13:23.835931+0000","last_fullsized":"2024-09-12T22:13:23.835931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":937,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778204+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:23.778204+0000","last_peered":"2024-09-12T22:13:23.778204+0000","last_clean":"2024-09-12T22:13:23.778204+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:23.778204+0000","last_undegraded":"2024-09-12T22:13:23.778204+0000","last_fullsized":"2024-09-12T22:13:23.778204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":525,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786234+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:20.786234+0000","last_peered":"2024-09-12T22:13:20.786234+0000","last_clean":"2024-09-12T22:13:20.786234+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:20.786234+0000","last_undegraded":"2024-09-12T22:13:20.786234+0000","last_fullsized":"2024-09-12T22:13:20.786234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":974,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777724+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:23.777724+0000","last_peered":"2024-09-12T22:13:23.777724+0000","last_clean":"2024-09-12T22:13:23.777724+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:23.777724+0000","last_undegraded":"2024-09-12T22:13:23.777724+0000","last_fullsized":"2024-09-12T22:13:23.777724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":615,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835644+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:23.835644+0000","last_peered":"2024-09-12T22:13:23.835644+0000","last_clean":"2024-09-12T22:13:23.835644+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:23.835644+0000","last_undegraded":"2024-09-12T22:13:23.835644+0000","last_fullsized":"2024-09-12T22:13:23.835644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":667,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835263+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:23.835263+0000","last_peered":"2024-09-12T22:13:23.835263+0000","last_clean":"2024-09-12T22:13:23.835263+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:23.835263+0000","last_undegraded":"2024-09-12T22:13:23.835263+0000","last_fullsized":"2024-09-12T22:13:23.835263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":595,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787110+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:20.787110+0000","last_peered":"2024-09-12T22:13:20.787110+0000","last_clean":"2024-09-12T22:13:20.787110+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:20.787110+0000","last_undegraded":"2024-09-12T22:13:20.787110+0000","last_fullsized":"2024-09-12T22:13:20.787110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":656,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.776887+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:23.776887+0000","last_peered":"2024-09-12T22:13:23.776887+0000","last_clean":"2024-09-12T22:13:23.776887+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:23.776887+0000","last_undegraded":"2024-09-12T22:13:23.776887+0000","last_fullsized":"2024-09-12T22:13:23.776887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":552,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-12T22:13:20.785771+0000","last_change":"2024-09-12T22:13:20.785771+0000","last_active":"2024-09-12T22:13:07.722596+0000","last_peered":"2024-09-12T22:13:05.716300+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:10:32.246451+0000","last_became_peered":"2024-09-12T22:10:32.246451+0000","last_unstale":"2024-09-12T22:13:20.785771+0000","last_undegraded":"2024-09-12T22:13:20.785771+0000","last_fullsized":"2024-09-12T22:13:20.785771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":510,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786254+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:20.786254+0000","last_peered":"2024-09-12T22:13:20.786254+0000","last_clean":"2024-09-12T22:13:20.786254+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:20.786254+0000","last_undegraded":"2024-09-12T22:13:20.786254+0000","last_fullsized":"2024-09-12T22:13:20.786254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":657,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777867+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:23.777867+0000","last_peered":"2024-09-12T22:13:23.777867+0000","last_clean":"2024-09-12T22:13:23.777867+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:23.777867+0000","last_undegraded":"2024-09-12T22:13:23.777867+0000","last_fullsized":"2024-09-12T22:13:23.777867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":868,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836292+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:23.836292+0000","last_peered":"2024-09-12T22:13:23.836292+0000","last_clean":"2024-09-12T22:13:23.836292+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:23.836292+0000","last_undegraded":"2024-09-12T22:13:23.836292+0000","last_fullsized":"2024-09-12T22:13:23.836292+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":537,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786370+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:20.786370+0000","last_peered":"2024-09-12T22:13:20.786370+0000","last_clean":"2024-09-12T22:13:20.786370+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:20.786370+0000","last_undegraded":"2024-09-12T22:13:20.786370+0000","last_fullsized":"2024-09-12T22:13:20.786370+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":977,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777457+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:23.777457+0000","last_peered":"2024-09-12T22:13:23.777457+0000","last_clean":"2024-09-12T22:13:23.777457+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:23.777457+0000","last_undegraded":"2024-09-12T22:13:23.777457+0000","last_fullsized":"2024-09-12T22:13:23.777457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":627,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787027+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:20.787027+0000","last_peered":"2024-09-12T22:13:20.787027+0000","last_clean":"2024-09-12T22:13:20.787027+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:20.787027+0000","last_undegraded":"2024-09-12T22:13:20.787027+0000","last_fullsized":"2024-09-12T22:13:20.787027+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":932,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.776914+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:23.776914+0000","last_peered":"2024-09-12T22:13:23.776914+0000","last_clean":"2024-09-12T22:13:23.776914+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:23.776914+0000","last_undegraded":"2024-09-12T22:13:23.776914+0000","last_fullsized":"2024-09-12T22:13:23.776914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":994,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-12T22:13:23.713319+0000","last_change":"2024-09-12T22:13:23.835234+0000","last_active":"2024-09-12T22:13:23.835234+0000","last_peered":"2024-09-12T22:13:23.713319+0000","last_clean":"2024-09-12T22:13:05.717151+0000","last_became_active":"2024-09-12T22:13:08.827687+0000","last_became_peered":"2024-09-12T22:13:08.827687+0000","last_unstale":"2024-09-12T22:13:23.713319+0000","last_undegraded":"2024-09-12T22:13:23.713319+0000","last_fullsized":"2024-09-12T22:13:08.735102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":552,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786299+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:20.786299+0000","last_peered":"2024-09-12T22:13:20.786299+0000","last_clean":"2024-09-12T22:13:20.786299+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:20.786299+0000","last_undegraded":"2024-09-12T22:13:20.786299+0000","last_fullsized":"2024-09-12T22:13:20.786299+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":450,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835628+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:23.835628+0000","last_peered":"2024-09-12T22:13:23.835628+0000","last_clean":"2024-09-12T22:13:23.835628+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:23.835628+0000","last_undegraded":"2024-09-12T22:13:23.835628+0000","last_fullsized":"2024-09-12T22:13:23.835628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":553,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785940+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:20.785940+0000","last_peered":"2024-09-12T22:13:20.785940+0000","last_clean":"2024-09-12T22:13:20.785940+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:20.785940+0000","last_undegraded":"2024-09-12T22:13:20.785940+0000","last_fullsized":"2024-09-12T22:13:20.785940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":197,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777137+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:23.777137+0000","last_peered":"2024-09-12T22:13:23.777137+0000","last_clean":"2024-09-12T22:13:23.777137+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:23.777137+0000","last_undegraded":"2024-09-12T22:13:23.777137+0000","last_fullsized":"2024-09-12T22:13:23.777137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778165+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:23.778165+0000","last_peered":"2024-09-12T22:13:23.778165+0000","last_clean":"2024-09-12T22:13:23.778165+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:23.778165+0000","last_undegraded":"2024-09-12T22:13:23.778165+0000","last_fullsized":"2024-09-12T22:13:23.778165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785963+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:20.785963+0000","last_peered":"2024-09-12T22:13:20.785963+0000","last_clean":"2024-09-12T22:13:20.785963+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:20.785963+0000","last_undegraded":"2024-09-12T22:13:20.785963+0000","last_fullsized":"2024-09-12T22:13:20.785963+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":569,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777734+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:23.777734+0000","last_peered":"2024-09-12T22:13:23.777734+0000","last_clean":"2024-09-12T22:13:23.777734+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:23.777734+0000","last_undegraded":"2024-09-12T22:13:23.777734+0000","last_fullsized":"2024-09-12T22:13:23.777734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":217,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835978+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:23.835978+0000","last_peered":"2024-09-12T22:13:23.835978+0000","last_clean":"2024-09-12T22:13:23.835978+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:23.835978+0000","last_undegraded":"2024-09-12T22:13:23.835978+0000","last_fullsized":"2024-09-12T22:13:23.835978+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":309,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836633+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:23.836633+0000","last_peered":"2024-09-12T22:13:23.836633+0000","last_clean":"2024-09-12T22:13:23.836633+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:23.836633+0000","last_undegraded":"2024-09-12T22:13:23.836633+0000","last_fullsized":"2024-09-12T22:13:23.836633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":522,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786247+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:20.786247+0000","last_peered":"2024-09-12T22:13:20.786247+0000","last_clean":"2024-09-12T22:13:20.786247+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:20.786247+0000","last_undegraded":"2024-09-12T22:13:20.786247+0000","last_fullsized":"2024-09-12T22:13:20.786247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":330,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786098+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:20.786098+0000","last_peered":"2024-09-12T22:13:20.786098+0000","last_clean":"2024-09-12T22:13:20.786098+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:20.786098+0000","last_undegraded":"2024-09-12T22:13:20.786098+0000","last_fullsized":"2024-09-12T22:13:20.786098+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":575,"reported_epoch":78,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T22:13:20.779113+0000","last_change":"2024-09-12T22:13:09.232257+0000","last_active":"2024-09-12T22:13:20.779113+0000","last_peered":"2024-09-12T22:13:20.779113+0000","last_clean":"2024-09-12T22:09:49.932788+0000","last_became_active":"2024-09-12T22:13:08.796593+0000","last_became_peered":"2024-09-12T22:13:08.796593+0000","last_unstale":"2024-09-12T22:13:20.779113+0000","last_undegraded":"2024-09-12T22:13:09.232125+0000","last_fullsized":"2024-09-12T22:13:08.724199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":204,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":625,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836424+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:23.836424+0000","last_peered":"2024-09-12T22:13:23.836424+0000","last_clean":"2024-09-12T22:13:23.836424+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:23.836424+0000","last_undegraded":"2024-09-12T22:13:23.836424+0000","last_fullsized":"2024-09-12T22:13:23.836424+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":591,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835204+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:23.835204+0000","last_peered":"2024-09-12T22:13:23.835204+0000","last_clean":"2024-09-12T22:13:23.835204+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:23.835204+0000","last_undegraded":"2024-09-12T22:13:23.835204+0000","last_fullsized":"2024-09-12T22:13:23.835204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835943+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:23.835943+0000","last_peered":"2024-09-12T22:13:23.835943+0000","last_clean":"2024-09-12T22:13:23.835943+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:23.835943+0000","last_undegraded":"2024-09-12T22:13:23.835943+0000","last_fullsized":"2024-09-12T22:13:23.835943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":606,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777333+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:23.777333+0000","last_peered":"2024-09-12T22:13:23.777333+0000","last_clean":"2024-09-12T22:13:23.777333+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:23.777333+0000","last_undegraded":"2024-09-12T22:13:23.777333+0000","last_fullsized":"2024-09-12T22:13:23.777333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":310,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777904+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:23.777904+0000","last_peered":"2024-09-12T22:13:23.777904+0000","last_clean":"2024-09-12T22:13:23.777904+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:23.777904+0000","last_undegraded":"2024-09-12T22:13:23.777904+0000","last_fullsized":"2024-09-12T22:13:23.777904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":667,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835751+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:23.835751+0000","last_peered":"2024-09-12T22:13:23.835751+0000","last_clean":"2024-09-12T22:13:23.835751+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:23.835751+0000","last_undegraded":"2024-09-12T22:13:23.835751+0000","last_fullsized":"2024-09-12T22:13:23.835751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":213,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786937+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:20.786937+0000","last_peered":"2024-09-12T22:13:20.786937+0000","last_clean":"2024-09-12T22:13:20.786937+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:20.786937+0000","last_undegraded":"2024-09-12T22:13:20.786937+0000","last_fullsized":"2024-09-12T22:13:20.786937+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":894,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836462+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:23.836462+0000","last_peered":"2024-09-12T22:13:23.836462+0000","last_clean":"2024-09-12T22:13:23.836462+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:23.836462+0000","last_undegraded":"2024-09-12T22:13:23.836462+0000","last_fullsized":"2024-09-12T22:13:23.836462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785472+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:20.785472+0000","last_peered":"2024-09-12T22:13:20.785472+0000","last_clean":"2024-09-12T22:13:20.785472+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:20.785472+0000","last_undegraded":"2024-09-12T22:13:20.785472+0000","last_fullsized":"2024-09-12T22:13:20.785472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":839,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836366+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:23.836366+0000","last_peered":"2024-09-12T22:13:23.836366+0000","last_clean":"2024-09-12T22:13:23.836366+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:23.836366+0000","last_undegraded":"2024-09-12T22:13:23.836366+0000","last_fullsized":"2024-09-12T22:13:23.836366+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":596,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786663+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:20.786663+0000","last_peered":"2024-09-12T22:13:20.786663+0000","last_clean":"2024-09-12T22:13:20.786663+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:20.786663+0000","last_undegraded":"2024-09-12T22:13:20.786663+0000","last_fullsized":"2024-09-12T22:13:20.786663+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":974,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777808+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:23.777808+0000","last_peered":"2024-09-12T22:13:23.777808+0000","last_clean":"2024-09-12T22:13:23.777808+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:23.777808+0000","last_undegraded":"2024-09-12T22:13:23.777808+0000","last_fullsized":"2024-09-12T22:13:23.777808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":356,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836438+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:23.836438+0000","last_peered":"2024-09-12T22:13:23.836438+0000","last_clean":"2024-09-12T22:13:23.836438+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:23.836438+0000","last_undegraded":"2024-09-12T22:13:23.836438+0000","last_fullsized":"2024-09-12T22:13:23.836438+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835750+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:23.835750+0000","last_peered":"2024-09-12T22:13:23.835750+0000","last_clean":"2024-09-12T22:13:23.835750+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:23.835750+0000","last_undegraded":"2024-09-12T22:13:23.835750+0000","last_fullsized":"2024-09-12T22:13:23.835750+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":762,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777274+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:23.777274+0000","last_peered":"2024-09-12T22:13:23.777274+0000","last_clean":"2024-09-12T22:13:23.777274+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:23.777274+0000","last_undegraded":"2024-09-12T22:13:23.777274+0000","last_fullsized":"2024-09-12T22:13:23.777274+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":990,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.837820+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:23.837820+0000","last_peered":"2024-09-12T22:13:23.837820+0000","last_clean":"2024-09-12T22:13:23.837820+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:23.837820+0000","last_undegraded":"2024-09-12T22:13:23.837820+0000","last_fullsized":"2024-09-12T22:13:23.837820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836385+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:23.836385+0000","last_peered":"2024-09-12T22:13:23.836385+0000","last_clean":"2024-09-12T22:13:23.836385+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:23.836385+0000","last_undegraded":"2024-09-12T22:13:23.836385+0000","last_fullsized":"2024-09-12T22:13:23.836385+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":296,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777322+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:23.777322+0000","last_peered":"2024-09-12T22:13:23.777322+0000","last_clean":"2024-09-12T22:13:23.777322+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:23.777322+0000","last_undegraded":"2024-09-12T22:13:23.777322+0000","last_fullsized":"2024-09-12T22:13:23.777322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":605,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786446+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:20.786446+0000","last_peered":"2024-09-12T22:13:20.786446+0000","last_clean":"2024-09-12T22:13:20.786446+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:20.786446+0000","last_undegraded":"2024-09-12T22:13:20.786446+0000","last_fullsized":"2024-09-12T22:13:20.786446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777581+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:23.777581+0000","last_peered":"2024-09-12T22:13:23.777581+0000","last_clean":"2024-09-12T22:13:23.777581+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:23.777581+0000","last_undegraded":"2024-09-12T22:13:23.777581+0000","last_fullsized":"2024-09-12T22:13:23.777581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":501,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785630+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:20.785630+0000","last_peered":"2024-09-12T22:13:20.785630+0000","last_clean":"2024-09-12T22:13:20.785630+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:20.785630+0000","last_undegraded":"2024-09-12T22:13:20.785630+0000","last_fullsized":"2024-09-12T22:13:20.785630+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":822,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777975+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:23.777975+0000","last_peered":"2024-09-12T22:13:23.777975+0000","last_clean":"2024-09-12T22:13:23.777975+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:23.777975+0000","last_undegraded":"2024-09-12T22:13:23.777975+0000","last_fullsized":"2024-09-12T22:13:23.777975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835252+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:23.835252+0000","last_peered":"2024-09-12T22:13:23.835252+0000","last_clean":"2024-09-12T22:13:23.835252+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:23.835252+0000","last_undegraded":"2024-09-12T22:13:23.835252+0000","last_fullsized":"2024-09-12T22:13:23.835252+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785942+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:20.785942+0000","last_peered":"2024-09-12T22:13:20.785942+0000","last_clean":"2024-09-12T22:13:20.785942+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:20.785942+0000","last_undegraded":"2024-09-12T22:13:20.785942+0000","last_fullsized":"2024-09-12T22:13:20.785942+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":933,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777624+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:23.777624+0000","last_peered":"2024-09-12T22:13:23.777624+0000","last_clean":"2024-09-12T22:13:23.777624+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:23.777624+0000","last_undegraded":"2024-09-12T22:13:23.777624+0000","last_fullsized":"2024-09-12T22:13:23.777624+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":421,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836546+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:23.836546+0000","last_peered":"2024-09-12T22:13:23.836546+0000","last_clean":"2024-09-12T22:13:23.836546+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:23.836546+0000","last_undegraded":"2024-09-12T22:13:23.836546+0000","last_fullsized":"2024-09-12T22:13:23.836546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835132+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:23.835132+0000","last_peered":"2024-09-12T22:13:23.835132+0000","last_clean":"2024-09-12T22:13:23.835132+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:23.835132+0000","last_undegraded":"2024-09-12T22:13:23.835132+0000","last_fullsized":"2024-09-12T22:13:23.835132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":493,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.787086+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:20.787086+0000","last_peered":"2024-09-12T22:13:20.787086+0000","last_clean":"2024-09-12T22:13:20.787086+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:20.787086+0000","last_undegraded":"2024-09-12T22:13:20.787086+0000","last_fullsized":"2024-09-12T22:13:20.787086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":205,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777752+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:23.777752+0000","last_peered":"2024-09-12T22:13:23.777752+0000","last_clean":"2024-09-12T22:13:23.777752+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:23.777752+0000","last_undegraded":"2024-09-12T22:13:23.777752+0000","last_fullsized":"2024-09-12T22:13:23.777752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786507+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:20.786507+0000","last_peered":"2024-09-12T22:13:20.786507+0000","last_clean":"2024-09-12T22:13:20.786507+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:20.786507+0000","last_undegraded":"2024-09-12T22:13:20.786507+0000","last_fullsized":"2024-09-12T22:13:20.786507+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":532,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785841+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:20.785841+0000","last_peered":"2024-09-12T22:13:20.785841+0000","last_clean":"2024-09-12T22:13:20.785841+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:20.785841+0000","last_undegraded":"2024-09-12T22:13:20.785841+0000","last_fullsized":"2024-09-12T22:13:20.785841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":212,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778207+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:23.778207+0000","last_peered":"2024-09-12T22:13:23.778207+0000","last_clean":"2024-09-12T22:13:23.778207+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:23.778207+0000","last_undegraded":"2024-09-12T22:13:23.778207+0000","last_fullsized":"2024-09-12T22:13:23.778207+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778206+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:23.778206+0000","last_peered":"2024-09-12T22:13:23.778206+0000","last_clean":"2024-09-12T22:13:23.778206+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:23.778206+0000","last_undegraded":"2024-09-12T22:13:23.778206+0000","last_fullsized":"2024-09-12T22:13:23.778206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":564,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777133+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:23.777133+0000","last_peered":"2024-09-12T22:13:23.777133+0000","last_clean":"2024-09-12T22:13:23.777133+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:23.777133+0000","last_undegraded":"2024-09-12T22:13:23.777133+0000","last_fullsized":"2024-09-12T22:13:23.777133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":234,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785942+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:20.785942+0000","last_peered":"2024-09-12T22:13:20.785942+0000","last_clean":"2024-09-12T22:13:20.785942+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:20.785942+0000","last_undegraded":"2024-09-12T22:13:20.785942+0000","last_fullsized":"2024-09-12T22:13:20.785942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836638+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:23.836638+0000","last_peered":"2024-09-12T22:13:23.836638+0000","last_clean":"2024-09-12T22:13:23.836638+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:23.836638+0000","last_undegraded":"2024-09-12T22:13:23.836638+0000","last_fullsized":"2024-09-12T22:13:23.836638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":666,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785995+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:20.785995+0000","last_peered":"2024-09-12T22:13:20.785995+0000","last_clean":"2024-09-12T22:13:20.785995+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:20.785995+0000","last_undegraded":"2024-09-12T22:13:20.785995+0000","last_fullsized":"2024-09-12T22:13:20.785995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":904,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835626+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:23.835626+0000","last_peered":"2024-09-12T22:13:23.835626+0000","last_clean":"2024-09-12T22:13:23.835626+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:23.835626+0000","last_undegraded":"2024-09-12T22:13:23.835626+0000","last_fullsized":"2024-09-12T22:13:23.835626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835882+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:23.835882+0000","last_peered":"2024-09-12T22:13:23.835882+0000","last_clean":"2024-09-12T22:13:23.835882+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:23.835882+0000","last_undegraded":"2024-09-12T22:13:23.835882+0000","last_fullsized":"2024-09-12T22:13:23.835882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1022,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777004+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:23.777004+0000","last_peered":"2024-09-12T22:13:23.777004+0000","last_clean":"2024-09-12T22:13:23.777004+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:23.777004+0000","last_undegraded":"2024-09-12T22:13:23.777004+0000","last_fullsized":"2024-09-12T22:13:23.777004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786406+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:20.786406+0000","last_peered":"2024-09-12T22:13:20.786406+0000","last_clean":"2024-09-12T22:13:20.786406+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:20.786406+0000","last_undegraded":"2024-09-12T22:13:20.786406+0000","last_fullsized":"2024-09-12T22:13:20.786406+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":319,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785828+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:20.785828+0000","last_peered":"2024-09-12T22:13:20.785828+0000","last_clean":"2024-09-12T22:13:20.785828+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:20.785828+0000","last_undegraded":"2024-09-12T22:13:20.785828+0000","last_fullsized":"2024-09-12T22:13:20.785828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":686,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777020+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:23.777020+0000","last_peered":"2024-09-12T22:13:23.777020+0000","last_clean":"2024-09-12T22:13:23.777020+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:23.777020+0000","last_undegraded":"2024-09-12T22:13:23.777020+0000","last_fullsized":"2024-09-12T22:13:23.777020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":190,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778094+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:23.778094+0000","last_peered":"2024-09-12T22:13:23.778094+0000","last_clean":"2024-09-12T22:13:23.778094+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:23.778094+0000","last_undegraded":"2024-09-12T22:13:23.778094+0000","last_fullsized":"2024-09-12T22:13:23.778094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1018,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777007+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:23.777007+0000","last_peered":"2024-09-12T22:13:23.777007+0000","last_clean":"2024-09-12T22:13:23.777007+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:23.777007+0000","last_undegraded":"2024-09-12T22:13:23.777007+0000","last_fullsized":"2024-09-12T22:13:23.777007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":509,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786569+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:20.786569+0000","last_peered":"2024-09-12T22:13:20.786569+0000","last_clean":"2024-09-12T22:13:20.786569+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:20.786569+0000","last_undegraded":"2024-09-12T22:13:20.786569+0000","last_fullsized":"2024-09-12T22:13:20.786569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":920,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777224+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:23.777224+0000","last_peered":"2024-09-12T22:13:23.777224+0000","last_clean":"2024-09-12T22:13:23.777224+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:23.777224+0000","last_undegraded":"2024-09-12T22:13:23.777224+0000","last_fullsized":"2024-09-12T22:13:23.777224+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":577,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777906+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:23.777906+0000","last_peered":"2024-09-12T22:13:23.777906+0000","last_clean":"2024-09-12T22:13:23.777906+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:23.777906+0000","last_undegraded":"2024-09-12T22:13:23.777906+0000","last_fullsized":"2024-09-12T22:13:23.777906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":324,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777172+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:23.777172+0000","last_peered":"2024-09-12T22:13:23.777172+0000","last_clean":"2024-09-12T22:13:23.777172+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:23.777172+0000","last_undegraded":"2024-09-12T22:13:23.777172+0000","last_fullsized":"2024-09-12T22:13:23.777172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":515,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.792676+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:20.792676+0000","last_peered":"2024-09-12T22:13:20.792676+0000","last_clean":"2024-09-12T22:13:20.792676+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:20.792676+0000","last_undegraded":"2024-09-12T22:13:20.792676+0000","last_fullsized":"2024-09-12T22:13:20.792676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":275,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786999+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:20.786999+0000","last_peered":"2024-09-12T22:13:20.786999+0000","last_clean":"2024-09-12T22:13:20.786999+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:20.786999+0000","last_undegraded":"2024-09-12T22:13:20.786999+0000","last_fullsized":"2024-09-12T22:13:20.786999+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":525,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.786251+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:20.786251+0000","last_peered":"2024-09-12T22:13:20.786251+0000","last_clean":"2024-09-12T22:13:20.786251+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:20.786251+0000","last_undegraded":"2024-09-12T22:13:20.786251+0000","last_fullsized":"2024-09-12T22:13:20.786251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785622+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:20.785622+0000","last_peered":"2024-09-12T22:13:20.785622+0000","last_clean":"2024-09-12T22:13:20.785622+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:20.785622+0000","last_undegraded":"2024-09-12T22:13:20.785622+0000","last_fullsized":"2024-09-12T22:13:20.785622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":525,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835500+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:23.835500+0000","last_peered":"2024-09-12T22:13:23.835500+0000","last_clean":"2024-09-12T22:13:23.835500+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:23.835500+0000","last_undegraded":"2024-09-12T22:13:23.835500+0000","last_fullsized":"2024-09-12T22:13:23.835500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":326,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835808+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:23.835808+0000","last_peered":"2024-09-12T22:13:23.835808+0000","last_clean":"2024-09-12T22:13:23.835808+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:23.835808+0000","last_undegraded":"2024-09-12T22:13:23.835808+0000","last_fullsized":"2024-09-12T22:13:23.835808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":892,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.835151+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:23.835151+0000","last_peered":"2024-09-12T22:13:23.835151+0000","last_clean":"2024-09-12T22:13:23.835151+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:23.835151+0000","last_undegraded":"2024-09-12T22:13:23.835151+0000","last_fullsized":"2024-09-12T22:13:23.835151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":300,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785838+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:20.785838+0000","last_peered":"2024-09-12T22:13:20.785838+0000","last_clean":"2024-09-12T22:13:20.785838+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:20.785838+0000","last_undegraded":"2024-09-12T22:13:20.785838+0000","last_fullsized":"2024-09-12T22:13:20.785838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":567,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T22:13:20.785854+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:20.785854+0000","last_peered":"2024-09-12T22:13:20.785854+0000","last_clean":"2024-09-12T22:13:20.785854+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:20.785854+0000","last_undegraded":"2024-09-12T22:13:20.785854+0000","last_fullsized":"2024-09-12T22:13:20.785854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":209,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.778104+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:23.778104+0000","last_peered":"2024-09-12T22:13:23.778104+0000","last_clean":"2024-09-12T22:13:23.778104+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:23.778104+0000","last_undegraded":"2024-09-12T22:13:23.778104+0000","last_fullsized":"2024-09-12T22:13:23.778104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":648,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.836162+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:23.836162+0000","last_peered":"2024-09-12T22:13:23.836162+0000","last_clean":"2024-09-12T22:13:23.836162+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:23.836162+0000","last_undegraded":"2024-09-12T22:13:23.836162+0000","last_fullsized":"2024-09-12T22:13:23.836162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":250,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T22:13:23.777930+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:23.777930+0000","last_peered":"2024-09-12T22:13:23.777930+0000","last_clean":"2024-09-12T22:13:23.777930+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:23.777930+0000","last_undegraded":"2024-09-12T22:13:23.777930+0000","last_fullsized":"2024-09-12T22:13:23.777930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":384,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68456,"kb_used_data":18708,"kb_used_omap":5,"kb_used_meta":49722,"kb_avail":94303384,"statfs":{"total":96636764160,"available":96566665216,"internally_reserved":0,"allocated":19156992,"data_stored":93167796,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":50915434},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114640,"kb_used_data":25208,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257200,"statfs":{"total":96636764160,"available":96519372800,"internally_reserved":0,"allocated":25812992,"data_stored":77908297,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118480,"kb_used_data":29048,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253360,"statfs":{"total":96636764160,"available":96515440640,"internally_reserved":0,"allocated":29745152,"data_stored":85667018,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:29.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:29.316 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:29.318 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:29.328 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-12T22:13:29.127161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309984,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805536,"statfs":{"total":289910292480,"available":289592868864,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-759,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1049,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.346467"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":577,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783387+0000","last_change":"2024-09-12T22:13:23.781184+0000","last_active":"2024-09-12T22:13:24.783387+0000","last_peered":"2024-09-12T22:13:24.783387+0000","last_clean":"2024-09-12T22:13:24.783387+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:13:24.783387+0000","last_undegraded":"2024-09-12T22:13:24.783387+0000","last_fullsized":"2024-09-12T22:13:24.783387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.501549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783355+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:24.783355+0000","last_peered":"2024-09-12T22:13:24.783355+0000","last_clean":"2024-09-12T22:13:24.783355+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:24.783355+0000","last_undegraded":"2024-09-12T22:13:24.783355+0000","last_fullsized":"2024-09-12T22:13:24.783355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":866,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781319+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:24.781319+0000","last_peered":"2024-09-12T22:13:24.781319+0000","last_clean":"2024-09-12T22:13:24.781319+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:24.781319+0000","last_undegraded":"2024-09-12T22:13:24.781319+0000","last_fullsized":"2024-09-12T22:13:24.781319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":599,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781138+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:24.781138+0000","last_peered":"2024-09-12T22:13:24.781138+0000","last_clean":"2024-09-12T22:13:24.781138+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:24.781138+0000","last_undegraded":"2024-09-12T22:13:24.781138+0000","last_fullsized":"2024-09-12T22:13:24.781138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":623,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780765+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:24.780765+0000","last_peered":"2024-09-12T22:13:24.780765+0000","last_clean":"2024-09-12T22:13:24.780765+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:24.780765+0000","last_undegraded":"2024-09-12T22:13:24.780765+0000","last_fullsized":"2024-09-12T22:13:24.780765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":686,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780956+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:24.780956+0000","last_peered":"2024-09-12T22:13:24.780956+0000","last_clean":"2024-09-12T22:13:24.780956+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:24.780956+0000","last_undegraded":"2024-09-12T22:13:24.780956+0000","last_fullsized":"2024-09-12T22:13:24.780956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780690+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:24.780690+0000","last_peered":"2024-09-12T22:13:24.780690+0000","last_clean":"2024-09-12T22:13:24.780690+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:24.780690+0000","last_undegraded":"2024-09-12T22:13:24.780690+0000","last_fullsized":"2024-09-12T22:13:24.780690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":982,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780825+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:24.780825+0000","last_peered":"2024-09-12T22:13:24.780825+0000","last_clean":"2024-09-12T22:13:24.780825+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:24.780825+0000","last_undegraded":"2024-09-12T22:13:24.780825+0000","last_fullsized":"2024-09-12T22:13:24.780825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783311+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:24.783311+0000","last_peered":"2024-09-12T22:13:24.783311+0000","last_clean":"2024-09-12T22:13:24.783311+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:24.783311+0000","last_undegraded":"2024-09-12T22:13:24.783311+0000","last_fullsized":"2024-09-12T22:13:24.783311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781586+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:24.781586+0000","last_peered":"2024-09-12T22:13:24.781586+0000","last_clean":"2024-09-12T22:13:24.781586+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:24.781586+0000","last_undegraded":"2024-09-12T22:13:24.781586+0000","last_fullsized":"2024-09-12T22:13:24.781586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":485,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783141+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:24.783141+0000","last_peered":"2024-09-12T22:13:24.783141+0000","last_clean":"2024-09-12T22:13:24.783141+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:24.783141+0000","last_undegraded":"2024-09-12T22:13:24.783141+0000","last_fullsized":"2024-09-12T22:13:24.783141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782600+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:24.782600+0000","last_peered":"2024-09-12T22:13:24.782600+0000","last_clean":"2024-09-12T22:13:24.782600+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:24.782600+0000","last_undegraded":"2024-09-12T22:13:24.782600+0000","last_fullsized":"2024-09-12T22:13:24.782600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":940,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780983+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:24.780983+0000","last_peered":"2024-09-12T22:13:24.780983+0000","last_clean":"2024-09-12T22:13:24.780983+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:24.780983+0000","last_undegraded":"2024-09-12T22:13:24.780983+0000","last_fullsized":"2024-09-12T22:13:24.780983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1039,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781025+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:24.781025+0000","last_peered":"2024-09-12T22:13:24.781025+0000","last_clean":"2024-09-12T22:13:24.781025+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:24.781025+0000","last_undegraded":"2024-09-12T22:13:24.781025+0000","last_fullsized":"2024-09-12T22:13:24.781025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":624,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781202+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:24.781202+0000","last_peered":"2024-09-12T22:13:24.781202+0000","last_clean":"2024-09-12T22:13:24.781202+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:24.781202+0000","last_undegraded":"2024-09-12T22:13:24.781202+0000","last_fullsized":"2024-09-12T22:13:24.781202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":939,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781309+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:24.781309+0000","last_peered":"2024-09-12T22:13:24.781309+0000","last_clean":"2024-09-12T22:13:24.781309+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:24.781309+0000","last_undegraded":"2024-09-12T22:13:24.781309+0000","last_fullsized":"2024-09-12T22:13:24.781309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783153+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:24.783153+0000","last_peered":"2024-09-12T22:13:24.783153+0000","last_clean":"2024-09-12T22:13:24.783153+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:24.783153+0000","last_undegraded":"2024-09-12T22:13:24.783153+0000","last_fullsized":"2024-09-12T22:13:24.783153+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780749+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:24.780749+0000","last_peered":"2024-09-12T22:13:24.780749+0000","last_clean":"2024-09-12T22:13:24.780749+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:24.780749+0000","last_undegraded":"2024-09-12T22:13:24.780749+0000","last_fullsized":"2024-09-12T22:13:24.780749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":617,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781177+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:24.781177+0000","last_peered":"2024-09-12T22:13:24.781177+0000","last_clean":"2024-09-12T22:13:24.781177+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:24.781177+0000","last_undegraded":"2024-09-12T22:13:24.781177+0000","last_fullsized":"2024-09-12T22:13:24.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780992+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:24.780992+0000","last_peered":"2024-09-12T22:13:24.780992+0000","last_clean":"2024-09-12T22:13:24.780992+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:24.780992+0000","last_undegraded":"2024-09-12T22:13:24.780992+0000","last_fullsized":"2024-09-12T22:13:24.780992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":603,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783042+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:24.783042+0000","last_peered":"2024-09-12T22:13:24.783042+0000","last_clean":"2024-09-12T22:13:24.783042+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:24.783042+0000","last_undegraded":"2024-09-12T22:13:24.783042+0000","last_fullsized":"2024-09-12T22:13:24.783042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":658,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780069+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:24.780069+0000","last_peered":"2024-09-12T22:13:24.780069+0000","last_clean":"2024-09-12T22:13:24.780069+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:24.780069+0000","last_undegraded":"2024-09-12T22:13:24.780069+0000","last_fullsized":"2024-09-12T22:13:24.780069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782800+0000","last_change":"2024-09-12T22:13:21.785416+0000","last_active":"2024-09-12T22:13:24.782800+0000","last_peered":"2024-09-12T22:13:24.782800+0000","last_clean":"2024-09-12T22:13:24.782800+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:13:24.782800+0000","last_undegraded":"2024-09-12T22:13:24.782800+0000","last_fullsized":"2024-09-12T22:13:24.782800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:11.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":518,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783050+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:24.783050+0000","last_peered":"2024-09-12T22:13:24.783050+0000","last_clean":"2024-09-12T22:13:24.783050+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:24.783050+0000","last_undegraded":"2024-09-12T22:13:24.783050+0000","last_fullsized":"2024-09-12T22:13:24.783050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780957+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:24.780957+0000","last_peered":"2024-09-12T22:13:24.780957+0000","last_clean":"2024-09-12T22:13:24.780957+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:24.780957+0000","last_undegraded":"2024-09-12T22:13:24.780957+0000","last_fullsized":"2024-09-12T22:13:24.780957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":870,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781672+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:24.781672+0000","last_peered":"2024-09-12T22:13:24.781672+0000","last_clean":"2024-09-12T22:13:24.781672+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:24.781672+0000","last_undegraded":"2024-09-12T22:13:24.781672+0000","last_fullsized":"2024-09-12T22:13:24.781672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":545,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782949+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:24.782949+0000","last_peered":"2024-09-12T22:13:24.782949+0000","last_clean":"2024-09-12T22:13:24.782949+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:24.782949+0000","last_undegraded":"2024-09-12T22:13:24.782949+0000","last_fullsized":"2024-09-12T22:13:24.782949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":979,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780784+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:24.780784+0000","last_peered":"2024-09-12T22:13:24.780784+0000","last_clean":"2024-09-12T22:13:24.780784+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:24.780784+0000","last_undegraded":"2024-09-12T22:13:24.780784+0000","last_fullsized":"2024-09-12T22:13:24.780784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":635,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782555+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:24.782555+0000","last_peered":"2024-09-12T22:13:24.782555+0000","last_clean":"2024-09-12T22:13:24.782555+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:24.782555+0000","last_undegraded":"2024-09-12T22:13:24.782555+0000","last_fullsized":"2024-09-12T22:13:24.782555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":934,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780124+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:24.780124+0000","last_peered":"2024-09-12T22:13:24.780124+0000","last_clean":"2024-09-12T22:13:24.780124+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:24.780124+0000","last_undegraded":"2024-09-12T22:13:24.780124+0000","last_fullsized":"2024-09-12T22:13:24.780124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1002,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.785126+0000","last_change":"2024-09-12T22:13:24.785126+0000","last_active":"2024-09-12T22:13:24.785126+0000","last_peered":"2024-09-12T22:13:24.785126+0000","last_clean":"2024-09-12T22:13:24.785126+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:13:24.785126+0000","last_undegraded":"2024-09-12T22:13:24.785126+0000","last_fullsized":"2024-09-12T22:13:24.785126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:01.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":560,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782376+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:24.782376+0000","last_peered":"2024-09-12T22:13:24.782376+0000","last_clean":"2024-09-12T22:13:24.782376+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:24.782376+0000","last_undegraded":"2024-09-12T22:13:24.782376+0000","last_fullsized":"2024-09-12T22:13:24.782376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":452,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781494+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:24.781494+0000","last_peered":"2024-09-12T22:13:24.781494+0000","last_clean":"2024-09-12T22:13:24.781494+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:24.781494+0000","last_undegraded":"2024-09-12T22:13:24.781494+0000","last_fullsized":"2024-09-12T22:13:24.781494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":561,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782748+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:24.782748+0000","last_peered":"2024-09-12T22:13:24.782748+0000","last_clean":"2024-09-12T22:13:24.782748+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:24.782748+0000","last_undegraded":"2024-09-12T22:13:24.782748+0000","last_fullsized":"2024-09-12T22:13:24.782748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780393+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:24.780393+0000","last_peered":"2024-09-12T22:13:24.780393+0000","last_clean":"2024-09-12T22:13:24.780393+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:24.780393+0000","last_undegraded":"2024-09-12T22:13:24.780393+0000","last_fullsized":"2024-09-12T22:13:24.780393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781190+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:24.781190+0000","last_peered":"2024-09-12T22:13:24.781190+0000","last_clean":"2024-09-12T22:13:24.781190+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:24.781190+0000","last_undegraded":"2024-09-12T22:13:24.781190+0000","last_fullsized":"2024-09-12T22:13:24.781190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782440+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:24.782440+0000","last_peered":"2024-09-12T22:13:24.782440+0000","last_clean":"2024-09-12T22:13:24.782440+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:24.782440+0000","last_undegraded":"2024-09-12T22:13:24.782440+0000","last_fullsized":"2024-09-12T22:13:24.782440+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780918+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:24.780918+0000","last_peered":"2024-09-12T22:13:24.780918+0000","last_clean":"2024-09-12T22:13:24.780918+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:24.780918+0000","last_undegraded":"2024-09-12T22:13:24.780918+0000","last_fullsized":"2024-09-12T22:13:24.780918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781248+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:24.781248+0000","last_peered":"2024-09-12T22:13:24.781248+0000","last_clean":"2024-09-12T22:13:24.781248+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:24.781248+0000","last_undegraded":"2024-09-12T22:13:24.781248+0000","last_fullsized":"2024-09-12T22:13:24.781248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":311,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781830+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:24.781830+0000","last_peered":"2024-09-12T22:13:24.781830+0000","last_clean":"2024-09-12T22:13:24.781830+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:24.781830+0000","last_undegraded":"2024-09-12T22:13:24.781830+0000","last_fullsized":"2024-09-12T22:13:24.781830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783139+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:24.783139+0000","last_peered":"2024-09-12T22:13:24.783139+0000","last_clean":"2024-09-12T22:13:24.783139+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:24.783139+0000","last_undegraded":"2024-09-12T22:13:24.783139+0000","last_fullsized":"2024-09-12T22:13:24.783139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":338,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783191+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:24.783191+0000","last_peered":"2024-09-12T22:13:24.783191+0000","last_clean":"2024-09-12T22:13:24.783191+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:24.783191+0000","last_undegraded":"2024-09-12T22:13:24.783191+0000","last_fullsized":"2024-09-12T22:13:24.783191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":553,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.787848+0000","last_change":"2024-09-12T22:13:24.787848+0000","last_active":"2024-09-12T22:13:24.787848+0000","last_peered":"2024-09-12T22:13:24.787848+0000","last_clean":"2024-09-12T22:13:24.787848+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:13:24.787848+0000","last_undegraded":"2024-09-12T22:13:24.787848+0000","last_fullsized":"2024-09-12T22:13:24.787848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:22.209835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":627,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781965+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:24.781965+0000","last_peered":"2024-09-12T22:13:24.781965+0000","last_clean":"2024-09-12T22:13:24.781965+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:24.781965+0000","last_undegraded":"2024-09-12T22:13:24.781965+0000","last_fullsized":"2024-09-12T22:13:24.781965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781125+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:24.781125+0000","last_peered":"2024-09-12T22:13:24.781125+0000","last_clean":"2024-09-12T22:13:24.781125+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:24.781125+0000","last_undegraded":"2024-09-12T22:13:24.781125+0000","last_fullsized":"2024-09-12T22:13:24.781125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":198,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781500+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:24.781500+0000","last_peered":"2024-09-12T22:13:24.781500+0000","last_clean":"2024-09-12T22:13:24.781500+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:24.781500+0000","last_undegraded":"2024-09-12T22:13:24.781500+0000","last_fullsized":"2024-09-12T22:13:24.781500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":608,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780535+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:24.780535+0000","last_peered":"2024-09-12T22:13:24.780535+0000","last_clean":"2024-09-12T22:13:24.780535+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:24.780535+0000","last_undegraded":"2024-09-12T22:13:24.780535+0000","last_fullsized":"2024-09-12T22:13:24.780535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":312,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780968+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:24.780968+0000","last_peered":"2024-09-12T22:13:24.780968+0000","last_clean":"2024-09-12T22:13:24.780968+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:24.780968+0000","last_undegraded":"2024-09-12T22:13:24.780968+0000","last_fullsized":"2024-09-12T22:13:24.780968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781304+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:24.781304+0000","last_peered":"2024-09-12T22:13:24.781304+0000","last_clean":"2024-09-12T22:13:24.781304+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:24.781304+0000","last_undegraded":"2024-09-12T22:13:24.781304+0000","last_fullsized":"2024-09-12T22:13:24.781304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782279+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:24.782279+0000","last_peered":"2024-09-12T22:13:24.782279+0000","last_clean":"2024-09-12T22:13:24.782279+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:24.782279+0000","last_undegraded":"2024-09-12T22:13:24.782279+0000","last_fullsized":"2024-09-12T22:13:24.782279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":896,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781826+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:24.781826+0000","last_peered":"2024-09-12T22:13:24.781826+0000","last_clean":"2024-09-12T22:13:24.781826+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:24.781826+0000","last_undegraded":"2024-09-12T22:13:24.781826+0000","last_fullsized":"2024-09-12T22:13:24.781826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782087+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:24.782087+0000","last_peered":"2024-09-12T22:13:24.782087+0000","last_clean":"2024-09-12T22:13:24.782087+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:24.782087+0000","last_undegraded":"2024-09-12T22:13:24.782087+0000","last_fullsized":"2024-09-12T22:13:24.782087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":841,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781926+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:24.781926+0000","last_peered":"2024-09-12T22:13:24.781926+0000","last_clean":"2024-09-12T22:13:24.781926+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:24.781926+0000","last_undegraded":"2024-09-12T22:13:24.781926+0000","last_fullsized":"2024-09-12T22:13:24.781926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":604,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782990+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782990+0000","last_peered":"2024-09-12T22:13:24.782990+0000","last_clean":"2024-09-12T22:13:24.782990+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:24.782990+0000","last_undegraded":"2024-09-12T22:13:24.782990+0000","last_fullsized":"2024-09-12T22:13:24.782990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781071+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:24.781071+0000","last_peered":"2024-09-12T22:13:24.781071+0000","last_clean":"2024-09-12T22:13:24.781071+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:24.781071+0000","last_undegraded":"2024-09-12T22:13:24.781071+0000","last_fullsized":"2024-09-12T22:13:24.781071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":358,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781569+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:24.781569+0000","last_peered":"2024-09-12T22:13:24.781569+0000","last_clean":"2024-09-12T22:13:24.781569+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:24.781569+0000","last_undegraded":"2024-09-12T22:13:24.781569+0000","last_fullsized":"2024-09-12T22:13:24.781569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781558+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:24.781558+0000","last_peered":"2024-09-12T22:13:24.781558+0000","last_clean":"2024-09-12T22:13:24.781558+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:24.781558+0000","last_undegraded":"2024-09-12T22:13:24.781558+0000","last_fullsized":"2024-09-12T22:13:24.781558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":764,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780511+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:24.780511+0000","last_peered":"2024-09-12T22:13:24.780511+0000","last_clean":"2024-09-12T22:13:24.780511+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:24.780511+0000","last_undegraded":"2024-09-12T22:13:24.780511+0000","last_fullsized":"2024-09-12T22:13:24.780511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":992,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781862+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:24.781862+0000","last_peered":"2024-09-12T22:13:24.781862+0000","last_clean":"2024-09-12T22:13:24.781862+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:24.781862+0000","last_undegraded":"2024-09-12T22:13:24.781862+0000","last_fullsized":"2024-09-12T22:13:24.781862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781666+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:24.781666+0000","last_peered":"2024-09-12T22:13:24.781666+0000","last_clean":"2024-09-12T22:13:24.781666+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:24.781666+0000","last_undegraded":"2024-09-12T22:13:24.781666+0000","last_fullsized":"2024-09-12T22:13:24.781666+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":298,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780576+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:24.780576+0000","last_peered":"2024-09-12T22:13:24.780576+0000","last_clean":"2024-09-12T22:13:24.780576+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:24.780576+0000","last_undegraded":"2024-09-12T22:13:24.780576+0000","last_fullsized":"2024-09-12T22:13:24.780576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":613,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783486+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:24.783486+0000","last_peered":"2024-09-12T22:13:24.783486+0000","last_clean":"2024-09-12T22:13:24.783486+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:24.783486+0000","last_undegraded":"2024-09-12T22:13:24.783486+0000","last_fullsized":"2024-09-12T22:13:24.783486+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780621+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:24.780621+0000","last_peered":"2024-09-12T22:13:24.780621+0000","last_clean":"2024-09-12T22:13:24.780621+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:24.780621+0000","last_undegraded":"2024-09-12T22:13:24.780621+0000","last_fullsized":"2024-09-12T22:13:24.780621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782556+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:24.782556+0000","last_peered":"2024-09-12T22:13:24.782556+0000","last_clean":"2024-09-12T22:13:24.782556+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:24.782556+0000","last_undegraded":"2024-09-12T22:13:24.782556+0000","last_fullsized":"2024-09-12T22:13:24.782556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":824,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781096+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:24.781096+0000","last_peered":"2024-09-12T22:13:24.781096+0000","last_clean":"2024-09-12T22:13:24.781096+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:24.781096+0000","last_undegraded":"2024-09-12T22:13:24.781096+0000","last_fullsized":"2024-09-12T22:13:24.781096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781261+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:24.781261+0000","last_peered":"2024-09-12T22:13:24.781261+0000","last_clean":"2024-09-12T22:13:24.781261+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:24.781261+0000","last_undegraded":"2024-09-12T22:13:24.781261+0000","last_fullsized":"2024-09-12T22:13:24.781261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782545+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:24.782545+0000","last_peered":"2024-09-12T22:13:24.782545+0000","last_clean":"2024-09-12T22:13:24.782545+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:24.782545+0000","last_undegraded":"2024-09-12T22:13:24.782545+0000","last_fullsized":"2024-09-12T22:13:24.782545+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":935,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780747+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:24.780747+0000","last_peered":"2024-09-12T22:13:24.780747+0000","last_clean":"2024-09-12T22:13:24.780747+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:24.780747+0000","last_undegraded":"2024-09-12T22:13:24.780747+0000","last_fullsized":"2024-09-12T22:13:24.780747+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":423,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782014+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:24.782014+0000","last_peered":"2024-09-12T22:13:24.782014+0000","last_clean":"2024-09-12T22:13:24.782014+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:24.782014+0000","last_undegraded":"2024-09-12T22:13:24.782014+0000","last_fullsized":"2024-09-12T22:13:24.782014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780845+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:24.780845+0000","last_peered":"2024-09-12T22:13:24.780845+0000","last_clean":"2024-09-12T22:13:24.780845+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:24.780845+0000","last_undegraded":"2024-09-12T22:13:24.780845+0000","last_fullsized":"2024-09-12T22:13:24.780845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":501,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782933+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:24.782933+0000","last_peered":"2024-09-12T22:13:24.782933+0000","last_clean":"2024-09-12T22:13:24.782933+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:24.782933+0000","last_undegraded":"2024-09-12T22:13:24.782933+0000","last_fullsized":"2024-09-12T22:13:24.782933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":207,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781077+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:24.781077+0000","last_peered":"2024-09-12T22:13:24.781077+0000","last_clean":"2024-09-12T22:13:24.781077+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:24.781077+0000","last_undegraded":"2024-09-12T22:13:24.781077+0000","last_fullsized":"2024-09-12T22:13:24.781077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783170+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:24.783170+0000","last_peered":"2024-09-12T22:13:24.783170+0000","last_clean":"2024-09-12T22:13:24.783170+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:24.783170+0000","last_undegraded":"2024-09-12T22:13:24.783170+0000","last_fullsized":"2024-09-12T22:13:24.783170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":540,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782233+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:24.782233+0000","last_peered":"2024-09-12T22:13:24.782233+0000","last_clean":"2024-09-12T22:13:24.782233+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:24.782233+0000","last_undegraded":"2024-09-12T22:13:24.782233+0000","last_fullsized":"2024-09-12T22:13:24.782233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781330+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:24.781330+0000","last_peered":"2024-09-12T22:13:24.781330+0000","last_clean":"2024-09-12T22:13:24.781330+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:24.781330+0000","last_undegraded":"2024-09-12T22:13:24.781330+0000","last_fullsized":"2024-09-12T22:13:24.781330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781214+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:24.781214+0000","last_peered":"2024-09-12T22:13:24.781214+0000","last_clean":"2024-09-12T22:13:24.781214+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:24.781214+0000","last_undegraded":"2024-09-12T22:13:24.781214+0000","last_fullsized":"2024-09-12T22:13:24.781214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780274+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:24.780274+0000","last_peered":"2024-09-12T22:13:24.780274+0000","last_clean":"2024-09-12T22:13:24.780274+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:24.780274+0000","last_undegraded":"2024-09-12T22:13:24.780274+0000","last_fullsized":"2024-09-12T22:13:24.780274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":242,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782756+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:24.782756+0000","last_peered":"2024-09-12T22:13:24.782756+0000","last_clean":"2024-09-12T22:13:24.782756+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:24.782756+0000","last_undegraded":"2024-09-12T22:13:24.782756+0000","last_fullsized":"2024-09-12T22:13:24.782756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781912+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:24.781912+0000","last_peered":"2024-09-12T22:13:24.781912+0000","last_clean":"2024-09-12T22:13:24.781912+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:24.781912+0000","last_undegraded":"2024-09-12T22:13:24.781912+0000","last_fullsized":"2024-09-12T22:13:24.781912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":674,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782776+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:24.782776+0000","last_peered":"2024-09-12T22:13:24.782776+0000","last_clean":"2024-09-12T22:13:24.782776+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:24.782776+0000","last_undegraded":"2024-09-12T22:13:24.782776+0000","last_fullsized":"2024-09-12T22:13:24.782776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":906,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781312+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:24.781312+0000","last_peered":"2024-09-12T22:13:24.781312+0000","last_clean":"2024-09-12T22:13:24.781312+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:24.781312+0000","last_undegraded":"2024-09-12T22:13:24.781312+0000","last_fullsized":"2024-09-12T22:13:24.781312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":442,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781465+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:24.781465+0000","last_peered":"2024-09-12T22:13:24.781465+0000","last_clean":"2024-09-12T22:13:24.781465+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:24.781465+0000","last_undegraded":"2024-09-12T22:13:24.781465+0000","last_fullsized":"2024-09-12T22:13:24.781465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1024,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780241+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:24.780241+0000","last_peered":"2024-09-12T22:13:24.780241+0000","last_clean":"2024-09-12T22:13:24.780241+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:24.780241+0000","last_undegraded":"2024-09-12T22:13:24.780241+0000","last_fullsized":"2024-09-12T22:13:24.780241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782903+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:24.782903+0000","last_peered":"2024-09-12T22:13:24.782903+0000","last_clean":"2024-09-12T22:13:24.782903+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:24.782903+0000","last_undegraded":"2024-09-12T22:13:24.782903+0000","last_fullsized":"2024-09-12T22:13:24.782903+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":327,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782688+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:24.782688+0000","last_peered":"2024-09-12T22:13:24.782688+0000","last_clean":"2024-09-12T22:13:24.782688+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:24.782688+0000","last_undegraded":"2024-09-12T22:13:24.782688+0000","last_fullsized":"2024-09-12T22:13:24.782688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":688,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780256+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:24.780256+0000","last_peered":"2024-09-12T22:13:24.780256+0000","last_clean":"2024-09-12T22:13:24.780256+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:24.780256+0000","last_undegraded":"2024-09-12T22:13:24.780256+0000","last_fullsized":"2024-09-12T22:13:24.780256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":192,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781267+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:24.781267+0000","last_peered":"2024-09-12T22:13:24.781267+0000","last_clean":"2024-09-12T22:13:24.781267+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:24.781267+0000","last_undegraded":"2024-09-12T22:13:24.781267+0000","last_fullsized":"2024-09-12T22:13:24.781267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1020,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780205+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:24.780205+0000","last_peered":"2024-09-12T22:13:24.780205+0000","last_clean":"2024-09-12T22:13:24.780205+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:24.780205+0000","last_undegraded":"2024-09-12T22:13:24.780205+0000","last_fullsized":"2024-09-12T22:13:24.780205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":517,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783155+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:24.783155+0000","last_peered":"2024-09-12T22:13:24.783155+0000","last_clean":"2024-09-12T22:13:24.783155+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:24.783155+0000","last_undegraded":"2024-09-12T22:13:24.783155+0000","last_fullsized":"2024-09-12T22:13:24.783155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":922,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780397+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:24.780397+0000","last_peered":"2024-09-12T22:13:24.780397+0000","last_clean":"2024-09-12T22:13:24.780397+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:24.780397+0000","last_undegraded":"2024-09-12T22:13:24.780397+0000","last_fullsized":"2024-09-12T22:13:24.780397+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":579,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780899+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:24.780899+0000","last_peered":"2024-09-12T22:13:24.780899+0000","last_clean":"2024-09-12T22:13:24.780899+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:24.780899+0000","last_undegraded":"2024-09-12T22:13:24.780899+0000","last_fullsized":"2024-09-12T22:13:24.780899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":326,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780407+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:24.780407+0000","last_peered":"2024-09-12T22:13:24.780407+0000","last_clean":"2024-09-12T22:13:24.780407+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:24.780407+0000","last_undegraded":"2024-09-12T22:13:24.780407+0000","last_fullsized":"2024-09-12T22:13:24.780407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":523,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782824+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:24.782824+0000","last_peered":"2024-09-12T22:13:24.782824+0000","last_clean":"2024-09-12T22:13:24.782824+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:24.782824+0000","last_undegraded":"2024-09-12T22:13:24.782824+0000","last_fullsized":"2024-09-12T22:13:24.782824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":283,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782495+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782495+0000","last_peered":"2024-09-12T22:13:24.782495+0000","last_clean":"2024-09-12T22:13:24.782495+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:24.782495+0000","last_undegraded":"2024-09-12T22:13:24.782495+0000","last_fullsized":"2024-09-12T22:13:24.782495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782697+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:24.782697+0000","last_peered":"2024-09-12T22:13:24.782697+0000","last_clean":"2024-09-12T22:13:24.782697+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:24.782697+0000","last_undegraded":"2024-09-12T22:13:24.782697+0000","last_fullsized":"2024-09-12T22:13:24.782697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782280+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:24.782280+0000","last_peered":"2024-09-12T22:13:24.782280+0000","last_clean":"2024-09-12T22:13:24.782280+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:24.782280+0000","last_undegraded":"2024-09-12T22:13:24.782280+0000","last_fullsized":"2024-09-12T22:13:24.782280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781143+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:24.781143+0000","last_peered":"2024-09-12T22:13:24.781143+0000","last_clean":"2024-09-12T22:13:24.781143+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:24.781143+0000","last_undegraded":"2024-09-12T22:13:24.781143+0000","last_fullsized":"2024-09-12T22:13:24.781143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781348+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:24.781348+0000","last_peered":"2024-09-12T22:13:24.781348+0000","last_clean":"2024-09-12T22:13:24.781348+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:24.781348+0000","last_undegraded":"2024-09-12T22:13:24.781348+0000","last_fullsized":"2024-09-12T22:13:24.781348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":894,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781038+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:24.781038+0000","last_peered":"2024-09-12T22:13:24.781038+0000","last_clean":"2024-09-12T22:13:24.781038+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:24.781038+0000","last_undegraded":"2024-09-12T22:13:24.781038+0000","last_fullsized":"2024-09-12T22:13:24.781038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782691+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:24.782691+0000","last_peered":"2024-09-12T22:13:24.782691+0000","last_clean":"2024-09-12T22:13:24.782691+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:24.782691+0000","last_undegraded":"2024-09-12T22:13:24.782691+0000","last_fullsized":"2024-09-12T22:13:24.782691+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":211,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781130+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:24.781130+0000","last_peered":"2024-09-12T22:13:24.781130+0000","last_clean":"2024-09-12T22:13:24.781130+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:24.781130+0000","last_undegraded":"2024-09-12T22:13:24.781130+0000","last_fullsized":"2024-09-12T22:13:24.781130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":650,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781368+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:24.781368+0000","last_peered":"2024-09-12T22:13:24.781368+0000","last_clean":"2024-09-12T22:13:24.781368+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:24.781368+0000","last_undegraded":"2024-09-12T22:13:24.781368+0000","last_fullsized":"2024-09-12T22:13:24.781368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781216+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:24.781216+0000","last_peered":"2024-09-12T22:13:24.781216+0000","last_clean":"2024-09-12T22:13:24.781216+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:24.781216+0000","last_undegraded":"2024-09-12T22:13:24.781216+0000","last_fullsized":"2024-09-12T22:13:24.781216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906950,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76828,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295012,"statfs":{"total":96636764160,"available":96558092288,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114660,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257180,"statfs":{"total":96636764160,"available":96519352320,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118496,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253344,"statfs":{"total":96636764160,"available":96515424256,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:29.331 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T22:13:29.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T22:13:29.676 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T22:13:29.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:13:29.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:29.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:29.983 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:29.993 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-12T22:13:29.127161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309984,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805536,"statfs":{"total":289910292480,"available":289592868864,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-759,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1049,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.346467"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":577,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783387+0000","last_change":"2024-09-12T22:13:23.781184+0000","last_active":"2024-09-12T22:13:24.783387+0000","last_peered":"2024-09-12T22:13:24.783387+0000","last_clean":"2024-09-12T22:13:24.783387+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:13:24.783387+0000","last_undegraded":"2024-09-12T22:13:24.783387+0000","last_fullsized":"2024-09-12T22:13:24.783387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.501549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783355+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:24.783355+0000","last_peered":"2024-09-12T22:13:24.783355+0000","last_clean":"2024-09-12T22:13:24.783355+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:24.783355+0000","last_undegraded":"2024-09-12T22:13:24.783355+0000","last_fullsized":"2024-09-12T22:13:24.783355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":866,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781319+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:24.781319+0000","last_peered":"2024-09-12T22:13:24.781319+0000","last_clean":"2024-09-12T22:13:24.781319+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:24.781319+0000","last_undegraded":"2024-09-12T22:13:24.781319+0000","last_fullsized":"2024-09-12T22:13:24.781319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":599,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781138+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:24.781138+0000","last_peered":"2024-09-12T22:13:24.781138+0000","last_clean":"2024-09-12T22:13:24.781138+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:24.781138+0000","last_undegraded":"2024-09-12T22:13:24.781138+0000","last_fullsized":"2024-09-12T22:13:24.781138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":623,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780765+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:24.780765+0000","last_peered":"2024-09-12T22:13:24.780765+0000","last_clean":"2024-09-12T22:13:24.780765+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:24.780765+0000","last_undegraded":"2024-09-12T22:13:24.780765+0000","last_fullsized":"2024-09-12T22:13:24.780765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":686,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780956+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:24.780956+0000","last_peered":"2024-09-12T22:13:24.780956+0000","last_clean":"2024-09-12T22:13:24.780956+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:24.780956+0000","last_undegraded":"2024-09-12T22:13:24.780956+0000","last_fullsized":"2024-09-12T22:13:24.780956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780690+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:24.780690+0000","last_peered":"2024-09-12T22:13:24.780690+0000","last_clean":"2024-09-12T22:13:24.780690+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:24.780690+0000","last_undegraded":"2024-09-12T22:13:24.780690+0000","last_fullsized":"2024-09-12T22:13:24.780690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":982,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780825+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:24.780825+0000","last_peered":"2024-09-12T22:13:24.780825+0000","last_clean":"2024-09-12T22:13:24.780825+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:24.780825+0000","last_undegraded":"2024-09-12T22:13:24.780825+0000","last_fullsized":"2024-09-12T22:13:24.780825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783311+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:24.783311+0000","last_peered":"2024-09-12T22:13:24.783311+0000","last_clean":"2024-09-12T22:13:24.783311+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:24.783311+0000","last_undegraded":"2024-09-12T22:13:24.783311+0000","last_fullsized":"2024-09-12T22:13:24.783311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781586+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:24.781586+0000","last_peered":"2024-09-12T22:13:24.781586+0000","last_clean":"2024-09-12T22:13:24.781586+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:24.781586+0000","last_undegraded":"2024-09-12T22:13:24.781586+0000","last_fullsized":"2024-09-12T22:13:24.781586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":485,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783141+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:24.783141+0000","last_peered":"2024-09-12T22:13:24.783141+0000","last_clean":"2024-09-12T22:13:24.783141+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:24.783141+0000","last_undegraded":"2024-09-12T22:13:24.783141+0000","last_fullsized":"2024-09-12T22:13:24.783141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782600+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:24.782600+0000","last_peered":"2024-09-12T22:13:24.782600+0000","last_clean":"2024-09-12T22:13:24.782600+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:24.782600+0000","last_undegraded":"2024-09-12T22:13:24.782600+0000","last_fullsized":"2024-09-12T22:13:24.782600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":940,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780983+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:24.780983+0000","last_peered":"2024-09-12T22:13:24.780983+0000","last_clean":"2024-09-12T22:13:24.780983+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:24.780983+0000","last_undegraded":"2024-09-12T22:13:24.780983+0000","last_fullsized":"2024-09-12T22:13:24.780983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1039,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781025+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:24.781025+0000","last_peered":"2024-09-12T22:13:24.781025+0000","last_clean":"2024-09-12T22:13:24.781025+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:24.781025+0000","last_undegraded":"2024-09-12T22:13:24.781025+0000","last_fullsized":"2024-09-12T22:13:24.781025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":624,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781202+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:24.781202+0000","last_peered":"2024-09-12T22:13:24.781202+0000","last_clean":"2024-09-12T22:13:24.781202+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:24.781202+0000","last_undegraded":"2024-09-12T22:13:24.781202+0000","last_fullsized":"2024-09-12T22:13:24.781202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":939,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781309+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:24.781309+0000","last_peered":"2024-09-12T22:13:24.781309+0000","last_clean":"2024-09-12T22:13:24.781309+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:24.781309+0000","last_undegraded":"2024-09-12T22:13:24.781309+0000","last_fullsized":"2024-09-12T22:13:24.781309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783153+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:24.783153+0000","last_peered":"2024-09-12T22:13:24.783153+0000","last_clean":"2024-09-12T22:13:24.783153+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:24.783153+0000","last_undegraded":"2024-09-12T22:13:24.783153+0000","last_fullsized":"2024-09-12T22:13:24.783153+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780749+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:24.780749+0000","last_peered":"2024-09-12T22:13:24.780749+0000","last_clean":"2024-09-12T22:13:24.780749+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:24.780749+0000","last_undegraded":"2024-09-12T22:13:24.780749+0000","last_fullsized":"2024-09-12T22:13:24.780749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":617,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781177+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:24.781177+0000","last_peered":"2024-09-12T22:13:24.781177+0000","last_clean":"2024-09-12T22:13:24.781177+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:24.781177+0000","last_undegraded":"2024-09-12T22:13:24.781177+0000","last_fullsized":"2024-09-12T22:13:24.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780992+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:24.780992+0000","last_peered":"2024-09-12T22:13:24.780992+0000","last_clean":"2024-09-12T22:13:24.780992+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:24.780992+0000","last_undegraded":"2024-09-12T22:13:24.780992+0000","last_fullsized":"2024-09-12T22:13:24.780992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":603,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783042+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:24.783042+0000","last_peered":"2024-09-12T22:13:24.783042+0000","last_clean":"2024-09-12T22:13:24.783042+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:24.783042+0000","last_undegraded":"2024-09-12T22:13:24.783042+0000","last_fullsized":"2024-09-12T22:13:24.783042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":658,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780069+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:24.780069+0000","last_peered":"2024-09-12T22:13:24.780069+0000","last_clean":"2024-09-12T22:13:24.780069+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:24.780069+0000","last_undegraded":"2024-09-12T22:13:24.780069+0000","last_fullsized":"2024-09-12T22:13:24.780069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782800+0000","last_change":"2024-09-12T22:13:21.785416+0000","last_active":"2024-09-12T22:13:24.782800+0000","last_peered":"2024-09-12T22:13:24.782800+0000","last_clean":"2024-09-12T22:13:24.782800+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:13:24.782800+0000","last_undegraded":"2024-09-12T22:13:24.782800+0000","last_fullsized":"2024-09-12T22:13:24.782800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:11.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":518,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783050+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:24.783050+0000","last_peered":"2024-09-12T22:13:24.783050+0000","last_clean":"2024-09-12T22:13:24.783050+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:24.783050+0000","last_undegraded":"2024-09-12T22:13:24.783050+0000","last_fullsized":"2024-09-12T22:13:24.783050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780957+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:24.780957+0000","last_peered":"2024-09-12T22:13:24.780957+0000","last_clean":"2024-09-12T22:13:24.780957+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:24.780957+0000","last_undegraded":"2024-09-12T22:13:24.780957+0000","last_fullsized":"2024-09-12T22:13:24.780957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":870,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781672+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:24.781672+0000","last_peered":"2024-09-12T22:13:24.781672+0000","last_clean":"2024-09-12T22:13:24.781672+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:24.781672+0000","last_undegraded":"2024-09-12T22:13:24.781672+0000","last_fullsized":"2024-09-12T22:13:24.781672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":545,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782949+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:24.782949+0000","last_peered":"2024-09-12T22:13:24.782949+0000","last_clean":"2024-09-12T22:13:24.782949+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:24.782949+0000","last_undegraded":"2024-09-12T22:13:24.782949+0000","last_fullsized":"2024-09-12T22:13:24.782949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":979,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780784+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:24.780784+0000","last_peered":"2024-09-12T22:13:24.780784+0000","last_clean":"2024-09-12T22:13:24.780784+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:24.780784+0000","last_undegraded":"2024-09-12T22:13:24.780784+0000","last_fullsized":"2024-09-12T22:13:24.780784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":635,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782555+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:24.782555+0000","last_peered":"2024-09-12T22:13:24.782555+0000","last_clean":"2024-09-12T22:13:24.782555+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:24.782555+0000","last_undegraded":"2024-09-12T22:13:24.782555+0000","last_fullsized":"2024-09-12T22:13:24.782555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":934,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780124+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:24.780124+0000","last_peered":"2024-09-12T22:13:24.780124+0000","last_clean":"2024-09-12T22:13:24.780124+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:24.780124+0000","last_undegraded":"2024-09-12T22:13:24.780124+0000","last_fullsized":"2024-09-12T22:13:24.780124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1002,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.785126+0000","last_change":"2024-09-12T22:13:24.785126+0000","last_active":"2024-09-12T22:13:24.785126+0000","last_peered":"2024-09-12T22:13:24.785126+0000","last_clean":"2024-09-12T22:13:24.785126+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:13:24.785126+0000","last_undegraded":"2024-09-12T22:13:24.785126+0000","last_fullsized":"2024-09-12T22:13:24.785126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:01.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":560,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782376+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:24.782376+0000","last_peered":"2024-09-12T22:13:24.782376+0000","last_clean":"2024-09-12T22:13:24.782376+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:24.782376+0000","last_undegraded":"2024-09-12T22:13:24.782376+0000","last_fullsized":"2024-09-12T22:13:24.782376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":452,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781494+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:24.781494+0000","last_peered":"2024-09-12T22:13:24.781494+0000","last_clean":"2024-09-12T22:13:24.781494+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:24.781494+0000","last_undegraded":"2024-09-12T22:13:24.781494+0000","last_fullsized":"2024-09-12T22:13:24.781494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":561,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782748+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:24.782748+0000","last_peered":"2024-09-12T22:13:24.782748+0000","last_clean":"2024-09-12T22:13:24.782748+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:24.782748+0000","last_undegraded":"2024-09-12T22:13:24.782748+0000","last_fullsized":"2024-09-12T22:13:24.782748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780393+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:24.780393+0000","last_peered":"2024-09-12T22:13:24.780393+0000","last_clean":"2024-09-12T22:13:24.780393+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:24.780393+0000","last_undegraded":"2024-09-12T22:13:24.780393+0000","last_fullsized":"2024-09-12T22:13:24.780393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781190+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:24.781190+0000","last_peered":"2024-09-12T22:13:24.781190+0000","last_clean":"2024-09-12T22:13:24.781190+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:24.781190+0000","last_undegraded":"2024-09-12T22:13:24.781190+0000","last_fullsized":"2024-09-12T22:13:24.781190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782440+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:24.782440+0000","last_peered":"2024-09-12T22:13:24.782440+0000","last_clean":"2024-09-12T22:13:24.782440+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:24.782440+0000","last_undegraded":"2024-09-12T22:13:24.782440+0000","last_fullsized":"2024-09-12T22:13:24.782440+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780918+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:24.780918+0000","last_peered":"2024-09-12T22:13:24.780918+0000","last_clean":"2024-09-12T22:13:24.780918+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:24.780918+0000","last_undegraded":"2024-09-12T22:13:24.780918+0000","last_fullsized":"2024-09-12T22:13:24.780918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781248+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:24.781248+0000","last_peered":"2024-09-12T22:13:24.781248+0000","last_clean":"2024-09-12T22:13:24.781248+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:24.781248+0000","last_undegraded":"2024-09-12T22:13:24.781248+0000","last_fullsized":"2024-09-12T22:13:24.781248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":311,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781830+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:24.781830+0000","last_peered":"2024-09-12T22:13:24.781830+0000","last_clean":"2024-09-12T22:13:24.781830+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:24.781830+0000","last_undegraded":"2024-09-12T22:13:24.781830+0000","last_fullsized":"2024-09-12T22:13:24.781830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783139+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:24.783139+0000","last_peered":"2024-09-12T22:13:24.783139+0000","last_clean":"2024-09-12T22:13:24.783139+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:24.783139+0000","last_undegraded":"2024-09-12T22:13:24.783139+0000","last_fullsized":"2024-09-12T22:13:24.783139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":338,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783191+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:24.783191+0000","last_peered":"2024-09-12T22:13:24.783191+0000","last_clean":"2024-09-12T22:13:24.783191+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:24.783191+0000","last_undegraded":"2024-09-12T22:13:24.783191+0000","last_fullsized":"2024-09-12T22:13:24.783191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":553,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.787848+0000","last_change":"2024-09-12T22:13:24.787848+0000","last_active":"2024-09-12T22:13:24.787848+0000","last_peered":"2024-09-12T22:13:24.787848+0000","last_clean":"2024-09-12T22:13:24.787848+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:13:24.787848+0000","last_undegraded":"2024-09-12T22:13:24.787848+0000","last_fullsized":"2024-09-12T22:13:24.787848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:22.209835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":627,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781965+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:24.781965+0000","last_peered":"2024-09-12T22:13:24.781965+0000","last_clean":"2024-09-12T22:13:24.781965+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:24.781965+0000","last_undegraded":"2024-09-12T22:13:24.781965+0000","last_fullsized":"2024-09-12T22:13:24.781965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781125+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:24.781125+0000","last_peered":"2024-09-12T22:13:24.781125+0000","last_clean":"2024-09-12T22:13:24.781125+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:24.781125+0000","last_undegraded":"2024-09-12T22:13:24.781125+0000","last_fullsized":"2024-09-12T22:13:24.781125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":198,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781500+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:24.781500+0000","last_peered":"2024-09-12T22:13:24.781500+0000","last_clean":"2024-09-12T22:13:24.781500+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:24.781500+0000","last_undegraded":"2024-09-12T22:13:24.781500+0000","last_fullsized":"2024-09-12T22:13:24.781500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":608,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780535+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:24.780535+0000","last_peered":"2024-09-12T22:13:24.780535+0000","last_clean":"2024-09-12T22:13:24.780535+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:24.780535+0000","last_undegraded":"2024-09-12T22:13:24.780535+0000","last_fullsized":"2024-09-12T22:13:24.780535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":312,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780968+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:24.780968+0000","last_peered":"2024-09-12T22:13:24.780968+0000","last_clean":"2024-09-12T22:13:24.780968+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:24.780968+0000","last_undegraded":"2024-09-12T22:13:24.780968+0000","last_fullsized":"2024-09-12T22:13:24.780968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781304+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:24.781304+0000","last_peered":"2024-09-12T22:13:24.781304+0000","last_clean":"2024-09-12T22:13:24.781304+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:24.781304+0000","last_undegraded":"2024-09-12T22:13:24.781304+0000","last_fullsized":"2024-09-12T22:13:24.781304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782279+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:24.782279+0000","last_peered":"2024-09-12T22:13:24.782279+0000","last_clean":"2024-09-12T22:13:24.782279+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:24.782279+0000","last_undegraded":"2024-09-12T22:13:24.782279+0000","last_fullsized":"2024-09-12T22:13:24.782279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":896,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781826+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:24.781826+0000","last_peered":"2024-09-12T22:13:24.781826+0000","last_clean":"2024-09-12T22:13:24.781826+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:24.781826+0000","last_undegraded":"2024-09-12T22:13:24.781826+0000","last_fullsized":"2024-09-12T22:13:24.781826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782087+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:24.782087+0000","last_peered":"2024-09-12T22:13:24.782087+0000","last_clean":"2024-09-12T22:13:24.782087+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:24.782087+0000","last_undegraded":"2024-09-12T22:13:24.782087+0000","last_fullsized":"2024-09-12T22:13:24.782087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":841,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781926+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:24.781926+0000","last_peered":"2024-09-12T22:13:24.781926+0000","last_clean":"2024-09-12T22:13:24.781926+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:24.781926+0000","last_undegraded":"2024-09-12T22:13:24.781926+0000","last_fullsized":"2024-09-12T22:13:24.781926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":604,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782990+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782990+0000","last_peered":"2024-09-12T22:13:24.782990+0000","last_clean":"2024-09-12T22:13:24.782990+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:24.782990+0000","last_undegraded":"2024-09-12T22:13:24.782990+0000","last_fullsized":"2024-09-12T22:13:24.782990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781071+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:24.781071+0000","last_peered":"2024-09-12T22:13:24.781071+0000","last_clean":"2024-09-12T22:13:24.781071+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:24.781071+0000","last_undegraded":"2024-09-12T22:13:24.781071+0000","last_fullsized":"2024-09-12T22:13:24.781071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":358,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781569+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:24.781569+0000","last_peered":"2024-09-12T22:13:24.781569+0000","last_clean":"2024-09-12T22:13:24.781569+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:24.781569+0000","last_undegraded":"2024-09-12T22:13:24.781569+0000","last_fullsized":"2024-09-12T22:13:24.781569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781558+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:24.781558+0000","last_peered":"2024-09-12T22:13:24.781558+0000","last_clean":"2024-09-12T22:13:24.781558+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:24.781558+0000","last_undegraded":"2024-09-12T22:13:24.781558+0000","last_fullsized":"2024-09-12T22:13:24.781558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":764,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780511+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:24.780511+0000","last_peered":"2024-09-12T22:13:24.780511+0000","last_clean":"2024-09-12T22:13:24.780511+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:24.780511+0000","last_undegraded":"2024-09-12T22:13:24.780511+0000","last_fullsized":"2024-09-12T22:13:24.780511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":992,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781862+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:24.781862+0000","last_peered":"2024-09-12T22:13:24.781862+0000","last_clean":"2024-09-12T22:13:24.781862+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:24.781862+0000","last_undegraded":"2024-09-12T22:13:24.781862+0000","last_fullsized":"2024-09-12T22:13:24.781862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781666+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:24.781666+0000","last_peered":"2024-09-12T22:13:24.781666+0000","last_clean":"2024-09-12T22:13:24.781666+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:24.781666+0000","last_undegraded":"2024-09-12T22:13:24.781666+0000","last_fullsized":"2024-09-12T22:13:24.781666+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":298,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780576+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:24.780576+0000","last_peered":"2024-09-12T22:13:24.780576+0000","last_clean":"2024-09-12T22:13:24.780576+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:24.780576+0000","last_undegraded":"2024-09-12T22:13:24.780576+0000","last_fullsized":"2024-09-12T22:13:24.780576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":613,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783486+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:24.783486+0000","last_peered":"2024-09-12T22:13:24.783486+0000","last_clean":"2024-09-12T22:13:24.783486+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:24.783486+0000","last_undegraded":"2024-09-12T22:13:24.783486+0000","last_fullsized":"2024-09-12T22:13:24.783486+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780621+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:24.780621+0000","last_peered":"2024-09-12T22:13:24.780621+0000","last_clean":"2024-09-12T22:13:24.780621+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:24.780621+0000","last_undegraded":"2024-09-12T22:13:24.780621+0000","last_fullsized":"2024-09-12T22:13:24.780621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782556+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:24.782556+0000","last_peered":"2024-09-12T22:13:24.782556+0000","last_clean":"2024-09-12T22:13:24.782556+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:24.782556+0000","last_undegraded":"2024-09-12T22:13:24.782556+0000","last_fullsized":"2024-09-12T22:13:24.782556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":824,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781096+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:24.781096+0000","last_peered":"2024-09-12T22:13:24.781096+0000","last_clean":"2024-09-12T22:13:24.781096+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:24.781096+0000","last_undegraded":"2024-09-12T22:13:24.781096+0000","last_fullsized":"2024-09-12T22:13:24.781096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781261+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:24.781261+0000","last_peered":"2024-09-12T22:13:24.781261+0000","last_clean":"2024-09-12T22:13:24.781261+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:24.781261+0000","last_undegraded":"2024-09-12T22:13:24.781261+0000","last_fullsized":"2024-09-12T22:13:24.781261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782545+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:24.782545+0000","last_peered":"2024-09-12T22:13:24.782545+0000","last_clean":"2024-09-12T22:13:24.782545+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:24.782545+0000","last_undegraded":"2024-09-12T22:13:24.782545+0000","last_fullsized":"2024-09-12T22:13:24.782545+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":935,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780747+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:24.780747+0000","last_peered":"2024-09-12T22:13:24.780747+0000","last_clean":"2024-09-12T22:13:24.780747+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:24.780747+0000","last_undegraded":"2024-09-12T22:13:24.780747+0000","last_fullsized":"2024-09-12T22:13:24.780747+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":423,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782014+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:24.782014+0000","last_peered":"2024-09-12T22:13:24.782014+0000","last_clean":"2024-09-12T22:13:24.782014+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:24.782014+0000","last_undegraded":"2024-09-12T22:13:24.782014+0000","last_fullsized":"2024-09-12T22:13:24.782014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780845+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:24.780845+0000","last_peered":"2024-09-12T22:13:24.780845+0000","last_clean":"2024-09-12T22:13:24.780845+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:24.780845+0000","last_undegraded":"2024-09-12T22:13:24.780845+0000","last_fullsized":"2024-09-12T22:13:24.780845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":501,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782933+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:24.782933+0000","last_peered":"2024-09-12T22:13:24.782933+0000","last_clean":"2024-09-12T22:13:24.782933+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:24.782933+0000","last_undegraded":"2024-09-12T22:13:24.782933+0000","last_fullsized":"2024-09-12T22:13:24.782933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":207,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781077+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:24.781077+0000","last_peered":"2024-09-12T22:13:24.781077+0000","last_clean":"2024-09-12T22:13:24.781077+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:24.781077+0000","last_undegraded":"2024-09-12T22:13:24.781077+0000","last_fullsized":"2024-09-12T22:13:24.781077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783170+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:24.783170+0000","last_peered":"2024-09-12T22:13:24.783170+0000","last_clean":"2024-09-12T22:13:24.783170+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:24.783170+0000","last_undegraded":"2024-09-12T22:13:24.783170+0000","last_fullsized":"2024-09-12T22:13:24.783170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":540,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782233+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:24.782233+0000","last_peered":"2024-09-12T22:13:24.782233+0000","last_clean":"2024-09-12T22:13:24.782233+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:24.782233+0000","last_undegraded":"2024-09-12T22:13:24.782233+0000","last_fullsized":"2024-09-12T22:13:24.782233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781330+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:24.781330+0000","last_peered":"2024-09-12T22:13:24.781330+0000","last_clean":"2024-09-12T22:13:24.781330+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:24.781330+0000","last_undegraded":"2024-09-12T22:13:24.781330+0000","last_fullsized":"2024-09-12T22:13:24.781330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781214+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:24.781214+0000","last_peered":"2024-09-12T22:13:24.781214+0000","last_clean":"2024-09-12T22:13:24.781214+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:24.781214+0000","last_undegraded":"2024-09-12T22:13:24.781214+0000","last_fullsized":"2024-09-12T22:13:24.781214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780274+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:24.780274+0000","last_peered":"2024-09-12T22:13:24.780274+0000","last_clean":"2024-09-12T22:13:24.780274+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:24.780274+0000","last_undegraded":"2024-09-12T22:13:24.780274+0000","last_fullsized":"2024-09-12T22:13:24.780274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":242,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782756+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:24.782756+0000","last_peered":"2024-09-12T22:13:24.782756+0000","last_clean":"2024-09-12T22:13:24.782756+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:24.782756+0000","last_undegraded":"2024-09-12T22:13:24.782756+0000","last_fullsized":"2024-09-12T22:13:24.782756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781912+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:24.781912+0000","last_peered":"2024-09-12T22:13:24.781912+0000","last_clean":"2024-09-12T22:13:24.781912+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:24.781912+0000","last_undegraded":"2024-09-12T22:13:24.781912+0000","last_fullsized":"2024-09-12T22:13:24.781912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":674,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782776+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:24.782776+0000","last_peered":"2024-09-12T22:13:24.782776+0000","last_clean":"2024-09-12T22:13:24.782776+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:24.782776+0000","last_undegraded":"2024-09-12T22:13:24.782776+0000","last_fullsized":"2024-09-12T22:13:24.782776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":906,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781312+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:24.781312+0000","last_peered":"2024-09-12T22:13:24.781312+0000","last_clean":"2024-09-12T22:13:24.781312+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:24.781312+0000","last_undegraded":"2024-09-12T22:13:24.781312+0000","last_fullsized":"2024-09-12T22:13:24.781312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":442,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781465+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:24.781465+0000","last_peered":"2024-09-12T22:13:24.781465+0000","last_clean":"2024-09-12T22:13:24.781465+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:24.781465+0000","last_undegraded":"2024-09-12T22:13:24.781465+0000","last_fullsized":"2024-09-12T22:13:24.781465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1024,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780241+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:24.780241+0000","last_peered":"2024-09-12T22:13:24.780241+0000","last_clean":"2024-09-12T22:13:24.780241+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:24.780241+0000","last_undegraded":"2024-09-12T22:13:24.780241+0000","last_fullsized":"2024-09-12T22:13:24.780241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782903+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:24.782903+0000","last_peered":"2024-09-12T22:13:24.782903+0000","last_clean":"2024-09-12T22:13:24.782903+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:24.782903+0000","last_undegraded":"2024-09-12T22:13:24.782903+0000","last_fullsized":"2024-09-12T22:13:24.782903+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":327,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782688+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:24.782688+0000","last_peered":"2024-09-12T22:13:24.782688+0000","last_clean":"2024-09-12T22:13:24.782688+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:24.782688+0000","last_undegraded":"2024-09-12T22:13:24.782688+0000","last_fullsized":"2024-09-12T22:13:24.782688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":688,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780256+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:24.780256+0000","last_peered":"2024-09-12T22:13:24.780256+0000","last_clean":"2024-09-12T22:13:24.780256+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:24.780256+0000","last_undegraded":"2024-09-12T22:13:24.780256+0000","last_fullsized":"2024-09-12T22:13:24.780256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":192,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781267+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:24.781267+0000","last_peered":"2024-09-12T22:13:24.781267+0000","last_clean":"2024-09-12T22:13:24.781267+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:24.781267+0000","last_undegraded":"2024-09-12T22:13:24.781267+0000","last_fullsized":"2024-09-12T22:13:24.781267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1020,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780205+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:24.780205+0000","last_peered":"2024-09-12T22:13:24.780205+0000","last_clean":"2024-09-12T22:13:24.780205+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:24.780205+0000","last_undegraded":"2024-09-12T22:13:24.780205+0000","last_fullsized":"2024-09-12T22:13:24.780205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":517,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783155+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:24.783155+0000","last_peered":"2024-09-12T22:13:24.783155+0000","last_clean":"2024-09-12T22:13:24.783155+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:24.783155+0000","last_undegraded":"2024-09-12T22:13:24.783155+0000","last_fullsized":"2024-09-12T22:13:24.783155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":922,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780397+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:24.780397+0000","last_peered":"2024-09-12T22:13:24.780397+0000","last_clean":"2024-09-12T22:13:24.780397+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:24.780397+0000","last_undegraded":"2024-09-12T22:13:24.780397+0000","last_fullsized":"2024-09-12T22:13:24.780397+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":579,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780899+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:24.780899+0000","last_peered":"2024-09-12T22:13:24.780899+0000","last_clean":"2024-09-12T22:13:24.780899+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:24.780899+0000","last_undegraded":"2024-09-12T22:13:24.780899+0000","last_fullsized":"2024-09-12T22:13:24.780899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":326,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780407+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:24.780407+0000","last_peered":"2024-09-12T22:13:24.780407+0000","last_clean":"2024-09-12T22:13:24.780407+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:24.780407+0000","last_undegraded":"2024-09-12T22:13:24.780407+0000","last_fullsized":"2024-09-12T22:13:24.780407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":523,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782824+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:24.782824+0000","last_peered":"2024-09-12T22:13:24.782824+0000","last_clean":"2024-09-12T22:13:24.782824+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:24.782824+0000","last_undegraded":"2024-09-12T22:13:24.782824+0000","last_fullsized":"2024-09-12T22:13:24.782824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":283,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782495+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782495+0000","last_peered":"2024-09-12T22:13:24.782495+0000","last_clean":"2024-09-12T22:13:24.782495+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:24.782495+0000","last_undegraded":"2024-09-12T22:13:24.782495+0000","last_fullsized":"2024-09-12T22:13:24.782495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782697+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:24.782697+0000","last_peered":"2024-09-12T22:13:24.782697+0000","last_clean":"2024-09-12T22:13:24.782697+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:24.782697+0000","last_undegraded":"2024-09-12T22:13:24.782697+0000","last_fullsized":"2024-09-12T22:13:24.782697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782280+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:24.782280+0000","last_peered":"2024-09-12T22:13:24.782280+0000","last_clean":"2024-09-12T22:13:24.782280+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:24.782280+0000","last_undegraded":"2024-09-12T22:13:24.782280+0000","last_fullsized":"2024-09-12T22:13:24.782280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781143+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:24.781143+0000","last_peered":"2024-09-12T22:13:24.781143+0000","last_clean":"2024-09-12T22:13:24.781143+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:24.781143+0000","last_undegraded":"2024-09-12T22:13:24.781143+0000","last_fullsized":"2024-09-12T22:13:24.781143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781348+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:24.781348+0000","last_peered":"2024-09-12T22:13:24.781348+0000","last_clean":"2024-09-12T22:13:24.781348+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:24.781348+0000","last_undegraded":"2024-09-12T22:13:24.781348+0000","last_fullsized":"2024-09-12T22:13:24.781348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":894,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781038+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:24.781038+0000","last_peered":"2024-09-12T22:13:24.781038+0000","last_clean":"2024-09-12T22:13:24.781038+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:24.781038+0000","last_undegraded":"2024-09-12T22:13:24.781038+0000","last_fullsized":"2024-09-12T22:13:24.781038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782691+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:24.782691+0000","last_peered":"2024-09-12T22:13:24.782691+0000","last_clean":"2024-09-12T22:13:24.782691+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:24.782691+0000","last_undegraded":"2024-09-12T22:13:24.782691+0000","last_fullsized":"2024-09-12T22:13:24.782691+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":211,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781130+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:24.781130+0000","last_peered":"2024-09-12T22:13:24.781130+0000","last_clean":"2024-09-12T22:13:24.781130+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:24.781130+0000","last_undegraded":"2024-09-12T22:13:24.781130+0000","last_fullsized":"2024-09-12T22:13:24.781130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":650,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781368+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:24.781368+0000","last_peered":"2024-09-12T22:13:24.781368+0000","last_clean":"2024-09-12T22:13:24.781368+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:24.781368+0000","last_undegraded":"2024-09-12T22:13:24.781368+0000","last_fullsized":"2024-09-12T22:13:24.781368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781216+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:24.781216+0000","last_peered":"2024-09-12T22:13:24.781216+0000","last_clean":"2024-09-12T22:13:24.781216+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:24.781216+0000","last_undegraded":"2024-09-12T22:13:24.781216+0000","last_fullsized":"2024-09-12T22:13:24.781216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906950,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76828,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295012,"statfs":{"total":96636764160,"available":96558092288,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114660,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257180,"statfs":{"total":96636764160,"available":96519352320,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118496,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253344,"statfs":{"total":96636764160,"available":96515424256,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:29.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:30.330 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:30.331 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:30.342 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-12T22:13:29.127161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309984,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805536,"statfs":{"total":289910292480,"available":289592868864,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-759,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1049,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.346467"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":577,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783387+0000","last_change":"2024-09-12T22:13:23.781184+0000","last_active":"2024-09-12T22:13:24.783387+0000","last_peered":"2024-09-12T22:13:24.783387+0000","last_clean":"2024-09-12T22:13:24.783387+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:13:24.783387+0000","last_undegraded":"2024-09-12T22:13:24.783387+0000","last_fullsized":"2024-09-12T22:13:24.783387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.501549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783355+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:24.783355+0000","last_peered":"2024-09-12T22:13:24.783355+0000","last_clean":"2024-09-12T22:13:24.783355+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:24.783355+0000","last_undegraded":"2024-09-12T22:13:24.783355+0000","last_fullsized":"2024-09-12T22:13:24.783355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":866,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781319+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:24.781319+0000","last_peered":"2024-09-12T22:13:24.781319+0000","last_clean":"2024-09-12T22:13:24.781319+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:24.781319+0000","last_undegraded":"2024-09-12T22:13:24.781319+0000","last_fullsized":"2024-09-12T22:13:24.781319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":599,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781138+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:24.781138+0000","last_peered":"2024-09-12T22:13:24.781138+0000","last_clean":"2024-09-12T22:13:24.781138+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:24.781138+0000","last_undegraded":"2024-09-12T22:13:24.781138+0000","last_fullsized":"2024-09-12T22:13:24.781138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":623,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780765+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:24.780765+0000","last_peered":"2024-09-12T22:13:24.780765+0000","last_clean":"2024-09-12T22:13:24.780765+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:24.780765+0000","last_undegraded":"2024-09-12T22:13:24.780765+0000","last_fullsized":"2024-09-12T22:13:24.780765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":686,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780956+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:24.780956+0000","last_peered":"2024-09-12T22:13:24.780956+0000","last_clean":"2024-09-12T22:13:24.780956+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:24.780956+0000","last_undegraded":"2024-09-12T22:13:24.780956+0000","last_fullsized":"2024-09-12T22:13:24.780956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780690+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:24.780690+0000","last_peered":"2024-09-12T22:13:24.780690+0000","last_clean":"2024-09-12T22:13:24.780690+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:24.780690+0000","last_undegraded":"2024-09-12T22:13:24.780690+0000","last_fullsized":"2024-09-12T22:13:24.780690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":982,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780825+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:24.780825+0000","last_peered":"2024-09-12T22:13:24.780825+0000","last_clean":"2024-09-12T22:13:24.780825+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:24.780825+0000","last_undegraded":"2024-09-12T22:13:24.780825+0000","last_fullsized":"2024-09-12T22:13:24.780825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783311+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:24.783311+0000","last_peered":"2024-09-12T22:13:24.783311+0000","last_clean":"2024-09-12T22:13:24.783311+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:24.783311+0000","last_undegraded":"2024-09-12T22:13:24.783311+0000","last_fullsized":"2024-09-12T22:13:24.783311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781586+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:24.781586+0000","last_peered":"2024-09-12T22:13:24.781586+0000","last_clean":"2024-09-12T22:13:24.781586+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:24.781586+0000","last_undegraded":"2024-09-12T22:13:24.781586+0000","last_fullsized":"2024-09-12T22:13:24.781586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":485,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783141+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:24.783141+0000","last_peered":"2024-09-12T22:13:24.783141+0000","last_clean":"2024-09-12T22:13:24.783141+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:24.783141+0000","last_undegraded":"2024-09-12T22:13:24.783141+0000","last_fullsized":"2024-09-12T22:13:24.783141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782600+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:24.782600+0000","last_peered":"2024-09-12T22:13:24.782600+0000","last_clean":"2024-09-12T22:13:24.782600+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:24.782600+0000","last_undegraded":"2024-09-12T22:13:24.782600+0000","last_fullsized":"2024-09-12T22:13:24.782600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":940,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780983+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:24.780983+0000","last_peered":"2024-09-12T22:13:24.780983+0000","last_clean":"2024-09-12T22:13:24.780983+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:24.780983+0000","last_undegraded":"2024-09-12T22:13:24.780983+0000","last_fullsized":"2024-09-12T22:13:24.780983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1039,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781025+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:24.781025+0000","last_peered":"2024-09-12T22:13:24.781025+0000","last_clean":"2024-09-12T22:13:24.781025+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:24.781025+0000","last_undegraded":"2024-09-12T22:13:24.781025+0000","last_fullsized":"2024-09-12T22:13:24.781025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":624,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781202+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:24.781202+0000","last_peered":"2024-09-12T22:13:24.781202+0000","last_clean":"2024-09-12T22:13:24.781202+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:24.781202+0000","last_undegraded":"2024-09-12T22:13:24.781202+0000","last_fullsized":"2024-09-12T22:13:24.781202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":939,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781309+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:24.781309+0000","last_peered":"2024-09-12T22:13:24.781309+0000","last_clean":"2024-09-12T22:13:24.781309+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:24.781309+0000","last_undegraded":"2024-09-12T22:13:24.781309+0000","last_fullsized":"2024-09-12T22:13:24.781309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783153+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:24.783153+0000","last_peered":"2024-09-12T22:13:24.783153+0000","last_clean":"2024-09-12T22:13:24.783153+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:24.783153+0000","last_undegraded":"2024-09-12T22:13:24.783153+0000","last_fullsized":"2024-09-12T22:13:24.783153+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780749+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:24.780749+0000","last_peered":"2024-09-12T22:13:24.780749+0000","last_clean":"2024-09-12T22:13:24.780749+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:24.780749+0000","last_undegraded":"2024-09-12T22:13:24.780749+0000","last_fullsized":"2024-09-12T22:13:24.780749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":617,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781177+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:24.781177+0000","last_peered":"2024-09-12T22:13:24.781177+0000","last_clean":"2024-09-12T22:13:24.781177+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:24.781177+0000","last_undegraded":"2024-09-12T22:13:24.781177+0000","last_fullsized":"2024-09-12T22:13:24.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780992+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:24.780992+0000","last_peered":"2024-09-12T22:13:24.780992+0000","last_clean":"2024-09-12T22:13:24.780992+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:24.780992+0000","last_undegraded":"2024-09-12T22:13:24.780992+0000","last_fullsized":"2024-09-12T22:13:24.780992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":603,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783042+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:24.783042+0000","last_peered":"2024-09-12T22:13:24.783042+0000","last_clean":"2024-09-12T22:13:24.783042+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:24.783042+0000","last_undegraded":"2024-09-12T22:13:24.783042+0000","last_fullsized":"2024-09-12T22:13:24.783042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":658,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780069+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:24.780069+0000","last_peered":"2024-09-12T22:13:24.780069+0000","last_clean":"2024-09-12T22:13:24.780069+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:24.780069+0000","last_undegraded":"2024-09-12T22:13:24.780069+0000","last_fullsized":"2024-09-12T22:13:24.780069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782800+0000","last_change":"2024-09-12T22:13:21.785416+0000","last_active":"2024-09-12T22:13:24.782800+0000","last_peered":"2024-09-12T22:13:24.782800+0000","last_clean":"2024-09-12T22:13:24.782800+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:13:24.782800+0000","last_undegraded":"2024-09-12T22:13:24.782800+0000","last_fullsized":"2024-09-12T22:13:24.782800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:11.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":518,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783050+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:24.783050+0000","last_peered":"2024-09-12T22:13:24.783050+0000","last_clean":"2024-09-12T22:13:24.783050+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:24.783050+0000","last_undegraded":"2024-09-12T22:13:24.783050+0000","last_fullsized":"2024-09-12T22:13:24.783050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780957+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:24.780957+0000","last_peered":"2024-09-12T22:13:24.780957+0000","last_clean":"2024-09-12T22:13:24.780957+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:24.780957+0000","last_undegraded":"2024-09-12T22:13:24.780957+0000","last_fullsized":"2024-09-12T22:13:24.780957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":870,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781672+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:24.781672+0000","last_peered":"2024-09-12T22:13:24.781672+0000","last_clean":"2024-09-12T22:13:24.781672+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:24.781672+0000","last_undegraded":"2024-09-12T22:13:24.781672+0000","last_fullsized":"2024-09-12T22:13:24.781672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":545,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782949+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:24.782949+0000","last_peered":"2024-09-12T22:13:24.782949+0000","last_clean":"2024-09-12T22:13:24.782949+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:24.782949+0000","last_undegraded":"2024-09-12T22:13:24.782949+0000","last_fullsized":"2024-09-12T22:13:24.782949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":979,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780784+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:24.780784+0000","last_peered":"2024-09-12T22:13:24.780784+0000","last_clean":"2024-09-12T22:13:24.780784+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:24.780784+0000","last_undegraded":"2024-09-12T22:13:24.780784+0000","last_fullsized":"2024-09-12T22:13:24.780784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":635,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782555+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:24.782555+0000","last_peered":"2024-09-12T22:13:24.782555+0000","last_clean":"2024-09-12T22:13:24.782555+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:24.782555+0000","last_undegraded":"2024-09-12T22:13:24.782555+0000","last_fullsized":"2024-09-12T22:13:24.782555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":934,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780124+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:24.780124+0000","last_peered":"2024-09-12T22:13:24.780124+0000","last_clean":"2024-09-12T22:13:24.780124+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:24.780124+0000","last_undegraded":"2024-09-12T22:13:24.780124+0000","last_fullsized":"2024-09-12T22:13:24.780124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1002,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.785126+0000","last_change":"2024-09-12T22:13:24.785126+0000","last_active":"2024-09-12T22:13:24.785126+0000","last_peered":"2024-09-12T22:13:24.785126+0000","last_clean":"2024-09-12T22:13:24.785126+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:13:24.785126+0000","last_undegraded":"2024-09-12T22:13:24.785126+0000","last_fullsized":"2024-09-12T22:13:24.785126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:01.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":560,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782376+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:24.782376+0000","last_peered":"2024-09-12T22:13:24.782376+0000","last_clean":"2024-09-12T22:13:24.782376+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:24.782376+0000","last_undegraded":"2024-09-12T22:13:24.782376+0000","last_fullsized":"2024-09-12T22:13:24.782376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":452,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781494+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:24.781494+0000","last_peered":"2024-09-12T22:13:24.781494+0000","last_clean":"2024-09-12T22:13:24.781494+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:24.781494+0000","last_undegraded":"2024-09-12T22:13:24.781494+0000","last_fullsized":"2024-09-12T22:13:24.781494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":561,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782748+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:24.782748+0000","last_peered":"2024-09-12T22:13:24.782748+0000","last_clean":"2024-09-12T22:13:24.782748+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:24.782748+0000","last_undegraded":"2024-09-12T22:13:24.782748+0000","last_fullsized":"2024-09-12T22:13:24.782748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780393+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:24.780393+0000","last_peered":"2024-09-12T22:13:24.780393+0000","last_clean":"2024-09-12T22:13:24.780393+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:24.780393+0000","last_undegraded":"2024-09-12T22:13:24.780393+0000","last_fullsized":"2024-09-12T22:13:24.780393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781190+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:24.781190+0000","last_peered":"2024-09-12T22:13:24.781190+0000","last_clean":"2024-09-12T22:13:24.781190+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:24.781190+0000","last_undegraded":"2024-09-12T22:13:24.781190+0000","last_fullsized":"2024-09-12T22:13:24.781190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782440+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:24.782440+0000","last_peered":"2024-09-12T22:13:24.782440+0000","last_clean":"2024-09-12T22:13:24.782440+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:24.782440+0000","last_undegraded":"2024-09-12T22:13:24.782440+0000","last_fullsized":"2024-09-12T22:13:24.782440+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780918+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:24.780918+0000","last_peered":"2024-09-12T22:13:24.780918+0000","last_clean":"2024-09-12T22:13:24.780918+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:24.780918+0000","last_undegraded":"2024-09-12T22:13:24.780918+0000","last_fullsized":"2024-09-12T22:13:24.780918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781248+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:24.781248+0000","last_peered":"2024-09-12T22:13:24.781248+0000","last_clean":"2024-09-12T22:13:24.781248+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:24.781248+0000","last_undegraded":"2024-09-12T22:13:24.781248+0000","last_fullsized":"2024-09-12T22:13:24.781248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":311,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781830+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:24.781830+0000","last_peered":"2024-09-12T22:13:24.781830+0000","last_clean":"2024-09-12T22:13:24.781830+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:24.781830+0000","last_undegraded":"2024-09-12T22:13:24.781830+0000","last_fullsized":"2024-09-12T22:13:24.781830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783139+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:24.783139+0000","last_peered":"2024-09-12T22:13:24.783139+0000","last_clean":"2024-09-12T22:13:24.783139+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:24.783139+0000","last_undegraded":"2024-09-12T22:13:24.783139+0000","last_fullsized":"2024-09-12T22:13:24.783139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":338,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783191+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:24.783191+0000","last_peered":"2024-09-12T22:13:24.783191+0000","last_clean":"2024-09-12T22:13:24.783191+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:24.783191+0000","last_undegraded":"2024-09-12T22:13:24.783191+0000","last_fullsized":"2024-09-12T22:13:24.783191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":553,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.787848+0000","last_change":"2024-09-12T22:13:24.787848+0000","last_active":"2024-09-12T22:13:24.787848+0000","last_peered":"2024-09-12T22:13:24.787848+0000","last_clean":"2024-09-12T22:13:24.787848+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:13:24.787848+0000","last_undegraded":"2024-09-12T22:13:24.787848+0000","last_fullsized":"2024-09-12T22:13:24.787848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:22.209835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":627,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781965+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:24.781965+0000","last_peered":"2024-09-12T22:13:24.781965+0000","last_clean":"2024-09-12T22:13:24.781965+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:24.781965+0000","last_undegraded":"2024-09-12T22:13:24.781965+0000","last_fullsized":"2024-09-12T22:13:24.781965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781125+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:24.781125+0000","last_peered":"2024-09-12T22:13:24.781125+0000","last_clean":"2024-09-12T22:13:24.781125+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:24.781125+0000","last_undegraded":"2024-09-12T22:13:24.781125+0000","last_fullsized":"2024-09-12T22:13:24.781125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":198,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781500+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:24.781500+0000","last_peered":"2024-09-12T22:13:24.781500+0000","last_clean":"2024-09-12T22:13:24.781500+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:24.781500+0000","last_undegraded":"2024-09-12T22:13:24.781500+0000","last_fullsized":"2024-09-12T22:13:24.781500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":608,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780535+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:24.780535+0000","last_peered":"2024-09-12T22:13:24.780535+0000","last_clean":"2024-09-12T22:13:24.780535+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:24.780535+0000","last_undegraded":"2024-09-12T22:13:24.780535+0000","last_fullsized":"2024-09-12T22:13:24.780535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":312,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780968+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:24.780968+0000","last_peered":"2024-09-12T22:13:24.780968+0000","last_clean":"2024-09-12T22:13:24.780968+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:24.780968+0000","last_undegraded":"2024-09-12T22:13:24.780968+0000","last_fullsized":"2024-09-12T22:13:24.780968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781304+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:24.781304+0000","last_peered":"2024-09-12T22:13:24.781304+0000","last_clean":"2024-09-12T22:13:24.781304+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:24.781304+0000","last_undegraded":"2024-09-12T22:13:24.781304+0000","last_fullsized":"2024-09-12T22:13:24.781304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782279+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:24.782279+0000","last_peered":"2024-09-12T22:13:24.782279+0000","last_clean":"2024-09-12T22:13:24.782279+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:24.782279+0000","last_undegraded":"2024-09-12T22:13:24.782279+0000","last_fullsized":"2024-09-12T22:13:24.782279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":896,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781826+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:24.781826+0000","last_peered":"2024-09-12T22:13:24.781826+0000","last_clean":"2024-09-12T22:13:24.781826+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:24.781826+0000","last_undegraded":"2024-09-12T22:13:24.781826+0000","last_fullsized":"2024-09-12T22:13:24.781826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782087+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:24.782087+0000","last_peered":"2024-09-12T22:13:24.782087+0000","last_clean":"2024-09-12T22:13:24.782087+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:24.782087+0000","last_undegraded":"2024-09-12T22:13:24.782087+0000","last_fullsized":"2024-09-12T22:13:24.782087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":841,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781926+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:24.781926+0000","last_peered":"2024-09-12T22:13:24.781926+0000","last_clean":"2024-09-12T22:13:24.781926+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:24.781926+0000","last_undegraded":"2024-09-12T22:13:24.781926+0000","last_fullsized":"2024-09-12T22:13:24.781926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":604,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782990+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782990+0000","last_peered":"2024-09-12T22:13:24.782990+0000","last_clean":"2024-09-12T22:13:24.782990+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:24.782990+0000","last_undegraded":"2024-09-12T22:13:24.782990+0000","last_fullsized":"2024-09-12T22:13:24.782990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781071+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:24.781071+0000","last_peered":"2024-09-12T22:13:24.781071+0000","last_clean":"2024-09-12T22:13:24.781071+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:24.781071+0000","last_undegraded":"2024-09-12T22:13:24.781071+0000","last_fullsized":"2024-09-12T22:13:24.781071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":358,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781569+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:24.781569+0000","last_peered":"2024-09-12T22:13:24.781569+0000","last_clean":"2024-09-12T22:13:24.781569+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:24.781569+0000","last_undegraded":"2024-09-12T22:13:24.781569+0000","last_fullsized":"2024-09-12T22:13:24.781569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781558+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:24.781558+0000","last_peered":"2024-09-12T22:13:24.781558+0000","last_clean":"2024-09-12T22:13:24.781558+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:24.781558+0000","last_undegraded":"2024-09-12T22:13:24.781558+0000","last_fullsized":"2024-09-12T22:13:24.781558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":764,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780511+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:24.780511+0000","last_peered":"2024-09-12T22:13:24.780511+0000","last_clean":"2024-09-12T22:13:24.780511+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:24.780511+0000","last_undegraded":"2024-09-12T22:13:24.780511+0000","last_fullsized":"2024-09-12T22:13:24.780511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":992,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781862+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:24.781862+0000","last_peered":"2024-09-12T22:13:24.781862+0000","last_clean":"2024-09-12T22:13:24.781862+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:24.781862+0000","last_undegraded":"2024-09-12T22:13:24.781862+0000","last_fullsized":"2024-09-12T22:13:24.781862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781666+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:24.781666+0000","last_peered":"2024-09-12T22:13:24.781666+0000","last_clean":"2024-09-12T22:13:24.781666+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:24.781666+0000","last_undegraded":"2024-09-12T22:13:24.781666+0000","last_fullsized":"2024-09-12T22:13:24.781666+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":298,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780576+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:24.780576+0000","last_peered":"2024-09-12T22:13:24.780576+0000","last_clean":"2024-09-12T22:13:24.780576+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:24.780576+0000","last_undegraded":"2024-09-12T22:13:24.780576+0000","last_fullsized":"2024-09-12T22:13:24.780576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":613,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783486+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:24.783486+0000","last_peered":"2024-09-12T22:13:24.783486+0000","last_clean":"2024-09-12T22:13:24.783486+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:24.783486+0000","last_undegraded":"2024-09-12T22:13:24.783486+0000","last_fullsized":"2024-09-12T22:13:24.783486+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780621+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:24.780621+0000","last_peered":"2024-09-12T22:13:24.780621+0000","last_clean":"2024-09-12T22:13:24.780621+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:24.780621+0000","last_undegraded":"2024-09-12T22:13:24.780621+0000","last_fullsized":"2024-09-12T22:13:24.780621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782556+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:24.782556+0000","last_peered":"2024-09-12T22:13:24.782556+0000","last_clean":"2024-09-12T22:13:24.782556+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:24.782556+0000","last_undegraded":"2024-09-12T22:13:24.782556+0000","last_fullsized":"2024-09-12T22:13:24.782556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":824,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781096+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:24.781096+0000","last_peered":"2024-09-12T22:13:24.781096+0000","last_clean":"2024-09-12T22:13:24.781096+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:24.781096+0000","last_undegraded":"2024-09-12T22:13:24.781096+0000","last_fullsized":"2024-09-12T22:13:24.781096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781261+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:24.781261+0000","last_peered":"2024-09-12T22:13:24.781261+0000","last_clean":"2024-09-12T22:13:24.781261+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:24.781261+0000","last_undegraded":"2024-09-12T22:13:24.781261+0000","last_fullsized":"2024-09-12T22:13:24.781261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782545+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:24.782545+0000","last_peered":"2024-09-12T22:13:24.782545+0000","last_clean":"2024-09-12T22:13:24.782545+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:24.782545+0000","last_undegraded":"2024-09-12T22:13:24.782545+0000","last_fullsized":"2024-09-12T22:13:24.782545+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":935,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780747+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:24.780747+0000","last_peered":"2024-09-12T22:13:24.780747+0000","last_clean":"2024-09-12T22:13:24.780747+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:24.780747+0000","last_undegraded":"2024-09-12T22:13:24.780747+0000","last_fullsized":"2024-09-12T22:13:24.780747+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":423,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782014+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:24.782014+0000","last_peered":"2024-09-12T22:13:24.782014+0000","last_clean":"2024-09-12T22:13:24.782014+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:24.782014+0000","last_undegraded":"2024-09-12T22:13:24.782014+0000","last_fullsized":"2024-09-12T22:13:24.782014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780845+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:24.780845+0000","last_peered":"2024-09-12T22:13:24.780845+0000","last_clean":"2024-09-12T22:13:24.780845+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:24.780845+0000","last_undegraded":"2024-09-12T22:13:24.780845+0000","last_fullsized":"2024-09-12T22:13:24.780845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":501,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782933+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:24.782933+0000","last_peered":"2024-09-12T22:13:24.782933+0000","last_clean":"2024-09-12T22:13:24.782933+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:24.782933+0000","last_undegraded":"2024-09-12T22:13:24.782933+0000","last_fullsized":"2024-09-12T22:13:24.782933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":207,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781077+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:24.781077+0000","last_peered":"2024-09-12T22:13:24.781077+0000","last_clean":"2024-09-12T22:13:24.781077+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:24.781077+0000","last_undegraded":"2024-09-12T22:13:24.781077+0000","last_fullsized":"2024-09-12T22:13:24.781077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783170+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:24.783170+0000","last_peered":"2024-09-12T22:13:24.783170+0000","last_clean":"2024-09-12T22:13:24.783170+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:24.783170+0000","last_undegraded":"2024-09-12T22:13:24.783170+0000","last_fullsized":"2024-09-12T22:13:24.783170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":540,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782233+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:24.782233+0000","last_peered":"2024-09-12T22:13:24.782233+0000","last_clean":"2024-09-12T22:13:24.782233+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:24.782233+0000","last_undegraded":"2024-09-12T22:13:24.782233+0000","last_fullsized":"2024-09-12T22:13:24.782233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781330+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:24.781330+0000","last_peered":"2024-09-12T22:13:24.781330+0000","last_clean":"2024-09-12T22:13:24.781330+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:24.781330+0000","last_undegraded":"2024-09-12T22:13:24.781330+0000","last_fullsized":"2024-09-12T22:13:24.781330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781214+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:24.781214+0000","last_peered":"2024-09-12T22:13:24.781214+0000","last_clean":"2024-09-12T22:13:24.781214+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:24.781214+0000","last_undegraded":"2024-09-12T22:13:24.781214+0000","last_fullsized":"2024-09-12T22:13:24.781214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780274+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:24.780274+0000","last_peered":"2024-09-12T22:13:24.780274+0000","last_clean":"2024-09-12T22:13:24.780274+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:24.780274+0000","last_undegraded":"2024-09-12T22:13:24.780274+0000","last_fullsized":"2024-09-12T22:13:24.780274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":242,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782756+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:24.782756+0000","last_peered":"2024-09-12T22:13:24.782756+0000","last_clean":"2024-09-12T22:13:24.782756+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:24.782756+0000","last_undegraded":"2024-09-12T22:13:24.782756+0000","last_fullsized":"2024-09-12T22:13:24.782756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781912+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:24.781912+0000","last_peered":"2024-09-12T22:13:24.781912+0000","last_clean":"2024-09-12T22:13:24.781912+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:24.781912+0000","last_undegraded":"2024-09-12T22:13:24.781912+0000","last_fullsized":"2024-09-12T22:13:24.781912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":674,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782776+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:24.782776+0000","last_peered":"2024-09-12T22:13:24.782776+0000","last_clean":"2024-09-12T22:13:24.782776+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:24.782776+0000","last_undegraded":"2024-09-12T22:13:24.782776+0000","last_fullsized":"2024-09-12T22:13:24.782776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":906,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781312+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:24.781312+0000","last_peered":"2024-09-12T22:13:24.781312+0000","last_clean":"2024-09-12T22:13:24.781312+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:24.781312+0000","last_undegraded":"2024-09-12T22:13:24.781312+0000","last_fullsized":"2024-09-12T22:13:24.781312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":442,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781465+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:24.781465+0000","last_peered":"2024-09-12T22:13:24.781465+0000","last_clean":"2024-09-12T22:13:24.781465+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:24.781465+0000","last_undegraded":"2024-09-12T22:13:24.781465+0000","last_fullsized":"2024-09-12T22:13:24.781465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1024,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780241+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:24.780241+0000","last_peered":"2024-09-12T22:13:24.780241+0000","last_clean":"2024-09-12T22:13:24.780241+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:24.780241+0000","last_undegraded":"2024-09-12T22:13:24.780241+0000","last_fullsized":"2024-09-12T22:13:24.780241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782903+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:24.782903+0000","last_peered":"2024-09-12T22:13:24.782903+0000","last_clean":"2024-09-12T22:13:24.782903+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:24.782903+0000","last_undegraded":"2024-09-12T22:13:24.782903+0000","last_fullsized":"2024-09-12T22:13:24.782903+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":327,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782688+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:24.782688+0000","last_peered":"2024-09-12T22:13:24.782688+0000","last_clean":"2024-09-12T22:13:24.782688+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:24.782688+0000","last_undegraded":"2024-09-12T22:13:24.782688+0000","last_fullsized":"2024-09-12T22:13:24.782688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":688,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780256+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:24.780256+0000","last_peered":"2024-09-12T22:13:24.780256+0000","last_clean":"2024-09-12T22:13:24.780256+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:24.780256+0000","last_undegraded":"2024-09-12T22:13:24.780256+0000","last_fullsized":"2024-09-12T22:13:24.780256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":192,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781267+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:24.781267+0000","last_peered":"2024-09-12T22:13:24.781267+0000","last_clean":"2024-09-12T22:13:24.781267+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:24.781267+0000","last_undegraded":"2024-09-12T22:13:24.781267+0000","last_fullsized":"2024-09-12T22:13:24.781267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1020,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780205+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:24.780205+0000","last_peered":"2024-09-12T22:13:24.780205+0000","last_clean":"2024-09-12T22:13:24.780205+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:24.780205+0000","last_undegraded":"2024-09-12T22:13:24.780205+0000","last_fullsized":"2024-09-12T22:13:24.780205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":517,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783155+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:24.783155+0000","last_peered":"2024-09-12T22:13:24.783155+0000","last_clean":"2024-09-12T22:13:24.783155+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:24.783155+0000","last_undegraded":"2024-09-12T22:13:24.783155+0000","last_fullsized":"2024-09-12T22:13:24.783155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":922,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780397+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:24.780397+0000","last_peered":"2024-09-12T22:13:24.780397+0000","last_clean":"2024-09-12T22:13:24.780397+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:24.780397+0000","last_undegraded":"2024-09-12T22:13:24.780397+0000","last_fullsized":"2024-09-12T22:13:24.780397+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":579,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780899+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:24.780899+0000","last_peered":"2024-09-12T22:13:24.780899+0000","last_clean":"2024-09-12T22:13:24.780899+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:24.780899+0000","last_undegraded":"2024-09-12T22:13:24.780899+0000","last_fullsized":"2024-09-12T22:13:24.780899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":326,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780407+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:24.780407+0000","last_peered":"2024-09-12T22:13:24.780407+0000","last_clean":"2024-09-12T22:13:24.780407+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:24.780407+0000","last_undegraded":"2024-09-12T22:13:24.780407+0000","last_fullsized":"2024-09-12T22:13:24.780407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":523,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782824+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:24.782824+0000","last_peered":"2024-09-12T22:13:24.782824+0000","last_clean":"2024-09-12T22:13:24.782824+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:24.782824+0000","last_undegraded":"2024-09-12T22:13:24.782824+0000","last_fullsized":"2024-09-12T22:13:24.782824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":283,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782495+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782495+0000","last_peered":"2024-09-12T22:13:24.782495+0000","last_clean":"2024-09-12T22:13:24.782495+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:24.782495+0000","last_undegraded":"2024-09-12T22:13:24.782495+0000","last_fullsized":"2024-09-12T22:13:24.782495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782697+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:24.782697+0000","last_peered":"2024-09-12T22:13:24.782697+0000","last_clean":"2024-09-12T22:13:24.782697+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:24.782697+0000","last_undegraded":"2024-09-12T22:13:24.782697+0000","last_fullsized":"2024-09-12T22:13:24.782697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782280+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:24.782280+0000","last_peered":"2024-09-12T22:13:24.782280+0000","last_clean":"2024-09-12T22:13:24.782280+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:24.782280+0000","last_undegraded":"2024-09-12T22:13:24.782280+0000","last_fullsized":"2024-09-12T22:13:24.782280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781143+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:24.781143+0000","last_peered":"2024-09-12T22:13:24.781143+0000","last_clean":"2024-09-12T22:13:24.781143+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:24.781143+0000","last_undegraded":"2024-09-12T22:13:24.781143+0000","last_fullsized":"2024-09-12T22:13:24.781143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781348+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:24.781348+0000","last_peered":"2024-09-12T22:13:24.781348+0000","last_clean":"2024-09-12T22:13:24.781348+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:24.781348+0000","last_undegraded":"2024-09-12T22:13:24.781348+0000","last_fullsized":"2024-09-12T22:13:24.781348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":894,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781038+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:24.781038+0000","last_peered":"2024-09-12T22:13:24.781038+0000","last_clean":"2024-09-12T22:13:24.781038+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:24.781038+0000","last_undegraded":"2024-09-12T22:13:24.781038+0000","last_fullsized":"2024-09-12T22:13:24.781038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782691+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:24.782691+0000","last_peered":"2024-09-12T22:13:24.782691+0000","last_clean":"2024-09-12T22:13:24.782691+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:24.782691+0000","last_undegraded":"2024-09-12T22:13:24.782691+0000","last_fullsized":"2024-09-12T22:13:24.782691+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":211,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781130+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:24.781130+0000","last_peered":"2024-09-12T22:13:24.781130+0000","last_clean":"2024-09-12T22:13:24.781130+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:24.781130+0000","last_undegraded":"2024-09-12T22:13:24.781130+0000","last_fullsized":"2024-09-12T22:13:24.781130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":650,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781368+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:24.781368+0000","last_peered":"2024-09-12T22:13:24.781368+0000","last_clean":"2024-09-12T22:13:24.781368+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:24.781368+0000","last_undegraded":"2024-09-12T22:13:24.781368+0000","last_fullsized":"2024-09-12T22:13:24.781368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781216+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:24.781216+0000","last_peered":"2024-09-12T22:13:24.781216+0000","last_clean":"2024-09-12T22:13:24.781216+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:24.781216+0000","last_undegraded":"2024-09-12T22:13:24.781216+0000","last_fullsized":"2024-09-12T22:13:24.781216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906950,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76828,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295012,"statfs":{"total":96636764160,"available":96558092288,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114660,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257180,"statfs":{"total":96636764160,"available":96519352320,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118496,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253344,"statfs":{"total":96636764160,"available":96515424256,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:30.346 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:13:30.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:30.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:30.676 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:30.686 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-12T22:13:29.127161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309984,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805536,"statfs":{"total":289910292480,"available":289592868864,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-759,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1049,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.346467"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":577,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783387+0000","last_change":"2024-09-12T22:13:23.781184+0000","last_active":"2024-09-12T22:13:24.783387+0000","last_peered":"2024-09-12T22:13:24.783387+0000","last_clean":"2024-09-12T22:13:24.783387+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:13:24.783387+0000","last_undegraded":"2024-09-12T22:13:24.783387+0000","last_fullsized":"2024-09-12T22:13:24.783387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.501549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783355+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:24.783355+0000","last_peered":"2024-09-12T22:13:24.783355+0000","last_clean":"2024-09-12T22:13:24.783355+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:24.783355+0000","last_undegraded":"2024-09-12T22:13:24.783355+0000","last_fullsized":"2024-09-12T22:13:24.783355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":866,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781319+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:24.781319+0000","last_peered":"2024-09-12T22:13:24.781319+0000","last_clean":"2024-09-12T22:13:24.781319+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:24.781319+0000","last_undegraded":"2024-09-12T22:13:24.781319+0000","last_fullsized":"2024-09-12T22:13:24.781319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":599,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781138+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:24.781138+0000","last_peered":"2024-09-12T22:13:24.781138+0000","last_clean":"2024-09-12T22:13:24.781138+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:24.781138+0000","last_undegraded":"2024-09-12T22:13:24.781138+0000","last_fullsized":"2024-09-12T22:13:24.781138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":623,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780765+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:24.780765+0000","last_peered":"2024-09-12T22:13:24.780765+0000","last_clean":"2024-09-12T22:13:24.780765+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:24.780765+0000","last_undegraded":"2024-09-12T22:13:24.780765+0000","last_fullsized":"2024-09-12T22:13:24.780765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":686,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780956+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:24.780956+0000","last_peered":"2024-09-12T22:13:24.780956+0000","last_clean":"2024-09-12T22:13:24.780956+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:24.780956+0000","last_undegraded":"2024-09-12T22:13:24.780956+0000","last_fullsized":"2024-09-12T22:13:24.780956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780690+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:24.780690+0000","last_peered":"2024-09-12T22:13:24.780690+0000","last_clean":"2024-09-12T22:13:24.780690+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:24.780690+0000","last_undegraded":"2024-09-12T22:13:24.780690+0000","last_fullsized":"2024-09-12T22:13:24.780690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":982,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780825+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:24.780825+0000","last_peered":"2024-09-12T22:13:24.780825+0000","last_clean":"2024-09-12T22:13:24.780825+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:24.780825+0000","last_undegraded":"2024-09-12T22:13:24.780825+0000","last_fullsized":"2024-09-12T22:13:24.780825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783311+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:24.783311+0000","last_peered":"2024-09-12T22:13:24.783311+0000","last_clean":"2024-09-12T22:13:24.783311+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:24.783311+0000","last_undegraded":"2024-09-12T22:13:24.783311+0000","last_fullsized":"2024-09-12T22:13:24.783311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781586+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:24.781586+0000","last_peered":"2024-09-12T22:13:24.781586+0000","last_clean":"2024-09-12T22:13:24.781586+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:24.781586+0000","last_undegraded":"2024-09-12T22:13:24.781586+0000","last_fullsized":"2024-09-12T22:13:24.781586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":485,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783141+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:24.783141+0000","last_peered":"2024-09-12T22:13:24.783141+0000","last_clean":"2024-09-12T22:13:24.783141+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:24.783141+0000","last_undegraded":"2024-09-12T22:13:24.783141+0000","last_fullsized":"2024-09-12T22:13:24.783141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782600+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:24.782600+0000","last_peered":"2024-09-12T22:13:24.782600+0000","last_clean":"2024-09-12T22:13:24.782600+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:24.782600+0000","last_undegraded":"2024-09-12T22:13:24.782600+0000","last_fullsized":"2024-09-12T22:13:24.782600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":940,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780983+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:24.780983+0000","last_peered":"2024-09-12T22:13:24.780983+0000","last_clean":"2024-09-12T22:13:24.780983+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:24.780983+0000","last_undegraded":"2024-09-12T22:13:24.780983+0000","last_fullsized":"2024-09-12T22:13:24.780983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1039,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781025+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:24.781025+0000","last_peered":"2024-09-12T22:13:24.781025+0000","last_clean":"2024-09-12T22:13:24.781025+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:24.781025+0000","last_undegraded":"2024-09-12T22:13:24.781025+0000","last_fullsized":"2024-09-12T22:13:24.781025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":624,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781202+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:24.781202+0000","last_peered":"2024-09-12T22:13:24.781202+0000","last_clean":"2024-09-12T22:13:24.781202+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:24.781202+0000","last_undegraded":"2024-09-12T22:13:24.781202+0000","last_fullsized":"2024-09-12T22:13:24.781202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":939,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781309+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:24.781309+0000","last_peered":"2024-09-12T22:13:24.781309+0000","last_clean":"2024-09-12T22:13:24.781309+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:24.781309+0000","last_undegraded":"2024-09-12T22:13:24.781309+0000","last_fullsized":"2024-09-12T22:13:24.781309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783153+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:24.783153+0000","last_peered":"2024-09-12T22:13:24.783153+0000","last_clean":"2024-09-12T22:13:24.783153+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:24.783153+0000","last_undegraded":"2024-09-12T22:13:24.783153+0000","last_fullsized":"2024-09-12T22:13:24.783153+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780749+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:24.780749+0000","last_peered":"2024-09-12T22:13:24.780749+0000","last_clean":"2024-09-12T22:13:24.780749+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:24.780749+0000","last_undegraded":"2024-09-12T22:13:24.780749+0000","last_fullsized":"2024-09-12T22:13:24.780749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":617,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781177+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:24.781177+0000","last_peered":"2024-09-12T22:13:24.781177+0000","last_clean":"2024-09-12T22:13:24.781177+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:24.781177+0000","last_undegraded":"2024-09-12T22:13:24.781177+0000","last_fullsized":"2024-09-12T22:13:24.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780992+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:24.780992+0000","last_peered":"2024-09-12T22:13:24.780992+0000","last_clean":"2024-09-12T22:13:24.780992+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:24.780992+0000","last_undegraded":"2024-09-12T22:13:24.780992+0000","last_fullsized":"2024-09-12T22:13:24.780992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":603,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783042+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:24.783042+0000","last_peered":"2024-09-12T22:13:24.783042+0000","last_clean":"2024-09-12T22:13:24.783042+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:24.783042+0000","last_undegraded":"2024-09-12T22:13:24.783042+0000","last_fullsized":"2024-09-12T22:13:24.783042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":658,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780069+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:24.780069+0000","last_peered":"2024-09-12T22:13:24.780069+0000","last_clean":"2024-09-12T22:13:24.780069+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:24.780069+0000","last_undegraded":"2024-09-12T22:13:24.780069+0000","last_fullsized":"2024-09-12T22:13:24.780069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782800+0000","last_change":"2024-09-12T22:13:21.785416+0000","last_active":"2024-09-12T22:13:24.782800+0000","last_peered":"2024-09-12T22:13:24.782800+0000","last_clean":"2024-09-12T22:13:24.782800+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:13:24.782800+0000","last_undegraded":"2024-09-12T22:13:24.782800+0000","last_fullsized":"2024-09-12T22:13:24.782800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:11.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":518,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783050+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:24.783050+0000","last_peered":"2024-09-12T22:13:24.783050+0000","last_clean":"2024-09-12T22:13:24.783050+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:24.783050+0000","last_undegraded":"2024-09-12T22:13:24.783050+0000","last_fullsized":"2024-09-12T22:13:24.783050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780957+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:24.780957+0000","last_peered":"2024-09-12T22:13:24.780957+0000","last_clean":"2024-09-12T22:13:24.780957+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:24.780957+0000","last_undegraded":"2024-09-12T22:13:24.780957+0000","last_fullsized":"2024-09-12T22:13:24.780957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":870,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781672+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:24.781672+0000","last_peered":"2024-09-12T22:13:24.781672+0000","last_clean":"2024-09-12T22:13:24.781672+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:24.781672+0000","last_undegraded":"2024-09-12T22:13:24.781672+0000","last_fullsized":"2024-09-12T22:13:24.781672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":545,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782949+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:24.782949+0000","last_peered":"2024-09-12T22:13:24.782949+0000","last_clean":"2024-09-12T22:13:24.782949+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:24.782949+0000","last_undegraded":"2024-09-12T22:13:24.782949+0000","last_fullsized":"2024-09-12T22:13:24.782949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":979,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780784+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:24.780784+0000","last_peered":"2024-09-12T22:13:24.780784+0000","last_clean":"2024-09-12T22:13:24.780784+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:24.780784+0000","last_undegraded":"2024-09-12T22:13:24.780784+0000","last_fullsized":"2024-09-12T22:13:24.780784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":635,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782555+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:24.782555+0000","last_peered":"2024-09-12T22:13:24.782555+0000","last_clean":"2024-09-12T22:13:24.782555+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:24.782555+0000","last_undegraded":"2024-09-12T22:13:24.782555+0000","last_fullsized":"2024-09-12T22:13:24.782555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":934,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780124+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:24.780124+0000","last_peered":"2024-09-12T22:13:24.780124+0000","last_clean":"2024-09-12T22:13:24.780124+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:24.780124+0000","last_undegraded":"2024-09-12T22:13:24.780124+0000","last_fullsized":"2024-09-12T22:13:24.780124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1002,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.785126+0000","last_change":"2024-09-12T22:13:24.785126+0000","last_active":"2024-09-12T22:13:24.785126+0000","last_peered":"2024-09-12T22:13:24.785126+0000","last_clean":"2024-09-12T22:13:24.785126+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:13:24.785126+0000","last_undegraded":"2024-09-12T22:13:24.785126+0000","last_fullsized":"2024-09-12T22:13:24.785126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:01.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":560,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782376+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:24.782376+0000","last_peered":"2024-09-12T22:13:24.782376+0000","last_clean":"2024-09-12T22:13:24.782376+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:24.782376+0000","last_undegraded":"2024-09-12T22:13:24.782376+0000","last_fullsized":"2024-09-12T22:13:24.782376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":452,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781494+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:24.781494+0000","last_peered":"2024-09-12T22:13:24.781494+0000","last_clean":"2024-09-12T22:13:24.781494+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:24.781494+0000","last_undegraded":"2024-09-12T22:13:24.781494+0000","last_fullsized":"2024-09-12T22:13:24.781494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":561,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782748+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:24.782748+0000","last_peered":"2024-09-12T22:13:24.782748+0000","last_clean":"2024-09-12T22:13:24.782748+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:24.782748+0000","last_undegraded":"2024-09-12T22:13:24.782748+0000","last_fullsized":"2024-09-12T22:13:24.782748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780393+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:24.780393+0000","last_peered":"2024-09-12T22:13:24.780393+0000","last_clean":"2024-09-12T22:13:24.780393+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:24.780393+0000","last_undegraded":"2024-09-12T22:13:24.780393+0000","last_fullsized":"2024-09-12T22:13:24.780393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781190+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:24.781190+0000","last_peered":"2024-09-12T22:13:24.781190+0000","last_clean":"2024-09-12T22:13:24.781190+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:24.781190+0000","last_undegraded":"2024-09-12T22:13:24.781190+0000","last_fullsized":"2024-09-12T22:13:24.781190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782440+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:24.782440+0000","last_peered":"2024-09-12T22:13:24.782440+0000","last_clean":"2024-09-12T22:13:24.782440+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:24.782440+0000","last_undegraded":"2024-09-12T22:13:24.782440+0000","last_fullsized":"2024-09-12T22:13:24.782440+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780918+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:24.780918+0000","last_peered":"2024-09-12T22:13:24.780918+0000","last_clean":"2024-09-12T22:13:24.780918+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:24.780918+0000","last_undegraded":"2024-09-12T22:13:24.780918+0000","last_fullsized":"2024-09-12T22:13:24.780918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781248+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:24.781248+0000","last_peered":"2024-09-12T22:13:24.781248+0000","last_clean":"2024-09-12T22:13:24.781248+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:24.781248+0000","last_undegraded":"2024-09-12T22:13:24.781248+0000","last_fullsized":"2024-09-12T22:13:24.781248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":311,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781830+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:24.781830+0000","last_peered":"2024-09-12T22:13:24.781830+0000","last_clean":"2024-09-12T22:13:24.781830+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:24.781830+0000","last_undegraded":"2024-09-12T22:13:24.781830+0000","last_fullsized":"2024-09-12T22:13:24.781830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783139+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:24.783139+0000","last_peered":"2024-09-12T22:13:24.783139+0000","last_clean":"2024-09-12T22:13:24.783139+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:24.783139+0000","last_undegraded":"2024-09-12T22:13:24.783139+0000","last_fullsized":"2024-09-12T22:13:24.783139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":338,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783191+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:24.783191+0000","last_peered":"2024-09-12T22:13:24.783191+0000","last_clean":"2024-09-12T22:13:24.783191+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:24.783191+0000","last_undegraded":"2024-09-12T22:13:24.783191+0000","last_fullsized":"2024-09-12T22:13:24.783191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":553,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.787848+0000","last_change":"2024-09-12T22:13:24.787848+0000","last_active":"2024-09-12T22:13:24.787848+0000","last_peered":"2024-09-12T22:13:24.787848+0000","last_clean":"2024-09-12T22:13:24.787848+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:13:24.787848+0000","last_undegraded":"2024-09-12T22:13:24.787848+0000","last_fullsized":"2024-09-12T22:13:24.787848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:22.209835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":627,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781965+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:24.781965+0000","last_peered":"2024-09-12T22:13:24.781965+0000","last_clean":"2024-09-12T22:13:24.781965+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:24.781965+0000","last_undegraded":"2024-09-12T22:13:24.781965+0000","last_fullsized":"2024-09-12T22:13:24.781965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781125+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:24.781125+0000","last_peered":"2024-09-12T22:13:24.781125+0000","last_clean":"2024-09-12T22:13:24.781125+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:24.781125+0000","last_undegraded":"2024-09-12T22:13:24.781125+0000","last_fullsized":"2024-09-12T22:13:24.781125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":198,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781500+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:24.781500+0000","last_peered":"2024-09-12T22:13:24.781500+0000","last_clean":"2024-09-12T22:13:24.781500+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:24.781500+0000","last_undegraded":"2024-09-12T22:13:24.781500+0000","last_fullsized":"2024-09-12T22:13:24.781500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":608,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780535+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:24.780535+0000","last_peered":"2024-09-12T22:13:24.780535+0000","last_clean":"2024-09-12T22:13:24.780535+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:24.780535+0000","last_undegraded":"2024-09-12T22:13:24.780535+0000","last_fullsized":"2024-09-12T22:13:24.780535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":312,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780968+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:24.780968+0000","last_peered":"2024-09-12T22:13:24.780968+0000","last_clean":"2024-09-12T22:13:24.780968+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:24.780968+0000","last_undegraded":"2024-09-12T22:13:24.780968+0000","last_fullsized":"2024-09-12T22:13:24.780968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781304+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:24.781304+0000","last_peered":"2024-09-12T22:13:24.781304+0000","last_clean":"2024-09-12T22:13:24.781304+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:24.781304+0000","last_undegraded":"2024-09-12T22:13:24.781304+0000","last_fullsized":"2024-09-12T22:13:24.781304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782279+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:24.782279+0000","last_peered":"2024-09-12T22:13:24.782279+0000","last_clean":"2024-09-12T22:13:24.782279+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:24.782279+0000","last_undegraded":"2024-09-12T22:13:24.782279+0000","last_fullsized":"2024-09-12T22:13:24.782279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":896,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781826+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:24.781826+0000","last_peered":"2024-09-12T22:13:24.781826+0000","last_clean":"2024-09-12T22:13:24.781826+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:24.781826+0000","last_undegraded":"2024-09-12T22:13:24.781826+0000","last_fullsized":"2024-09-12T22:13:24.781826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782087+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:24.782087+0000","last_peered":"2024-09-12T22:13:24.782087+0000","last_clean":"2024-09-12T22:13:24.782087+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:24.782087+0000","last_undegraded":"2024-09-12T22:13:24.782087+0000","last_fullsized":"2024-09-12T22:13:24.782087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":841,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781926+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:24.781926+0000","last_peered":"2024-09-12T22:13:24.781926+0000","last_clean":"2024-09-12T22:13:24.781926+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:24.781926+0000","last_undegraded":"2024-09-12T22:13:24.781926+0000","last_fullsized":"2024-09-12T22:13:24.781926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":604,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782990+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782990+0000","last_peered":"2024-09-12T22:13:24.782990+0000","last_clean":"2024-09-12T22:13:24.782990+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:24.782990+0000","last_undegraded":"2024-09-12T22:13:24.782990+0000","last_fullsized":"2024-09-12T22:13:24.782990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781071+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:24.781071+0000","last_peered":"2024-09-12T22:13:24.781071+0000","last_clean":"2024-09-12T22:13:24.781071+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:24.781071+0000","last_undegraded":"2024-09-12T22:13:24.781071+0000","last_fullsized":"2024-09-12T22:13:24.781071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":358,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781569+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:24.781569+0000","last_peered":"2024-09-12T22:13:24.781569+0000","last_clean":"2024-09-12T22:13:24.781569+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:24.781569+0000","last_undegraded":"2024-09-12T22:13:24.781569+0000","last_fullsized":"2024-09-12T22:13:24.781569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781558+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:24.781558+0000","last_peered":"2024-09-12T22:13:24.781558+0000","last_clean":"2024-09-12T22:13:24.781558+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:24.781558+0000","last_undegraded":"2024-09-12T22:13:24.781558+0000","last_fullsized":"2024-09-12T22:13:24.781558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":764,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780511+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:24.780511+0000","last_peered":"2024-09-12T22:13:24.780511+0000","last_clean":"2024-09-12T22:13:24.780511+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:24.780511+0000","last_undegraded":"2024-09-12T22:13:24.780511+0000","last_fullsized":"2024-09-12T22:13:24.780511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":992,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781862+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:24.781862+0000","last_peered":"2024-09-12T22:13:24.781862+0000","last_clean":"2024-09-12T22:13:24.781862+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:24.781862+0000","last_undegraded":"2024-09-12T22:13:24.781862+0000","last_fullsized":"2024-09-12T22:13:24.781862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781666+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:24.781666+0000","last_peered":"2024-09-12T22:13:24.781666+0000","last_clean":"2024-09-12T22:13:24.781666+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:24.781666+0000","last_undegraded":"2024-09-12T22:13:24.781666+0000","last_fullsized":"2024-09-12T22:13:24.781666+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":298,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780576+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:24.780576+0000","last_peered":"2024-09-12T22:13:24.780576+0000","last_clean":"2024-09-12T22:13:24.780576+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:24.780576+0000","last_undegraded":"2024-09-12T22:13:24.780576+0000","last_fullsized":"2024-09-12T22:13:24.780576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":613,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783486+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:24.783486+0000","last_peered":"2024-09-12T22:13:24.783486+0000","last_clean":"2024-09-12T22:13:24.783486+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:24.783486+0000","last_undegraded":"2024-09-12T22:13:24.783486+0000","last_fullsized":"2024-09-12T22:13:24.783486+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780621+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:24.780621+0000","last_peered":"2024-09-12T22:13:24.780621+0000","last_clean":"2024-09-12T22:13:24.780621+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:24.780621+0000","last_undegraded":"2024-09-12T22:13:24.780621+0000","last_fullsized":"2024-09-12T22:13:24.780621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782556+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:24.782556+0000","last_peered":"2024-09-12T22:13:24.782556+0000","last_clean":"2024-09-12T22:13:24.782556+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:24.782556+0000","last_undegraded":"2024-09-12T22:13:24.782556+0000","last_fullsized":"2024-09-12T22:13:24.782556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":824,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781096+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:24.781096+0000","last_peered":"2024-09-12T22:13:24.781096+0000","last_clean":"2024-09-12T22:13:24.781096+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:24.781096+0000","last_undegraded":"2024-09-12T22:13:24.781096+0000","last_fullsized":"2024-09-12T22:13:24.781096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781261+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:24.781261+0000","last_peered":"2024-09-12T22:13:24.781261+0000","last_clean":"2024-09-12T22:13:24.781261+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:24.781261+0000","last_undegraded":"2024-09-12T22:13:24.781261+0000","last_fullsized":"2024-09-12T22:13:24.781261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782545+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:24.782545+0000","last_peered":"2024-09-12T22:13:24.782545+0000","last_clean":"2024-09-12T22:13:24.782545+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:24.782545+0000","last_undegraded":"2024-09-12T22:13:24.782545+0000","last_fullsized":"2024-09-12T22:13:24.782545+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":935,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780747+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:24.780747+0000","last_peered":"2024-09-12T22:13:24.780747+0000","last_clean":"2024-09-12T22:13:24.780747+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:24.780747+0000","last_undegraded":"2024-09-12T22:13:24.780747+0000","last_fullsized":"2024-09-12T22:13:24.780747+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":423,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782014+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:24.782014+0000","last_peered":"2024-09-12T22:13:24.782014+0000","last_clean":"2024-09-12T22:13:24.782014+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:24.782014+0000","last_undegraded":"2024-09-12T22:13:24.782014+0000","last_fullsized":"2024-09-12T22:13:24.782014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780845+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:24.780845+0000","last_peered":"2024-09-12T22:13:24.780845+0000","last_clean":"2024-09-12T22:13:24.780845+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:24.780845+0000","last_undegraded":"2024-09-12T22:13:24.780845+0000","last_fullsized":"2024-09-12T22:13:24.780845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":501,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782933+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:24.782933+0000","last_peered":"2024-09-12T22:13:24.782933+0000","last_clean":"2024-09-12T22:13:24.782933+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:24.782933+0000","last_undegraded":"2024-09-12T22:13:24.782933+0000","last_fullsized":"2024-09-12T22:13:24.782933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":207,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781077+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:24.781077+0000","last_peered":"2024-09-12T22:13:24.781077+0000","last_clean":"2024-09-12T22:13:24.781077+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:24.781077+0000","last_undegraded":"2024-09-12T22:13:24.781077+0000","last_fullsized":"2024-09-12T22:13:24.781077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783170+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:24.783170+0000","last_peered":"2024-09-12T22:13:24.783170+0000","last_clean":"2024-09-12T22:13:24.783170+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:24.783170+0000","last_undegraded":"2024-09-12T22:13:24.783170+0000","last_fullsized":"2024-09-12T22:13:24.783170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":540,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782233+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:24.782233+0000","last_peered":"2024-09-12T22:13:24.782233+0000","last_clean":"2024-09-12T22:13:24.782233+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:24.782233+0000","last_undegraded":"2024-09-12T22:13:24.782233+0000","last_fullsized":"2024-09-12T22:13:24.782233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781330+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:24.781330+0000","last_peered":"2024-09-12T22:13:24.781330+0000","last_clean":"2024-09-12T22:13:24.781330+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:24.781330+0000","last_undegraded":"2024-09-12T22:13:24.781330+0000","last_fullsized":"2024-09-12T22:13:24.781330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781214+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:24.781214+0000","last_peered":"2024-09-12T22:13:24.781214+0000","last_clean":"2024-09-12T22:13:24.781214+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:24.781214+0000","last_undegraded":"2024-09-12T22:13:24.781214+0000","last_fullsized":"2024-09-12T22:13:24.781214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780274+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:24.780274+0000","last_peered":"2024-09-12T22:13:24.780274+0000","last_clean":"2024-09-12T22:13:24.780274+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:24.780274+0000","last_undegraded":"2024-09-12T22:13:24.780274+0000","last_fullsized":"2024-09-12T22:13:24.780274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":242,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782756+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:24.782756+0000","last_peered":"2024-09-12T22:13:24.782756+0000","last_clean":"2024-09-12T22:13:24.782756+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:24.782756+0000","last_undegraded":"2024-09-12T22:13:24.782756+0000","last_fullsized":"2024-09-12T22:13:24.782756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781912+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:24.781912+0000","last_peered":"2024-09-12T22:13:24.781912+0000","last_clean":"2024-09-12T22:13:24.781912+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:24.781912+0000","last_undegraded":"2024-09-12T22:13:24.781912+0000","last_fullsized":"2024-09-12T22:13:24.781912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":674,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782776+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:24.782776+0000","last_peered":"2024-09-12T22:13:24.782776+0000","last_clean":"2024-09-12T22:13:24.782776+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:24.782776+0000","last_undegraded":"2024-09-12T22:13:24.782776+0000","last_fullsized":"2024-09-12T22:13:24.782776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":906,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781312+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:24.781312+0000","last_peered":"2024-09-12T22:13:24.781312+0000","last_clean":"2024-09-12T22:13:24.781312+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:24.781312+0000","last_undegraded":"2024-09-12T22:13:24.781312+0000","last_fullsized":"2024-09-12T22:13:24.781312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":442,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781465+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:24.781465+0000","last_peered":"2024-09-12T22:13:24.781465+0000","last_clean":"2024-09-12T22:13:24.781465+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:24.781465+0000","last_undegraded":"2024-09-12T22:13:24.781465+0000","last_fullsized":"2024-09-12T22:13:24.781465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1024,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780241+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:24.780241+0000","last_peered":"2024-09-12T22:13:24.780241+0000","last_clean":"2024-09-12T22:13:24.780241+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:24.780241+0000","last_undegraded":"2024-09-12T22:13:24.780241+0000","last_fullsized":"2024-09-12T22:13:24.780241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782903+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:24.782903+0000","last_peered":"2024-09-12T22:13:24.782903+0000","last_clean":"2024-09-12T22:13:24.782903+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:24.782903+0000","last_undegraded":"2024-09-12T22:13:24.782903+0000","last_fullsized":"2024-09-12T22:13:24.782903+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":327,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782688+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:24.782688+0000","last_peered":"2024-09-12T22:13:24.782688+0000","last_clean":"2024-09-12T22:13:24.782688+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:24.782688+0000","last_undegraded":"2024-09-12T22:13:24.782688+0000","last_fullsized":"2024-09-12T22:13:24.782688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":688,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780256+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:24.780256+0000","last_peered":"2024-09-12T22:13:24.780256+0000","last_clean":"2024-09-12T22:13:24.780256+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:24.780256+0000","last_undegraded":"2024-09-12T22:13:24.780256+0000","last_fullsized":"2024-09-12T22:13:24.780256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":192,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781267+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:24.781267+0000","last_peered":"2024-09-12T22:13:24.781267+0000","last_clean":"2024-09-12T22:13:24.781267+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:24.781267+0000","last_undegraded":"2024-09-12T22:13:24.781267+0000","last_fullsized":"2024-09-12T22:13:24.781267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1020,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780205+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:24.780205+0000","last_peered":"2024-09-12T22:13:24.780205+0000","last_clean":"2024-09-12T22:13:24.780205+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:24.780205+0000","last_undegraded":"2024-09-12T22:13:24.780205+0000","last_fullsized":"2024-09-12T22:13:24.780205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":517,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783155+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:24.783155+0000","last_peered":"2024-09-12T22:13:24.783155+0000","last_clean":"2024-09-12T22:13:24.783155+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:24.783155+0000","last_undegraded":"2024-09-12T22:13:24.783155+0000","last_fullsized":"2024-09-12T22:13:24.783155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":922,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780397+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:24.780397+0000","last_peered":"2024-09-12T22:13:24.780397+0000","last_clean":"2024-09-12T22:13:24.780397+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:24.780397+0000","last_undegraded":"2024-09-12T22:13:24.780397+0000","last_fullsized":"2024-09-12T22:13:24.780397+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":579,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780899+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:24.780899+0000","last_peered":"2024-09-12T22:13:24.780899+0000","last_clean":"2024-09-12T22:13:24.780899+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:24.780899+0000","last_undegraded":"2024-09-12T22:13:24.780899+0000","last_fullsized":"2024-09-12T22:13:24.780899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":326,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780407+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:24.780407+0000","last_peered":"2024-09-12T22:13:24.780407+0000","last_clean":"2024-09-12T22:13:24.780407+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:24.780407+0000","last_undegraded":"2024-09-12T22:13:24.780407+0000","last_fullsized":"2024-09-12T22:13:24.780407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":523,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782824+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:24.782824+0000","last_peered":"2024-09-12T22:13:24.782824+0000","last_clean":"2024-09-12T22:13:24.782824+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:24.782824+0000","last_undegraded":"2024-09-12T22:13:24.782824+0000","last_fullsized":"2024-09-12T22:13:24.782824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":283,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782495+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782495+0000","last_peered":"2024-09-12T22:13:24.782495+0000","last_clean":"2024-09-12T22:13:24.782495+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:24.782495+0000","last_undegraded":"2024-09-12T22:13:24.782495+0000","last_fullsized":"2024-09-12T22:13:24.782495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782697+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:24.782697+0000","last_peered":"2024-09-12T22:13:24.782697+0000","last_clean":"2024-09-12T22:13:24.782697+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:24.782697+0000","last_undegraded":"2024-09-12T22:13:24.782697+0000","last_fullsized":"2024-09-12T22:13:24.782697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782280+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:24.782280+0000","last_peered":"2024-09-12T22:13:24.782280+0000","last_clean":"2024-09-12T22:13:24.782280+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:24.782280+0000","last_undegraded":"2024-09-12T22:13:24.782280+0000","last_fullsized":"2024-09-12T22:13:24.782280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781143+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:24.781143+0000","last_peered":"2024-09-12T22:13:24.781143+0000","last_clean":"2024-09-12T22:13:24.781143+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:24.781143+0000","last_undegraded":"2024-09-12T22:13:24.781143+0000","last_fullsized":"2024-09-12T22:13:24.781143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781348+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:24.781348+0000","last_peered":"2024-09-12T22:13:24.781348+0000","last_clean":"2024-09-12T22:13:24.781348+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:24.781348+0000","last_undegraded":"2024-09-12T22:13:24.781348+0000","last_fullsized":"2024-09-12T22:13:24.781348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":894,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781038+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:24.781038+0000","last_peered":"2024-09-12T22:13:24.781038+0000","last_clean":"2024-09-12T22:13:24.781038+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:24.781038+0000","last_undegraded":"2024-09-12T22:13:24.781038+0000","last_fullsized":"2024-09-12T22:13:24.781038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782691+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:24.782691+0000","last_peered":"2024-09-12T22:13:24.782691+0000","last_clean":"2024-09-12T22:13:24.782691+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:24.782691+0000","last_undegraded":"2024-09-12T22:13:24.782691+0000","last_fullsized":"2024-09-12T22:13:24.782691+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":211,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781130+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:24.781130+0000","last_peered":"2024-09-12T22:13:24.781130+0000","last_clean":"2024-09-12T22:13:24.781130+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:24.781130+0000","last_undegraded":"2024-09-12T22:13:24.781130+0000","last_fullsized":"2024-09-12T22:13:24.781130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":650,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781368+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:24.781368+0000","last_peered":"2024-09-12T22:13:24.781368+0000","last_clean":"2024-09-12T22:13:24.781368+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:24.781368+0000","last_undegraded":"2024-09-12T22:13:24.781368+0000","last_fullsized":"2024-09-12T22:13:24.781368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781216+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:24.781216+0000","last_peered":"2024-09-12T22:13:24.781216+0000","last_clean":"2024-09-12T22:13:24.781216+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:24.781216+0000","last_undegraded":"2024-09-12T22:13:24.781216+0000","last_fullsized":"2024-09-12T22:13:24.781216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906950,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76828,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295012,"statfs":{"total":96636764160,"available":96558092288,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114660,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257180,"statfs":{"total":96636764160,"available":96519352320,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118496,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253344,"statfs":{"total":96636764160,"available":96515424256,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:30.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:13:31.018 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:31.018 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:13:24.774641+0000","last_up_change":"2024-09-12T22:13:06.714165+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":64,"up_thru":81,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6801","nonce":29356918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6803","nonce":29356918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6807","nonce":29356918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6805","nonce":29356918}]},"public_addr":"172.21.15.164:6801/29356918","cluster_addr":"172.21.15.164:6803/29356918","heartbeat_back_addr":"172.21.15.164:6807/29356918","heartbeat_front_addr":"172.21.15.164:6805/29356918","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":30}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":0,"to":1}]},{"pgid":"3.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.a","mappings":[{"from":1,"to":2}]},{"pgid":"3.16","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":1,"to":0}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.1a","mappings":[{"from":0,"to":2}]},{"pgid":"4.20","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:13:32.031 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T22:13:32.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:13:32.174 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:13:32.174 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:13:32.174 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:13:32.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T22:13:32.475 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T22:13:32.488 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T22:13:32.488 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:13:32.615 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:13:32.615 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:13:32.616 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:13:32.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T22:13:32.917 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T22:13:32.930 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T22:13:32.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:13:33.057 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:13:33.058 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T22:13:33.058 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:13:33.069 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T22:13:33.357 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T22:13:33.370 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:33.667 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:33.669 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:33.679 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-12T22:13:33.128120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33067,"ondisk_log_size":33067,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309984,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805536,"statfs":{"total":289910292480,"available":289592868864,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-759,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1049,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.352251"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":577,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783387+0000","last_change":"2024-09-12T22:13:23.781184+0000","last_active":"2024-09-12T22:13:24.783387+0000","last_peered":"2024-09-12T22:13:24.783387+0000","last_clean":"2024-09-12T22:13:24.783387+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:13:24.783387+0000","last_undegraded":"2024-09-12T22:13:24.783387+0000","last_fullsized":"2024-09-12T22:13:24.783387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:51.501549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783355+0000","last_change":"2024-09-12T22:13:11.756391+0000","last_active":"2024-09-12T22:13:24.783355+0000","last_peered":"2024-09-12T22:13:24.783355+0000","last_clean":"2024-09-12T22:13:24.783355+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:24.783355+0000","last_undegraded":"2024-09-12T22:13:24.783355+0000","last_fullsized":"2024-09-12T22:13:24.783355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":866,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781319+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:24.781319+0000","last_peered":"2024-09-12T22:13:24.781319+0000","last_clean":"2024-09-12T22:13:24.781319+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:24.781319+0000","last_undegraded":"2024-09-12T22:13:24.781319+0000","last_fullsized":"2024-09-12T22:13:24.781319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:25.815186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":599,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781138+0000","last_change":"2024-09-12T22:09:50.969815+0000","last_active":"2024-09-12T22:13:24.781138+0000","last_peered":"2024-09-12T22:13:24.781138+0000","last_clean":"2024-09-12T22:13:24.781138+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:24.781138+0000","last_undegraded":"2024-09-12T22:13:24.781138+0000","last_fullsized":"2024-09-12T22:13:24.781138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":623,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:15.789292+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:10.745297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780765+0000","last_change":"2024-09-12T22:09:50.966677+0000","last_active":"2024-09-12T22:13:24.780765+0000","last_peered":"2024-09-12T22:13:24.780765+0000","last_clean":"2024-09-12T22:13:24.780765+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:24.780765+0000","last_undegraded":"2024-09-12T22:13:24.780765+0000","last_fullsized":"2024-09-12T22:13:24.780765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":686,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780956+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:24.780956+0000","last_peered":"2024-09-12T22:13:24.780956+0000","last_clean":"2024-09-12T22:13:24.780956+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:24.780956+0000","last_undegraded":"2024-09-12T22:13:24.780956+0000","last_fullsized":"2024-09-12T22:13:24.780956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:54.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780690+0000","last_change":"2024-09-12T22:09:50.970361+0000","last_active":"2024-09-12T22:13:24.780690+0000","last_peered":"2024-09-12T22:13:24.780690+0000","last_clean":"2024-09-12T22:13:24.780690+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:24.780690+0000","last_undegraded":"2024-09-12T22:13:24.780690+0000","last_fullsized":"2024-09-12T22:13:24.780690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:19.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":982,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780825+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:24.780825+0000","last_peered":"2024-09-12T22:13:24.780825+0000","last_clean":"2024-09-12T22:13:24.780825+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:24.780825+0000","last_undegraded":"2024-09-12T22:13:24.780825+0000","last_fullsized":"2024-09-12T22:13:24.780825+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:42.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783311+0000","last_change":"2024-09-12T22:13:12.769448+0000","last_active":"2024-09-12T22:13:24.783311+0000","last_peered":"2024-09-12T22:13:24.783311+0000","last_clean":"2024-09-12T22:13:24.783311+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:24.783311+0000","last_undegraded":"2024-09-12T22:13:24.783311+0000","last_fullsized":"2024-09-12T22:13:24.783311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:01.157745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781586+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:24.781586+0000","last_peered":"2024-09-12T22:13:24.781586+0000","last_clean":"2024-09-12T22:13:24.781586+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:24.781586+0000","last_undegraded":"2024-09-12T22:13:24.781586+0000","last_fullsized":"2024-09-12T22:13:24.781586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:47.301950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":485,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783141+0000","last_change":"2024-09-12T22:13:16.790626+0000","last_active":"2024-09-12T22:13:24.783141+0000","last_peered":"2024-09-12T22:13:24.783141+0000","last_clean":"2024-09-12T22:13:24.783141+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:24.783141+0000","last_undegraded":"2024-09-12T22:13:24.783141+0000","last_fullsized":"2024-09-12T22:13:24.783141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:10.712603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782600+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:24.782600+0000","last_peered":"2024-09-12T22:13:24.782600+0000","last_clean":"2024-09-12T22:13:24.782600+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:24.782600+0000","last_undegraded":"2024-09-12T22:13:24.782600+0000","last_fullsized":"2024-09-12T22:13:24.782600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:09:41.564199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":940,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780983+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:24.780983+0000","last_peered":"2024-09-12T22:13:24.780983+0000","last_clean":"2024-09-12T22:13:24.780983+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:24.780983+0000","last_undegraded":"2024-09-12T22:13:24.780983+0000","last_fullsized":"2024-09-12T22:13:24.780983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:57.255349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1039,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781025+0000","last_change":"2024-09-12T22:13:11.756628+0000","last_active":"2024-09-12T22:13:24.781025+0000","last_peered":"2024-09-12T22:13:24.781025+0000","last_clean":"2024-09-12T22:13:24.781025+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:24.781025+0000","last_undegraded":"2024-09-12T22:13:24.781025+0000","last_fullsized":"2024-09-12T22:13:24.781025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:28.077164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":624,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781202+0000","last_change":"2024-09-12T22:09:50.965732+0000","last_active":"2024-09-12T22:13:24.781202+0000","last_peered":"2024-09-12T22:13:24.781202+0000","last_clean":"2024-09-12T22:13:24.781202+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:24.781202+0000","last_undegraded":"2024-09-12T22:13:24.781202+0000","last_fullsized":"2024-09-12T22:13:24.781202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:50.601321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":939,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781309+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:24.781309+0000","last_peered":"2024-09-12T22:13:24.781309+0000","last_clean":"2024-09-12T22:13:24.781309+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:24.781309+0000","last_undegraded":"2024-09-12T22:13:24.781309+0000","last_fullsized":"2024-09-12T22:13:24.781309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:53.456009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783153+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:24.783153+0000","last_peered":"2024-09-12T22:13:24.783153+0000","last_clean":"2024-09-12T22:13:24.783153+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:24.783153+0000","last_undegraded":"2024-09-12T22:13:24.783153+0000","last_fullsized":"2024-09-12T22:13:24.783153+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:28.944594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780749+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:24.780749+0000","last_peered":"2024-09-12T22:13:24.780749+0000","last_clean":"2024-09-12T22:13:24.780749+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:24.780749+0000","last_undegraded":"2024-09-12T22:13:24.780749+0000","last_fullsized":"2024-09-12T22:13:24.780749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:55.314936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":617,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781177+0000","last_change":"2024-09-12T22:09:50.965527+0000","last_active":"2024-09-12T22:13:24.781177+0000","last_peered":"2024-09-12T22:13:24.781177+0000","last_clean":"2024-09-12T22:13:24.781177+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:24.781177+0000","last_undegraded":"2024-09-12T22:13:24.781177+0000","last_fullsized":"2024-09-12T22:13:24.781177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:12.412987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780992+0000","last_change":"2024-09-12T22:09:50.968118+0000","last_active":"2024-09-12T22:13:24.780992+0000","last_peered":"2024-09-12T22:13:24.780992+0000","last_clean":"2024-09-12T22:13:24.780992+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:24.780992+0000","last_undegraded":"2024-09-12T22:13:24.780992+0000","last_fullsized":"2024-09-12T22:13:24.780992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:23.697527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":603,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783042+0000","last_change":"2024-09-12T22:13:16.791005+0000","last_active":"2024-09-12T22:13:24.783042+0000","last_peered":"2024-09-12T22:13:24.783042+0000","last_clean":"2024-09-12T22:13:24.783042+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:24.783042+0000","last_undegraded":"2024-09-12T22:13:24.783042+0000","last_fullsized":"2024-09-12T22:13:24.783042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:34:59.486974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":658,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780069+0000","last_change":"2024-09-12T22:09:50.964630+0000","last_active":"2024-09-12T22:13:24.780069+0000","last_peered":"2024-09-12T22:13:24.780069+0000","last_clean":"2024-09-12T22:13:24.780069+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:24.780069+0000","last_undegraded":"2024-09-12T22:13:24.780069+0000","last_fullsized":"2024-09-12T22:13:24.780069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:28.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782800+0000","last_change":"2024-09-12T22:13:21.785416+0000","last_active":"2024-09-12T22:13:24.782800+0000","last_peered":"2024-09-12T22:13:24.782800+0000","last_clean":"2024-09-12T22:13:24.782800+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:13:24.782800+0000","last_undegraded":"2024-09-12T22:13:24.782800+0000","last_fullsized":"2024-09-12T22:13:24.782800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:11.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":518,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783050+0000","last_change":"2024-09-12T22:13:17.797818+0000","last_active":"2024-09-12T22:13:24.783050+0000","last_peered":"2024-09-12T22:13:24.783050+0000","last_clean":"2024-09-12T22:13:24.783050+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:24.783050+0000","last_undegraded":"2024-09-12T22:13:24.783050+0000","last_fullsized":"2024-09-12T22:13:24.783050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:52.148925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780957+0000","last_change":"2024-09-12T22:09:50.961133+0000","last_active":"2024-09-12T22:13:24.780957+0000","last_peered":"2024-09-12T22:13:24.780957+0000","last_clean":"2024-09-12T22:13:24.780957+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:24.780957+0000","last_undegraded":"2024-09-12T22:13:24.780957+0000","last_fullsized":"2024-09-12T22:13:24.780957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:50.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":870,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781672+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:24.781672+0000","last_peered":"2024-09-12T22:13:24.781672+0000","last_clean":"2024-09-12T22:13:24.781672+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:24.781672+0000","last_undegraded":"2024-09-12T22:13:24.781672+0000","last_fullsized":"2024-09-12T22:13:24.781672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:33.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":545,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782949+0000","last_change":"2024-09-12T22:13:11.756452+0000","last_active":"2024-09-12T22:13:24.782949+0000","last_peered":"2024-09-12T22:13:24.782949+0000","last_clean":"2024-09-12T22:13:24.782949+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:24.782949+0000","last_undegraded":"2024-09-12T22:13:24.782949+0000","last_fullsized":"2024-09-12T22:13:24.782949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.095621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":979,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780784+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:24.780784+0000","last_peered":"2024-09-12T22:13:24.780784+0000","last_clean":"2024-09-12T22:13:24.780784+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:24.780784+0000","last_undegraded":"2024-09-12T22:13:24.780784+0000","last_fullsized":"2024-09-12T22:13:24.780784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:53.759898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":635,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782555+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:24.782555+0000","last_peered":"2024-09-12T22:13:24.782555+0000","last_clean":"2024-09-12T22:13:24.782555+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:24.782555+0000","last_undegraded":"2024-09-12T22:13:24.782555+0000","last_fullsized":"2024-09-12T22:13:24.782555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:27.232247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":934,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780124+0000","last_change":"2024-09-12T22:13:12.763962+0000","last_active":"2024-09-12T22:13:24.780124+0000","last_peered":"2024-09-12T22:13:24.780124+0000","last_clean":"2024-09-12T22:13:24.780124+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:24.780124+0000","last_undegraded":"2024-09-12T22:13:24.780124+0000","last_fullsized":"2024-09-12T22:13:24.780124+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:53.731624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1002,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.785126+0000","last_change":"2024-09-12T22:13:24.785126+0000","last_active":"2024-09-12T22:13:24.785126+0000","last_peered":"2024-09-12T22:13:24.785126+0000","last_clean":"2024-09-12T22:13:24.785126+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:13:24.785126+0000","last_undegraded":"2024-09-12T22:13:24.785126+0000","last_fullsized":"2024-09-12T22:13:24.785126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:01.051692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":560,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782376+0000","last_change":"2024-09-12T22:13:11.756471+0000","last_active":"2024-09-12T22:13:24.782376+0000","last_peered":"2024-09-12T22:13:24.782376+0000","last_clean":"2024-09-12T22:13:24.782376+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:24.782376+0000","last_undegraded":"2024-09-12T22:13:24.782376+0000","last_fullsized":"2024-09-12T22:13:24.782376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:42.322399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":452,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781494+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:24.781494+0000","last_peered":"2024-09-12T22:13:24.781494+0000","last_clean":"2024-09-12T22:13:24.781494+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:24.781494+0000","last_undegraded":"2024-09-12T22:13:24.781494+0000","last_fullsized":"2024-09-12T22:13:24.781494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:16.962786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":561,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782748+0000","last_change":"2024-09-12T22:13:17.797833+0000","last_active":"2024-09-12T22:13:24.782748+0000","last_peered":"2024-09-12T22:13:24.782748+0000","last_clean":"2024-09-12T22:13:24.782748+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:24.782748+0000","last_undegraded":"2024-09-12T22:13:24.782748+0000","last_fullsized":"2024-09-12T22:13:24.782748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.925970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780393+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:24.780393+0000","last_peered":"2024-09-12T22:13:24.780393+0000","last_clean":"2024-09-12T22:13:24.780393+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:24.780393+0000","last_undegraded":"2024-09-12T22:13:24.780393+0000","last_fullsized":"2024-09-12T22:13:24.780393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:29.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781190+0000","last_change":"2024-09-12T22:09:50.965646+0000","last_active":"2024-09-12T22:13:24.781190+0000","last_peered":"2024-09-12T22:13:24.781190+0000","last_clean":"2024-09-12T22:13:24.781190+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:24.781190+0000","last_undegraded":"2024-09-12T22:13:24.781190+0000","last_fullsized":"2024-09-12T22:13:24.781190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:18.619680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782440+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:24.782440+0000","last_peered":"2024-09-12T22:13:24.782440+0000","last_clean":"2024-09-12T22:13:24.782440+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:24.782440+0000","last_undegraded":"2024-09-12T22:13:24.782440+0000","last_fullsized":"2024-09-12T22:13:24.782440+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":571,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780918+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:24.780918+0000","last_peered":"2024-09-12T22:13:24.780918+0000","last_clean":"2024-09-12T22:13:24.780918+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:24.780918+0000","last_undegraded":"2024-09-12T22:13:24.780918+0000","last_fullsized":"2024-09-12T22:13:24.780918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:57.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"58'70","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781248+0000","last_change":"2024-09-12T22:13:07.745851+0000","last_active":"2024-09-12T22:13:24.781248+0000","last_peered":"2024-09-12T22:13:24.781248+0000","last_clean":"2024-09-12T22:13:24.781248+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:24.781248+0000","last_undegraded":"2024-09-12T22:13:24.781248+0000","last_fullsized":"2024-09-12T22:13:24.781248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:23.325241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":311,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781830+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:24.781830+0000","last_peered":"2024-09-12T22:13:24.781830+0000","last_clean":"2024-09-12T22:13:24.781830+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:24.781830+0000","last_undegraded":"2024-09-12T22:13:24.781830+0000","last_fullsized":"2024-09-12T22:13:24.781830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:08.012088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":530,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783139+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:24.783139+0000","last_peered":"2024-09-12T22:13:24.783139+0000","last_clean":"2024-09-12T22:13:24.783139+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:24.783139+0000","last_undegraded":"2024-09-12T22:13:24.783139+0000","last_fullsized":"2024-09-12T22:13:24.783139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:02.122528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'217","reported_seq":338,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783191+0000","last_change":"2024-09-12T22:13:10.750713+0000","last_active":"2024-09-12T22:13:24.783191+0000","last_peered":"2024-09-12T22:13:24.783191+0000","last_clean":"2024-09-12T22:13:24.783191+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:24.783191+0000","last_undegraded":"2024-09-12T22:13:24.783191+0000","last_fullsized":"2024-09-12T22:13:24.783191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:07.283514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":553,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.787848+0000","last_change":"2024-09-12T22:13:24.787848+0000","last_active":"2024-09-12T22:13:24.787848+0000","last_peered":"2024-09-12T22:13:24.787848+0000","last_clean":"2024-09-12T22:13:24.787848+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:13:24.787848+0000","last_undegraded":"2024-09-12T22:13:24.787848+0000","last_fullsized":"2024-09-12T22:13:24.787848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:22.209835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'472","reported_seq":627,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781965+0000","last_change":"2024-09-12T22:13:10.750594+0000","last_active":"2024-09-12T22:13:24.781965+0000","last_peered":"2024-09-12T22:13:24.781965+0000","last_clean":"2024-09-12T22:13:24.781965+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:24.781965+0000","last_undegraded":"2024-09-12T22:13:24.781965+0000","last_fullsized":"2024-09-12T22:13:24.781965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:23.427419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781125+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:24.781125+0000","last_peered":"2024-09-12T22:13:24.781125+0000","last_clean":"2024-09-12T22:13:24.781125+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:24.781125+0000","last_undegraded":"2024-09-12T22:13:24.781125+0000","last_fullsized":"2024-09-12T22:13:24.781125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:28.957283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":198,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781500+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:24.781500+0000","last_peered":"2024-09-12T22:13:24.781500+0000","last_clean":"2024-09-12T22:13:24.781500+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:24.781500+0000","last_undegraded":"2024-09-12T22:13:24.781500+0000","last_fullsized":"2024-09-12T22:13:24.781500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:17.108019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":608,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780535+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:24.780535+0000","last_peered":"2024-09-12T22:13:24.780535+0000","last_clean":"2024-09-12T22:13:24.780535+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:24.780535+0000","last_undegraded":"2024-09-12T22:13:24.780535+0000","last_fullsized":"2024-09-12T22:13:24.780535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:25.404115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":312,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780968+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:24.780968+0000","last_peered":"2024-09-12T22:13:24.780968+0000","last_clean":"2024-09-12T22:13:24.780968+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:24.780968+0000","last_undegraded":"2024-09-12T22:13:24.780968+0000","last_fullsized":"2024-09-12T22:13:24.780968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:48.403867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781304+0000","last_change":"2024-09-12T22:09:50.966328+0000","last_active":"2024-09-12T22:13:24.781304+0000","last_peered":"2024-09-12T22:13:24.781304+0000","last_clean":"2024-09-12T22:13:24.781304+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:24.781304+0000","last_undegraded":"2024-09-12T22:13:24.781304+0000","last_fullsized":"2024-09-12T22:13:24.781304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:50.661909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782279+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:24.782279+0000","last_peered":"2024-09-12T22:13:24.782279+0000","last_clean":"2024-09-12T22:13:24.782279+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:24.782279+0000","last_undegraded":"2024-09-12T22:13:24.782279+0000","last_fullsized":"2024-09-12T22:13:24.782279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:42.365730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":896,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781826+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:24.781826+0000","last_peered":"2024-09-12T22:13:24.781826+0000","last_clean":"2024-09-12T22:13:24.781826+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:24.781826+0000","last_undegraded":"2024-09-12T22:13:24.781826+0000","last_fullsized":"2024-09-12T22:13:24.781826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.561983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782087+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:24.782087+0000","last_peered":"2024-09-12T22:13:24.782087+0000","last_clean":"2024-09-12T22:13:24.782087+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:24.782087+0000","last_undegraded":"2024-09-12T22:13:24.782087+0000","last_fullsized":"2024-09-12T22:13:24.782087+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:37.109766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":841,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781926+0000","last_change":"2024-09-12T22:13:12.768714+0000","last_active":"2024-09-12T22:13:24.781926+0000","last_peered":"2024-09-12T22:13:24.781926+0000","last_clean":"2024-09-12T22:13:24.781926+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:24.781926+0000","last_undegraded":"2024-09-12T22:13:24.781926+0000","last_fullsized":"2024-09-12T22:13:24.781926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:05.323162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":604,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782990+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782990+0000","last_peered":"2024-09-12T22:13:24.782990+0000","last_clean":"2024-09-12T22:13:24.782990+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:24.782990+0000","last_undegraded":"2024-09-12T22:13:24.782990+0000","last_fullsized":"2024-09-12T22:13:24.782990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:59.672412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":976,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781071+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:24.781071+0000","last_peered":"2024-09-12T22:13:24.781071+0000","last_clean":"2024-09-12T22:13:24.781071+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:24.781071+0000","last_undegraded":"2024-09-12T22:13:24.781071+0000","last_fullsized":"2024-09-12T22:13:24.781071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:24.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":358,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781569+0000","last_change":"2024-09-12T22:13:07.744382+0000","last_active":"2024-09-12T22:13:24.781569+0000","last_peered":"2024-09-12T22:13:24.781569+0000","last_clean":"2024-09-12T22:13:24.781569+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:24.781569+0000","last_undegraded":"2024-09-12T22:13:24.781569+0000","last_fullsized":"2024-09-12T22:13:24.781569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:39.784615+0000","last_clean_scrub_stamp":"2024-09-12T22:09:39.784615+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:32.035703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781558+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:24.781558+0000","last_peered":"2024-09-12T22:13:24.781558+0000","last_clean":"2024-09-12T22:13:24.781558+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:24.781558+0000","last_undegraded":"2024-09-12T22:13:24.781558+0000","last_fullsized":"2024-09-12T22:13:24.781558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:52.719045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"57'608","reported_seq":764,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780511+0000","last_change":"2024-09-12T22:13:10.749280+0000","last_active":"2024-09-12T22:13:24.780511+0000","last_peered":"2024-09-12T22:13:24.780511+0000","last_clean":"2024-09-12T22:13:24.780511+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:24.780511+0000","last_undegraded":"2024-09-12T22:13:24.780511+0000","last_fullsized":"2024-09-12T22:13:24.780511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:31.472816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":992,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781862+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:24.781862+0000","last_peered":"2024-09-12T22:13:24.781862+0000","last_clean":"2024-09-12T22:13:24.781862+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:24.781862+0000","last_undegraded":"2024-09-12T22:13:24.781862+0000","last_fullsized":"2024-09-12T22:13:24.781862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:19.489834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781666+0000","last_change":"2024-09-12T22:13:07.744045+0000","last_active":"2024-09-12T22:13:24.781666+0000","last_peered":"2024-09-12T22:13:24.781666+0000","last_clean":"2024-09-12T22:13:24.781666+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:24.781666+0000","last_undegraded":"2024-09-12T22:13:24.781666+0000","last_fullsized":"2024-09-12T22:13:24.781666+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:48.622501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":298,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780576+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:24.780576+0000","last_peered":"2024-09-12T22:13:24.780576+0000","last_clean":"2024-09-12T22:13:24.780576+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:24.780576+0000","last_undegraded":"2024-09-12T22:13:24.780576+0000","last_fullsized":"2024-09-12T22:13:24.780576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:42.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":613,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783486+0000","last_change":"2024-09-12T22:13:12.767343+0000","last_active":"2024-09-12T22:13:24.783486+0000","last_peered":"2024-09-12T22:13:24.783486+0000","last_clean":"2024-09-12T22:13:24.783486+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:24.783486+0000","last_undegraded":"2024-09-12T22:13:24.783486+0000","last_fullsized":"2024-09-12T22:13:24.783486+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:39.778430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780621+0000","last_change":"2024-09-12T22:13:07.745888+0000","last_active":"2024-09-12T22:13:24.780621+0000","last_peered":"2024-09-12T22:13:24.780621+0000","last_clean":"2024-09-12T22:13:24.780621+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:24.780621+0000","last_undegraded":"2024-09-12T22:13:24.780621+0000","last_fullsized":"2024-09-12T22:13:24.780621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:08.076572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"58'397","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782556+0000","last_change":"2024-09-12T22:13:10.749795+0000","last_active":"2024-09-12T22:13:24.782556+0000","last_peered":"2024-09-12T22:13:24.782556+0000","last_clean":"2024-09-12T22:13:24.782556+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:24.782556+0000","last_undegraded":"2024-09-12T22:13:24.782556+0000","last_fullsized":"2024-09-12T22:13:24.782556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:00.484633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":824,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781096+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:24.781096+0000","last_peered":"2024-09-12T22:13:24.781096+0000","last_clean":"2024-09-12T22:13:24.781096+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:24.781096+0000","last_undegraded":"2024-09-12T22:13:24.781096+0000","last_fullsized":"2024-09-12T22:13:24.781096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:29.401241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781261+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:24.781261+0000","last_peered":"2024-09-12T22:13:24.781261+0000","last_clean":"2024-09-12T22:13:24.781261+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:24.781261+0000","last_undegraded":"2024-09-12T22:13:24.781261+0000","last_fullsized":"2024-09-12T22:13:24.781261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:35.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782545+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:24.782545+0000","last_peered":"2024-09-12T22:13:24.782545+0000","last_clean":"2024-09-12T22:13:24.782545+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:24.782545+0000","last_undegraded":"2024-09-12T22:13:24.782545+0000","last_fullsized":"2024-09-12T22:13:24.782545+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:25.724802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":935,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780747+0000","last_change":"2024-09-12T22:13:11.754979+0000","last_active":"2024-09-12T22:13:24.780747+0000","last_peered":"2024-09-12T22:13:24.780747+0000","last_clean":"2024-09-12T22:13:24.780747+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:24.780747+0000","last_undegraded":"2024-09-12T22:13:24.780747+0000","last_fullsized":"2024-09-12T22:13:24.780747+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":423,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782014+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:24.782014+0000","last_peered":"2024-09-12T22:13:24.782014+0000","last_clean":"2024-09-12T22:13:24.782014+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:24.782014+0000","last_undegraded":"2024-09-12T22:13:24.782014+0000","last_fullsized":"2024-09-12T22:13:24.782014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:47:00.700484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780845+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:24.780845+0000","last_peered":"2024-09-12T22:13:24.780845+0000","last_clean":"2024-09-12T22:13:24.780845+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:24.780845+0000","last_undegraded":"2024-09-12T22:13:24.780845+0000","last_fullsized":"2024-09-12T22:13:24.780845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:48.318612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":501,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782933+0000","last_change":"2024-09-12T22:13:15.789184+0000","last_active":"2024-09-12T22:13:24.782933+0000","last_peered":"2024-09-12T22:13:24.782933+0000","last_clean":"2024-09-12T22:13:24.782933+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:24.782933+0000","last_undegraded":"2024-09-12T22:13:24.782933+0000","last_fullsized":"2024-09-12T22:13:24.782933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:01.514030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":207,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781077+0000","last_change":"2024-09-12T22:13:07.742901+0000","last_active":"2024-09-12T22:13:24.781077+0000","last_peered":"2024-09-12T22:13:24.781077+0000","last_clean":"2024-09-12T22:13:24.781077+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:24.781077+0000","last_undegraded":"2024-09-12T22:13:24.781077+0000","last_fullsized":"2024-09-12T22:13:24.781077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:54.675910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783170+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:24.783170+0000","last_peered":"2024-09-12T22:13:24.783170+0000","last_clean":"2024-09-12T22:13:24.783170+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:24.783170+0000","last_undegraded":"2024-09-12T22:13:24.783170+0000","last_fullsized":"2024-09-12T22:13:24.783170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:12.540683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":540,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782233+0000","last_change":"2024-09-12T22:13:12.767231+0000","last_active":"2024-09-12T22:13:24.782233+0000","last_peered":"2024-09-12T22:13:24.782233+0000","last_clean":"2024-09-12T22:13:24.782233+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:24.782233+0000","last_undegraded":"2024-09-12T22:13:24.782233+0000","last_fullsized":"2024-09-12T22:13:24.782233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:31.966456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"58'65","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781330+0000","last_change":"2024-09-12T22:13:07.746920+0000","last_active":"2024-09-12T22:13:24.781330+0000","last_peered":"2024-09-12T22:13:24.781330+0000","last_clean":"2024-09-12T22:13:24.781330+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:24.781330+0000","last_undegraded":"2024-09-12T22:13:24.781330+0000","last_fullsized":"2024-09-12T22:13:24.781330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:36.856984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781214+0000","last_change":"2024-09-12T22:13:07.743456+0000","last_active":"2024-09-12T22:13:24.781214+0000","last_peered":"2024-09-12T22:13:24.781214+0000","last_clean":"2024-09-12T22:13:24.781214+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:24.781214+0000","last_undegraded":"2024-09-12T22:13:24.781214+0000","last_fullsized":"2024-09-12T22:13:24.781214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:15.091632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":566,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780274+0000","last_change":"2024-09-12T22:09:50.966744+0000","last_active":"2024-09-12T22:13:24.780274+0000","last_peered":"2024-09-12T22:13:24.780274+0000","last_clean":"2024-09-12T22:13:24.780274+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:24.780274+0000","last_undegraded":"2024-09-12T22:13:24.780274+0000","last_fullsized":"2024-09-12T22:13:24.780274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.567648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"59'107","reported_seq":242,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782756+0000","last_change":"2024-09-12T22:13:10.750754+0000","last_active":"2024-09-12T22:13:24.782756+0000","last_peered":"2024-09-12T22:13:24.782756+0000","last_clean":"2024-09-12T22:13:24.782756+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:24.782756+0000","last_undegraded":"2024-09-12T22:13:24.782756+0000","last_fullsized":"2024-09-12T22:13:24.782756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:05.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781912+0000","last_change":"2024-09-12T22:13:07.746009+0000","last_active":"2024-09-12T22:13:24.781912+0000","last_peered":"2024-09-12T22:13:24.781912+0000","last_clean":"2024-09-12T22:13:24.781912+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:24.781912+0000","last_undegraded":"2024-09-12T22:13:24.781912+0000","last_fullsized":"2024-09-12T22:13:24.781912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:24.263843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":674,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782776+0000","last_change":"2024-09-12T22:13:10.752211+0000","last_active":"2024-09-12T22:13:24.782776+0000","last_peered":"2024-09-12T22:13:24.782776+0000","last_clean":"2024-09-12T22:13:24.782776+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:24.782776+0000","last_undegraded":"2024-09-12T22:13:24.782776+0000","last_fullsized":"2024-09-12T22:13:24.782776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:24.394502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":906,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781312+0000","last_change":"2024-09-12T22:13:13.769103+0000","last_active":"2024-09-12T22:13:24.781312+0000","last_peered":"2024-09-12T22:13:24.781312+0000","last_clean":"2024-09-12T22:13:24.781312+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:24.781312+0000","last_undegraded":"2024-09-12T22:13:24.781312+0000","last_fullsized":"2024-09-12T22:13:24.781312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:24.031293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":442,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781465+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:24.781465+0000","last_peered":"2024-09-12T22:13:24.781465+0000","last_clean":"2024-09-12T22:13:24.781465+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:24.781465+0000","last_undegraded":"2024-09-12T22:13:24.781465+0000","last_fullsized":"2024-09-12T22:13:24.781465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:11.703570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1024,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780241+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:24.780241+0000","last_peered":"2024-09-12T22:13:24.780241+0000","last_clean":"2024-09-12T22:13:24.780241+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:24.780241+0000","last_undegraded":"2024-09-12T22:13:24.780241+0000","last_fullsized":"2024-09-12T22:13:24.780241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:30.431924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782903+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:24.782903+0000","last_peered":"2024-09-12T22:13:24.782903+0000","last_clean":"2024-09-12T22:13:24.782903+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:24.782903+0000","last_undegraded":"2024-09-12T22:13:24.782903+0000","last_fullsized":"2024-09-12T22:13:24.782903+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:52.125691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":327,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782688+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:24.782688+0000","last_peered":"2024-09-12T22:13:24.782688+0000","last_clean":"2024-09-12T22:13:24.782688+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:24.782688+0000","last_undegraded":"2024-09-12T22:13:24.782688+0000","last_fullsized":"2024-09-12T22:13:24.782688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:31.451035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":688,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780256+0000","last_change":"2024-09-12T22:09:50.964725+0000","last_active":"2024-09-12T22:13:24.780256+0000","last_peered":"2024-09-12T22:13:24.780256+0000","last_clean":"2024-09-12T22:13:24.780256+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:24.780256+0000","last_undegraded":"2024-09-12T22:13:24.780256+0000","last_fullsized":"2024-09-12T22:13:24.780256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:06.800291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":192,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781267+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:24.781267+0000","last_peered":"2024-09-12T22:13:24.781267+0000","last_clean":"2024-09-12T22:13:24.781267+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:24.781267+0000","last_undegraded":"2024-09-12T22:13:24.781267+0000","last_fullsized":"2024-09-12T22:13:24.781267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:52.979582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1020,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780205+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:24.780205+0000","last_peered":"2024-09-12T22:13:24.780205+0000","last_clean":"2024-09-12T22:13:24.780205+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:24.780205+0000","last_undegraded":"2024-09-12T22:13:24.780205+0000","last_fullsized":"2024-09-12T22:13:24.780205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:09.015763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":517,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783155+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:24.783155+0000","last_peered":"2024-09-12T22:13:24.783155+0000","last_clean":"2024-09-12T22:13:24.783155+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:24.783155+0000","last_undegraded":"2024-09-12T22:13:24.783155+0000","last_fullsized":"2024-09-12T22:13:24.783155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:15.173270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'766","reported_seq":922,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780397+0000","last_change":"2024-09-12T22:13:10.748567+0000","last_active":"2024-09-12T22:13:24.780397+0000","last_peered":"2024-09-12T22:13:24.780397+0000","last_clean":"2024-09-12T22:13:24.780397+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:24.780397+0000","last_undegraded":"2024-09-12T22:13:24.780397+0000","last_fullsized":"2024-09-12T22:13:24.780397+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:17.470642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":579,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780899+0000","last_change":"2024-09-12T22:09:50.965336+0000","last_active":"2024-09-12T22:13:24.780899+0000","last_peered":"2024-09-12T22:13:24.780899+0000","last_clean":"2024-09-12T22:13:24.780899+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:24.780899+0000","last_undegraded":"2024-09-12T22:13:24.780899+0000","last_fullsized":"2024-09-12T22:13:24.780899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:56.958926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"58'185","reported_seq":326,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780407+0000","last_change":"2024-09-12T22:09:49.951707+0000","last_active":"2024-09-12T22:13:24.780407+0000","last_peered":"2024-09-12T22:13:24.780407+0000","last_clean":"2024-09-12T22:13:24.780407+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:24.780407+0000","last_undegraded":"2024-09-12T22:13:24.780407+0000","last_fullsized":"2024-09-12T22:13:24.780407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:09.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":523,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782824+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:24.782824+0000","last_peered":"2024-09-12T22:13:24.782824+0000","last_clean":"2024-09-12T22:13:24.782824+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:24.782824+0000","last_undegraded":"2024-09-12T22:13:24.782824+0000","last_fullsized":"2024-09-12T22:13:24.782824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:58.064932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":283,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782495+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782495+0000","last_peered":"2024-09-12T22:13:24.782495+0000","last_clean":"2024-09-12T22:13:24.782495+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:24.782495+0000","last_undegraded":"2024-09-12T22:13:24.782495+0000","last_fullsized":"2024-09-12T22:13:24.782495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:09.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":533,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782697+0000","last_change":"2024-09-12T22:13:10.752853+0000","last_active":"2024-09-12T22:13:24.782697+0000","last_peered":"2024-09-12T22:13:24.782697+0000","last_clean":"2024-09-12T22:13:24.782697+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:24.782697+0000","last_undegraded":"2024-09-12T22:13:24.782697+0000","last_fullsized":"2024-09-12T22:13:24.782697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.208684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782280+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:24.782280+0000","last_peered":"2024-09-12T22:13:24.782280+0000","last_clean":"2024-09-12T22:13:24.782280+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:24.782280+0000","last_undegraded":"2024-09-12T22:13:24.782280+0000","last_fullsized":"2024-09-12T22:13:24.782280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:08.496846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781143+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:24.781143+0000","last_peered":"2024-09-12T22:13:24.781143+0000","last_clean":"2024-09-12T22:13:24.781143+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:24.781143+0000","last_undegraded":"2024-09-12T22:13:24.781143+0000","last_fullsized":"2024-09-12T22:13:24.781143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.570271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781348+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:24.781348+0000","last_peered":"2024-09-12T22:13:24.781348+0000","last_clean":"2024-09-12T22:13:24.781348+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:24.781348+0000","last_undegraded":"2024-09-12T22:13:24.781348+0000","last_fullsized":"2024-09-12T22:13:24.781348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:04.696490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":894,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781038+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:24.781038+0000","last_peered":"2024-09-12T22:13:24.781038+0000","last_clean":"2024-09-12T22:13:24.781038+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:24.781038+0000","last_undegraded":"2024-09-12T22:13:24.781038+0000","last_fullsized":"2024-09-12T22:13:24.781038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:37.363135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":308,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782691+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:24.782691+0000","last_peered":"2024-09-12T22:13:24.782691+0000","last_clean":"2024-09-12T22:13:24.782691+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:24.782691+0000","last_undegraded":"2024-09-12T22:13:24.782691+0000","last_fullsized":"2024-09-12T22:13:24.782691+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.871537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782391+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:24.782391+0000","last_peered":"2024-09-12T22:13:24.782391+0000","last_clean":"2024-09-12T22:13:24.782391+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:24.782391+0000","last_undegraded":"2024-09-12T22:13:24.782391+0000","last_fullsized":"2024-09-12T22:13:24.782391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:36.777583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"58'58","reported_seq":211,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781130+0000","last_change":"2024-09-12T22:13:07.766192+0000","last_active":"2024-09-12T22:13:24.781130+0000","last_peered":"2024-09-12T22:13:24.781130+0000","last_clean":"2024-09-12T22:13:24.781130+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:24.781130+0000","last_undegraded":"2024-09-12T22:13:24.781130+0000","last_fullsized":"2024-09-12T22:13:24.781130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:12.617670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":650,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781368+0000","last_change":"2024-09-12T22:09:50.965458+0000","last_active":"2024-09-12T22:13:24.781368+0000","last_peered":"2024-09-12T22:13:24.781368+0000","last_clean":"2024-09-12T22:13:24.781368+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:24.781368+0000","last_undegraded":"2024-09-12T22:13:24.781368+0000","last_fullsized":"2024-09-12T22:13:24.781368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:14.890798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"58'111","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781216+0000","last_change":"2024-09-12T22:09:49.952352+0000","last_active":"2024-09-12T22:13:24.781216+0000","last_peered":"2024-09-12T22:13:24.781216+0000","last_clean":"2024-09-12T22:13:24.781216+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:24.781216+0000","last_undegraded":"2024-09-12T22:13:24.781216+0000","last_fullsized":"2024-09-12T22:13:24.781216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:26.532919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6275,"ondisk_log_size":6275,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906951,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76828,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295012,"statfs":{"total":96636764160,"available":96558092288,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114660,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257180,"statfs":{"total":96636764160,"available":96519352320,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118496,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253344,"statfs":{"total":96636764160,"available":96515424256,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:33.687 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.687 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.688 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.689 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.690 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.691 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.692 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.693 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T22:09:39.784615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.694 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.695 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.696 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.697 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.698 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.699 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.699 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.699 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.699 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.699 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:33.699 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:13:53.700 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:13:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:13:54.019 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:13:54.024 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-12T22:13:53.133492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33090,"ondisk_log_size":33090,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309960,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805560,"statfs":{"total":289910292480,"available":289592893440,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003148"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":578,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783432+0000","last_change":"2024-09-12T22:13:23.781184+0000","last_active":"2024-09-12T22:13:24.783432+0000","last_peered":"2024-09-12T22:13:24.783432+0000","last_clean":"2024-09-12T22:13:24.783432+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:13:24.783432+0000","last_undegraded":"2024-09-12T22:13:24.783432+0000","last_fullsized":"2024-09-12T22:13:24.783432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":539,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.176819+0000","last_change":"2024-09-12T22:13:40.176860+0000","last_active":"2024-09-12T22:13:40.176819+0000","last_peered":"2024-09-12T22:13:40.176819+0000","last_clean":"2024-09-12T22:13:40.176819+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:40.176819+0000","last_undegraded":"2024-09-12T22:13:40.176819+0000","last_fullsized":"2024-09-12T22:13:40.176819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'392","last_scrub_stamp":"2024-09-12T22:13:40.176721+0000","last_deep_scrub":"58'392","last_deep_scrub_stamp":"2024-09-12T22:13:40.176721+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.176721+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:24.434920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":867,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781608+0000","last_change":"2024-09-12T22:13:19.784305+0000","last_active":"2024-09-12T22:13:24.781608+0000","last_peered":"2024-09-12T22:13:24.781608+0000","last_clean":"2024-09-12T22:13:24.781608+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:13:24.781608+0000","last_undegraded":"2024-09-12T22:13:24.781608+0000","last_fullsized":"2024-09-12T22:13:24.781608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":608,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.883945+0000","last_change":"2024-09-12T22:13:37.883972+0000","last_active":"2024-09-12T22:13:37.883945+0000","last_peered":"2024-09-12T22:13:37.883945+0000","last_clean":"2024-09-12T22:13:37.883945+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:37.883945+0000","last_undegraded":"2024-09-12T22:13:37.883945+0000","last_fullsized":"2024-09-12T22:13:37.883945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'417","last_scrub_stamp":"2024-09-12T22:13:37.883848+0000","last_deep_scrub":"58'417","last_deep_scrub_stamp":"2024-09-12T22:13:37.883848+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.883848+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:33.029505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":632,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.129647+0000","last_change":"2024-09-12T22:13:37.129694+0000","last_active":"2024-09-12T22:13:37.129647+0000","last_peered":"2024-09-12T22:13:37.129647+0000","last_clean":"2024-09-12T22:13:37.129647+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:37.129647+0000","last_undegraded":"2024-09-12T22:13:37.129647+0000","last_fullsized":"2024-09-12T22:13:37.129647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'466","last_scrub_stamp":"2024-09-12T22:13:37.129556+0000","last_deep_scrub":"58'466","last_deep_scrub_stamp":"2024-09-12T22:13:37.129556+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.129556+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:21:13.730450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":605,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.910215+0000","last_change":"2024-09-12T22:13:40.910269+0000","last_active":"2024-09-12T22:13:40.910215+0000","last_peered":"2024-09-12T22:13:40.910215+0000","last_clean":"2024-09-12T22:13:40.910215+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:40.910215+0000","last_undegraded":"2024-09-12T22:13:40.910215+0000","last_fullsized":"2024-09-12T22:13:40.910215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:40.910100+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:40.910100+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.910100+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:50.448625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":687,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781046+0000","last_change":"2024-09-12T22:09:50.961521+0000","last_active":"2024-09-12T22:13:24.781046+0000","last_peered":"2024-09-12T22:13:24.781046+0000","last_clean":"2024-09-12T22:13:24.781046+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:13:24.781046+0000","last_undegraded":"2024-09-12T22:13:24.781046+0000","last_fullsized":"2024-09-12T22:13:24.781046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:39.888993+0000","last_change":"2024-09-12T22:13:39.889019+0000","last_active":"2024-09-12T22:13:39.888993+0000","last_peered":"2024-09-12T22:13:39.888993+0000","last_clean":"2024-09-12T22:13:39.888993+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:39.888993+0000","last_undegraded":"2024-09-12T22:13:39.888993+0000","last_fullsized":"2024-09-12T22:13:39.888993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'391","last_scrub_stamp":"2024-09-12T22:13:39.888903+0000","last_deep_scrub":"58'391","last_deep_scrub_stamp":"2024-09-12T22:13:39.888903+0000","last_clean_scrub_stamp":"2024-09-12T22:13:39.888903+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:13.545009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":983,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780893+0000","last_change":"2024-09-12T22:13:19.790350+0000","last_active":"2024-09-12T22:13:24.780893+0000","last_peered":"2024-09-12T22:13:24.780893+0000","last_clean":"2024-09-12T22:13:24.780893+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:24.780893+0000","last_undegraded":"2024-09-12T22:13:24.780893+0000","last_fullsized":"2024-09-12T22:13:24.780893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":535,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:50.102416+0000","last_change":"2024-09-12T22:13:50.102445+0000","last_active":"2024-09-12T22:13:50.102416+0000","last_peered":"2024-09-12T22:13:50.102416+0000","last_clean":"2024-09-12T22:13:50.102416+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:50.102416+0000","last_undegraded":"2024-09-12T22:13:50.102416+0000","last_fullsized":"2024-09-12T22:13:50.102416+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'390","last_scrub_stamp":"2024-09-12T22:13:50.102311+0000","last_deep_scrub":"58'390","last_deep_scrub_stamp":"2024-09-12T22:13:50.102311+0000","last_clean_scrub_stamp":"2024-09-12T22:13:50.102311+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:49.935921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":550,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781646+0000","last_change":"2024-09-12T22:09:50.963435+0000","last_active":"2024-09-12T22:13:24.781646+0000","last_peered":"2024-09-12T22:13:24.781646+0000","last_clean":"2024-09-12T22:13:24.781646+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:24.781646+0000","last_undegraded":"2024-09-12T22:13:24.781646+0000","last_fullsized":"2024-09-12T22:13:24.781646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":494,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.103406+0000","last_change":"2024-09-12T22:13:36.103433+0000","last_active":"2024-09-12T22:13:36.103406+0000","last_peered":"2024-09-12T22:13:36.103406+0000","last_clean":"2024-09-12T22:13:36.103406+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:36.103406+0000","last_undegraded":"2024-09-12T22:13:36.103406+0000","last_fullsized":"2024-09-12T22:13:36.103406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'366","last_scrub_stamp":"2024-09-12T22:13:36.103319+0000","last_deep_scrub":"58'366","last_deep_scrub_stamp":"2024-09-12T22:13:36.103319+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.103319+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:12.617873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":576,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783240+0000","last_change":"2024-09-12T22:13:14.782069+0000","last_active":"2024-09-12T22:13:24.783240+0000","last_peered":"2024-09-12T22:13:24.783240+0000","last_clean":"2024-09-12T22:13:24.783240+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:13:24.783240+0000","last_undegraded":"2024-09-12T22:13:24.783240+0000","last_fullsized":"2024-09-12T22:13:24.783240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":941,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781039+0000","last_change":"2024-09-12T22:13:22.786917+0000","last_active":"2024-09-12T22:13:24.781039+0000","last_peered":"2024-09-12T22:13:24.781039+0000","last_clean":"2024-09-12T22:13:24.781039+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:13:24.781039+0000","last_undegraded":"2024-09-12T22:13:24.781039+0000","last_fullsized":"2024-09-12T22:13:24.781039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1048,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.799637+0000","last_change":"2024-09-12T22:13:34.799663+0000","last_active":"2024-09-12T22:13:34.799637+0000","last_peered":"2024-09-12T22:13:34.799637+0000","last_clean":"2024-09-12T22:13:34.799637+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:34.799637+0000","last_undegraded":"2024-09-12T22:13:34.799637+0000","last_fullsized":"2024-09-12T22:13:34.799637+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'437","last_scrub_stamp":"2024-09-12T22:13:34.799532+0000","last_deep_scrub":"58'437","last_deep_scrub_stamp":"2024-09-12T22:13:34.799532+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.799532+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:12.788366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":633,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.950391+0000","last_change":"2024-09-12T22:13:44.950422+0000","last_active":"2024-09-12T22:13:44.950391+0000","last_peered":"2024-09-12T22:13:44.950391+0000","last_clean":"2024-09-12T22:13:44.950391+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:44.950391+0000","last_undegraded":"2024-09-12T22:13:44.950391+0000","last_fullsized":"2024-09-12T22:13:44.950391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'438","last_scrub_stamp":"2024-09-12T22:13:44.950299+0000","last_deep_scrub":"58'438","last_deep_scrub_stamp":"2024-09-12T22:13:44.950299+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.950299+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:03.773639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":940,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781339+0000","last_change":"2024-09-12T22:13:21.784553+0000","last_active":"2024-09-12T22:13:24.781339+0000","last_peered":"2024-09-12T22:13:24.781339+0000","last_clean":"2024-09-12T22:13:24.781339+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:13:24.781339+0000","last_undegraded":"2024-09-12T22:13:24.781339+0000","last_fullsized":"2024-09-12T22:13:24.781339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":534,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783278+0000","last_change":"2024-09-12T22:13:18.785465+0000","last_active":"2024-09-12T22:13:24.783278+0000","last_peered":"2024-09-12T22:13:24.783278+0000","last_clean":"2024-09-12T22:13:24.783278+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:13:24.783278+0000","last_undegraded":"2024-09-12T22:13:24.783278+0000","last_fullsized":"2024-09-12T22:13:24.783278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":977,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780809+0000","last_change":"2024-09-12T22:13:16.789760+0000","last_active":"2024-09-12T22:13:24.780809+0000","last_peered":"2024-09-12T22:13:24.780809+0000","last_clean":"2024-09-12T22:13:24.780809+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:24.780809+0000","last_undegraded":"2024-09-12T22:13:24.780809+0000","last_fullsized":"2024-09-12T22:13:24.780809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":626,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.961819+0000","last_change":"2024-09-12T22:13:46.961847+0000","last_active":"2024-09-12T22:13:46.961819+0000","last_peered":"2024-09-12T22:13:46.961819+0000","last_clean":"2024-09-12T22:13:46.961819+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:46.961819+0000","last_undegraded":"2024-09-12T22:13:46.961819+0000","last_fullsized":"2024-09-12T22:13:46.961819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'442","last_scrub_stamp":"2024-09-12T22:13:46.961715+0000","last_deep_scrub":"58'442","last_deep_scrub_stamp":"2024-09-12T22:13:46.961715+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.961715+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.371724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":678,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.909178+0000","last_change":"2024-09-12T22:13:38.909206+0000","last_active":"2024-09-12T22:13:38.909178+0000","last_peered":"2024-09-12T22:13:38.909178+0000","last_clean":"2024-09-12T22:13:38.909178+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:38.909178+0000","last_undegraded":"2024-09-12T22:13:38.909178+0000","last_fullsized":"2024-09-12T22:13:38.909178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'440","last_scrub_stamp":"2024-09-12T22:13:38.909089+0000","last_deep_scrub":"58'440","last_deep_scrub_stamp":"2024-09-12T22:13:38.909089+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.909089+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:55.274195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":612,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.101346+0000","last_change":"2024-09-12T22:13:35.101372+0000","last_active":"2024-09-12T22:13:35.101346+0000","last_peered":"2024-09-12T22:13:35.101346+0000","last_clean":"2024-09-12T22:13:35.101346+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:35.101346+0000","last_undegraded":"2024-09-12T22:13:35.101346+0000","last_fullsized":"2024-09-12T22:13:35.101346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'443","last_scrub_stamp":"2024-09-12T22:13:35.101256+0000","last_deep_scrub":"58'443","last_deep_scrub_stamp":"2024-09-12T22:13:35.101256+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.101256+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:14.463127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":667,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.989810+0000","last_change":"2024-09-12T22:13:44.989836+0000","last_active":"2024-09-12T22:13:44.989810+0000","last_peered":"2024-09-12T22:13:44.989810+0000","last_clean":"2024-09-12T22:13:44.989810+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:44.989810+0000","last_undegraded":"2024-09-12T22:13:44.989810+0000","last_fullsized":"2024-09-12T22:13:44.989810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'442","last_scrub_stamp":"2024-09-12T22:13:44.989717+0000","last_deep_scrub":"58'442","last_deep_scrub_stamp":"2024-09-12T22:13:44.989717+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.989717+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:44.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":567,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782851+0000","last_change":"2024-09-12T22:13:21.785416+0000","last_active":"2024-09-12T22:13:24.782851+0000","last_peered":"2024-09-12T22:13:24.782851+0000","last_clean":"2024-09-12T22:13:24.782851+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:13:24.782851+0000","last_undegraded":"2024-09-12T22:13:24.782851+0000","last_fullsized":"2024-09-12T22:13:24.782851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.104721+0000","last_change":"2024-09-12T22:13:38.104758+0000","last_active":"2024-09-12T22:13:38.104721+0000","last_peered":"2024-09-12T22:13:38.104721+0000","last_clean":"2024-09-12T22:13:38.104721+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:38.104721+0000","last_undegraded":"2024-09-12T22:13:38.104721+0000","last_fullsized":"2024-09-12T22:13:38.104721+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'399","last_scrub_stamp":"2024-09-12T22:13:38.104628+0000","last_deep_scrub":"58'399","last_deep_scrub_stamp":"2024-09-12T22:13:38.104628+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.104628+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.552622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":668,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.054157+0000","last_change":"2024-09-12T22:13:47.054181+0000","last_active":"2024-09-12T22:13:47.054157+0000","last_peered":"2024-09-12T22:13:47.054157+0000","last_clean":"2024-09-12T22:13:47.054157+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:47.054157+0000","last_undegraded":"2024-09-12T22:13:47.054157+0000","last_fullsized":"2024-09-12T22:13:47.054157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'479","last_scrub_stamp":"2024-09-12T22:13:47.054068+0000","last_deep_scrub":"58'479","last_deep_scrub_stamp":"2024-09-12T22:13:47.054068+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.054068+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:14.956452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":871,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781751+0000","last_change":"2024-09-12T22:13:20.792069+0000","last_active":"2024-09-12T22:13:24.781751+0000","last_peered":"2024-09-12T22:13:24.781751+0000","last_clean":"2024-09-12T22:13:24.781751+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:13:24.781751+0000","last_undegraded":"2024-09-12T22:13:24.781751+0000","last_fullsized":"2024-09-12T22:13:24.781751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":554,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.156757+0000","last_change":"2024-09-12T22:13:42.156782+0000","last_active":"2024-09-12T22:13:42.156757+0000","last_peered":"2024-09-12T22:13:42.156757+0000","last_clean":"2024-09-12T22:13:42.156757+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:42.156757+0000","last_undegraded":"2024-09-12T22:13:42.156757+0000","last_fullsized":"2024-09-12T22:13:42.156757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:42.156667+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:42.156667+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.156667+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:35.039529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":980,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780882+0000","last_change":"2024-09-12T22:13:17.797065+0000","last_active":"2024-09-12T22:13:24.780882+0000","last_peered":"2024-09-12T22:13:24.780882+0000","last_clean":"2024-09-12T22:13:24.780882+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:24.780882+0000","last_undegraded":"2024-09-12T22:13:24.780882+0000","last_fullsized":"2024-09-12T22:13:24.780882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":636,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782614+0000","last_change":"2024-09-12T22:13:17.798051+0000","last_active":"2024-09-12T22:13:24.782614+0000","last_peered":"2024-09-12T22:13:24.782614+0000","last_clean":"2024-09-12T22:13:24.782614+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:13:24.782614+0000","last_undegraded":"2024-09-12T22:13:24.782614+0000","last_fullsized":"2024-09-12T22:13:24.782614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":943,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.007068+0000","last_change":"2024-09-12T22:13:46.007095+0000","last_active":"2024-09-12T22:13:46.007068+0000","last_peered":"2024-09-12T22:13:46.007068+0000","last_clean":"2024-09-12T22:13:46.007068+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:46.007068+0000","last_undegraded":"2024-09-12T22:13:46.007068+0000","last_fullsized":"2024-09-12T22:13:46.007068+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'401","last_scrub_stamp":"2024-09-12T22:13:46.006977+0000","last_deep_scrub":"58'401","last_deep_scrub_stamp":"2024-09-12T22:13:46.006977+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.006977+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:20:56.543008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1003,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.785559+0000","last_change":"2024-09-12T22:13:24.785126+0000","last_active":"2024-09-12T22:13:24.785559+0000","last_peered":"2024-09-12T22:13:24.785559+0000","last_clean":"2024-09-12T22:13:24.785559+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:13:24.785559+0000","last_undegraded":"2024-09-12T22:13:24.785559+0000","last_fullsized":"2024-09-12T22:13:24.785559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":569,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.105590+0000","last_change":"2024-09-12T22:13:44.105628+0000","last_active":"2024-09-12T22:13:44.105590+0000","last_peered":"2024-09-12T22:13:44.105590+0000","last_clean":"2024-09-12T22:13:44.105590+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:44.105590+0000","last_undegraded":"2024-09-12T22:13:44.105590+0000","last_fullsized":"2024-09-12T22:13:44.105590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'407","last_scrub_stamp":"2024-09-12T22:13:44.105503+0000","last_deep_scrub":"58'407","last_deep_scrub_stamp":"2024-09-12T22:13:44.105503+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.105503+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:57.987490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"58'311","reported_seq":453,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781565+0000","last_change":"2024-09-12T22:09:49.951607+0000","last_active":"2024-09-12T22:13:24.781565+0000","last_peered":"2024-09-12T22:13:24.781565+0000","last_clean":"2024-09-12T22:13:24.781565+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:24.781565+0000","last_undegraded":"2024-09-12T22:13:24.781565+0000","last_fullsized":"2024-09-12T22:13:24.781565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":570,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.144324+0000","last_change":"2024-09-12T22:13:34.144346+0000","last_active":"2024-09-12T22:13:34.144324+0000","last_peered":"2024-09-12T22:13:34.144324+0000","last_clean":"2024-09-12T22:13:34.144324+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:34.144324+0000","last_undegraded":"2024-09-12T22:13:34.144324+0000","last_fullsized":"2024-09-12T22:13:34.144324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'418","last_scrub_stamp":"2024-09-12T22:13:34.144214+0000","last_deep_scrub":"58'418","last_deep_scrub_stamp":"2024-09-12T22:13:34.144214+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.144214+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:50.343272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780462+0000","last_change":"2024-09-12T22:09:49.953331+0000","last_active":"2024-09-12T22:13:24.780462+0000","last_peered":"2024-09-12T22:13:24.780462+0000","last_clean":"2024-09-12T22:13:24.780462+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:24.780462+0000","last_undegraded":"2024-09-12T22:13:24.780462+0000","last_fullsized":"2024-09-12T22:13:24.780462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":580,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.962974+0000","last_change":"2024-09-12T22:13:38.962999+0000","last_active":"2024-09-12T22:13:38.962974+0000","last_peered":"2024-09-12T22:13:38.962974+0000","last_clean":"2024-09-12T22:13:38.962974+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:38.962974+0000","last_undegraded":"2024-09-12T22:13:38.962974+0000","last_fullsized":"2024-09-12T22:13:38.962974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'422","last_scrub_stamp":"2024-09-12T22:13:38.962883+0000","last_deep_scrub":"58'422","last_deep_scrub_stamp":"2024-09-12T22:13:38.962883+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.962883+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:32.625470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782495+0000","last_change":"2024-09-12T22:13:07.745579+0000","last_active":"2024-09-12T22:13:24.782495+0000","last_peered":"2024-09-12T22:13:24.782495+0000","last_clean":"2024-09-12T22:13:24.782495+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:24.782495+0000","last_undegraded":"2024-09-12T22:13:24.782495+0000","last_fullsized":"2024-09-12T22:13:24.782495+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":572,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780974+0000","last_change":"2024-09-12T22:09:50.961301+0000","last_active":"2024-09-12T22:13:24.780974+0000","last_peered":"2024-09-12T22:13:24.780974+0000","last_clean":"2024-09-12T22:13:24.780974+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:24.780974+0000","last_undegraded":"2024-09-12T22:13:24.780974+0000","last_fullsized":"2024-09-12T22:13:24.780974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"82'74","reported_seq":232,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:45.957216+0000","last_change":"2024-09-12T22:13:45.957271+0000","last_active":"2024-09-12T22:13:45.957216+0000","last_peered":"2024-09-12T22:13:45.957216+0000","last_clean":"2024-09-12T22:13:45.957216+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:45.957216+0000","last_undegraded":"2024-09-12T22:13:45.957216+0000","last_fullsized":"2024-09-12T22:13:45.957216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'74","last_scrub_stamp":"2024-09-12T22:13:45.957125+0000","last_deep_scrub":"82'74","last_deep_scrub_stamp":"2024-09-12T22:13:45.957125+0000","last_clean_scrub_stamp":"2024-09-12T22:13:45.957125+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:01.987729+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'156","reported_seq":312,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781891+0000","last_change":"2024-09-12T22:13:10.750262+0000","last_active":"2024-09-12T22:13:24.781891+0000","last_peered":"2024-09-12T22:13:24.781891+0000","last_clean":"2024-09-12T22:13:24.781891+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:24.781891+0000","last_undegraded":"2024-09-12T22:13:24.781891+0000","last_fullsized":"2024-09-12T22:13:24.781891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":531,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783193+0000","last_change":"2024-09-12T22:13:18.783644+0000","last_active":"2024-09-12T22:13:24.783193+0000","last_peered":"2024-09-12T22:13:24.783193+0000","last_clean":"2024-09-12T22:13:24.783193+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:13:24.783193+0000","last_undegraded":"2024-09-12T22:13:24.783193+0000","last_fullsized":"2024-09-12T22:13:24.783193+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"82'219","reported_seq":349,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.108065+0000","last_change":"2024-09-12T22:13:47.108094+0000","last_active":"2024-09-12T22:13:47.108065+0000","last_peered":"2024-09-12T22:13:47.108065+0000","last_clean":"2024-09-12T22:13:47.108065+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:47.108065+0000","last_undegraded":"2024-09-12T22:13:47.108065+0000","last_fullsized":"2024-09-12T22:13:47.108065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'219","last_scrub_stamp":"2024-09-12T22:13:47.107987+0000","last_deep_scrub":"82'219","last_deep_scrub_stamp":"2024-09-12T22:13:47.107987+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.107987+0000","objects_scrubbed":2,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:21.893622+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":554,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.791140+0000","last_change":"2024-09-12T22:13:24.787848+0000","last_active":"2024-09-12T22:13:24.791140+0000","last_peered":"2024-09-12T22:13:24.791140+0000","last_clean":"2024-09-12T22:13:24.791140+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:13:24.791140+0000","last_undegraded":"2024-09-12T22:13:24.791140+0000","last_fullsized":"2024-09-12T22:13:24.791140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'474","reported_seq":638,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.865474+0000","last_change":"2024-09-12T22:13:36.865505+0000","last_active":"2024-09-12T22:13:36.865474+0000","last_peered":"2024-09-12T22:13:36.865474+0000","last_clean":"2024-09-12T22:13:36.865474+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:36.865474+0000","last_undegraded":"2024-09-12T22:13:36.865474+0000","last_fullsized":"2024-09-12T22:13:36.865474+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'474","last_scrub_stamp":"2024-09-12T22:13:36.865383+0000","last_deep_scrub":"82'474","last_deep_scrub_stamp":"2024-09-12T22:13:36.865383+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.865383+0000","objects_scrubbed":2,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.405625+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":594,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781263+0000","last_change":"2024-09-12T22:09:50.959411+0000","last_active":"2024-09-12T22:13:24.781263+0000","last_peered":"2024-09-12T22:13:24.781263+0000","last_clean":"2024-09-12T22:13:24.781263+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:24.781263+0000","last_undegraded":"2024-09-12T22:13:24.781263+0000","last_fullsized":"2024-09-12T22:13:24.781263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781562+0000","last_change":"2024-09-12T22:09:49.949762+0000","last_active":"2024-09-12T22:13:24.781562+0000","last_peered":"2024-09-12T22:13:24.781562+0000","last_clean":"2024-09-12T22:13:24.781562+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:24.781562+0000","last_undegraded":"2024-09-12T22:13:24.781562+0000","last_fullsized":"2024-09-12T22:13:24.781562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":609,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780677+0000","last_change":"2024-09-12T22:09:50.961381+0000","last_active":"2024-09-12T22:13:24.780677+0000","last_peered":"2024-09-12T22:13:24.780677+0000","last_clean":"2024-09-12T22:13:24.780677+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:24.780677+0000","last_undegraded":"2024-09-12T22:13:24.780677+0000","last_fullsized":"2024-09-12T22:13:24.780677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"58'171","reported_seq":313,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781104+0000","last_change":"2024-09-12T22:09:49.953345+0000","last_active":"2024-09-12T22:13:24.781104+0000","last_peered":"2024-09-12T22:13:24.781104+0000","last_clean":"2024-09-12T22:13:24.781104+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:24.781104+0000","last_undegraded":"2024-09-12T22:13:24.781104+0000","last_fullsized":"2024-09-12T22:13:24.781104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":678,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.891606+0000","last_change":"2024-09-12T22:13:42.891634+0000","last_active":"2024-09-12T22:13:42.891606+0000","last_peered":"2024-09-12T22:13:42.891606+0000","last_clean":"2024-09-12T22:13:42.891606+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:42.891606+0000","last_undegraded":"2024-09-12T22:13:42.891606+0000","last_fullsized":"2024-09-12T22:13:42.891606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'476","last_scrub_stamp":"2024-09-12T22:13:42.891514+0000","last_deep_scrub":"58'476","last_deep_scrub_stamp":"2024-09-12T22:13:42.891514+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.891514+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:15.358329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"58'109","reported_seq":222,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782366+0000","last_change":"2024-09-12T22:13:10.749450+0000","last_active":"2024-09-12T22:13:24.782366+0000","last_peered":"2024-09-12T22:13:24.782366+0000","last_clean":"2024-09-12T22:13:24.782366+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:24.782366+0000","last_undegraded":"2024-09-12T22:13:24.782366+0000","last_fullsized":"2024-09-12T22:13:24.782366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":897,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781880+0000","last_change":"2024-09-12T22:13:21.784728+0000","last_active":"2024-09-12T22:13:24.781880+0000","last_peered":"2024-09-12T22:13:24.781880+0000","last_clean":"2024-09-12T22:13:24.781880+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:13:24.781880+0000","last_undegraded":"2024-09-12T22:13:24.781880+0000","last_fullsized":"2024-09-12T22:13:24.781880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782142+0000","last_change":"2024-09-12T22:13:07.744843+0000","last_active":"2024-09-12T22:13:24.782142+0000","last_peered":"2024-09-12T22:13:24.782142+0000","last_clean":"2024-09-12T22:13:24.782142+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:24.782142+0000","last_undegraded":"2024-09-12T22:13:24.782142+0000","last_fullsized":"2024-09-12T22:13:24.782142+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":850,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:33.805839+0000","last_change":"2024-09-12T22:13:33.805892+0000","last_active":"2024-09-12T22:13:33.805839+0000","last_peered":"2024-09-12T22:13:33.805839+0000","last_clean":"2024-09-12T22:13:33.805839+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:33.805839+0000","last_undegraded":"2024-09-12T22:13:33.805839+0000","last_fullsized":"2024-09-12T22:13:33.805839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'358","last_scrub_stamp":"2024-09-12T22:13:33.805719+0000","last_deep_scrub":"58'358","last_deep_scrub_stamp":"2024-09-12T22:13:33.805719+0000","last_clean_scrub_stamp":"2024-09-12T22:13:33.805719+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:53.477722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"58'492","reported_seq":605,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783040+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.783040+0000","last_peered":"2024-09-12T22:13:24.783040+0000","last_clean":"2024-09-12T22:13:24.783040+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:24.783040+0000","last_undegraded":"2024-09-12T22:13:24.783040+0000","last_fullsized":"2024-09-12T22:13:24.783040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":977,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781140+0000","last_change":"2024-09-12T22:13:19.790379+0000","last_active":"2024-09-12T22:13:24.781140+0000","last_peered":"2024-09-12T22:13:24.781140+0000","last_clean":"2024-09-12T22:13:24.781140+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:13:24.781140+0000","last_undegraded":"2024-09-12T22:13:24.781140+0000","last_fullsized":"2024-09-12T22:13:24.781140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":370,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.928350+0000","last_change":"2024-09-12T22:13:43.928350+0000","last_active":"2024-09-12T22:13:43.928350+0000","last_peered":"2024-09-12T22:13:43.928350+0000","last_clean":"2024-09-12T22:13:43.928350+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:43.928350+0000","last_undegraded":"2024-09-12T22:13:43.928350+0000","last_fullsized":"2024-09-12T22:13:43.928350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-09-12T22:13:43.928152+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-09-12T22:13:43.928152+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.928152+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:04.652918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781625+0000","last_change":"2024-09-12T22:09:47.822047+0000","last_active":"2024-09-12T22:13:24.781625+0000","last_peered":"2024-09-12T22:13:24.781625+0000","last_clean":"2024-09-12T22:13:24.781625+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:24.781625+0000","last_undegraded":"2024-09-12T22:13:24.781625+0000","last_fullsized":"2024-09-12T22:13:24.781625+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"82'610","reported_seq":775,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.977064+0000","last_change":"2024-09-12T22:13:41.977122+0000","last_active":"2024-09-12T22:13:41.977064+0000","last_peered":"2024-09-12T22:13:41.977064+0000","last_clean":"2024-09-12T22:13:41.977064+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:41.977064+0000","last_undegraded":"2024-09-12T22:13:41.977064+0000","last_fullsized":"2024-09-12T22:13:41.977064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'610","last_scrub_stamp":"2024-09-12T22:13:41.976949+0000","last_deep_scrub":"82'610","last_deep_scrub_stamp":"2024-09-12T22:13:41.976949+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.976949+0000","objects_scrubbed":2,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:53.900021+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":993,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781934+0000","last_change":"2024-09-12T22:13:23.837820+0000","last_active":"2024-09-12T22:13:24.781934+0000","last_peered":"2024-09-12T22:13:24.781934+0000","last_clean":"2024-09-12T22:13:24.781934+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:13:24.781934+0000","last_undegraded":"2024-09-12T22:13:24.781934+0000","last_fullsized":"2024-09-12T22:13:24.781934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.867859+0000","last_change":"2024-09-12T22:13:41.867859+0000","last_active":"2024-09-12T22:13:41.867859+0000","last_peered":"2024-09-12T22:13:41.867859+0000","last_clean":"2024-09-12T22:13:41.867859+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:41.867859+0000","last_undegraded":"2024-09-12T22:13:41.867859+0000","last_fullsized":"2024-09-12T22:13:41.867859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:41.867742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:41.867742+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.867742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:09.876272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"58'111","reported_seq":299,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780722+0000","last_change":"2024-09-12T22:09:49.952842+0000","last_active":"2024-09-12T22:13:24.780722+0000","last_peered":"2024-09-12T22:13:24.780722+0000","last_clean":"2024-09-12T22:13:24.780722+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:24.780722+0000","last_undegraded":"2024-09-12T22:13:24.780722+0000","last_fullsized":"2024-09-12T22:13:24.780722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":622,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.133393+0000","last_change":"2024-09-12T22:13:48.133442+0000","last_active":"2024-09-12T22:13:48.133393+0000","last_peered":"2024-09-12T22:13:48.133393+0000","last_clean":"2024-09-12T22:13:48.133393+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:48.133393+0000","last_undegraded":"2024-09-12T22:13:48.133393+0000","last_fullsized":"2024-09-12T22:13:48.133393+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'449","last_scrub_stamp":"2024-09-12T22:13:48.133281+0000","last_deep_scrub":"58'449","last_deep_scrub_stamp":"2024-09-12T22:13:48.133281+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.133281+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:39.397507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.034469+0000","last_change":"2024-09-12T22:13:34.034493+0000","last_active":"2024-09-12T22:13:34.034469+0000","last_peered":"2024-09-12T22:13:34.034469+0000","last_clean":"2024-09-12T22:13:34.034469+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:34.034469+0000","last_undegraded":"2024-09-12T22:13:34.034469+0000","last_fullsized":"2024-09-12T22:13:34.034469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:34.034386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:34.034386+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.034386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:45.571644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"82'399","reported_seq":520,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:49.107447+0000","last_change":"2024-09-12T22:13:49.107496+0000","last_active":"2024-09-12T22:13:49.107447+0000","last_peered":"2024-09-12T22:13:49.107447+0000","last_clean":"2024-09-12T22:13:49.107447+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:49.107447+0000","last_undegraded":"2024-09-12T22:13:49.107447+0000","last_fullsized":"2024-09-12T22:13:49.107447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'399","last_scrub_stamp":"2024-09-12T22:13:49.107347+0000","last_deep_scrub":"82'399","last_deep_scrub_stamp":"2024-09-12T22:13:49.107347+0000","last_clean_scrub_stamp":"2024-09-12T22:13:49.107347+0000","objects_scrubbed":2,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:19.733424+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":825,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781142+0000","last_change":"2024-09-12T22:13:20.791931+0000","last_active":"2024-09-12T22:13:24.781142+0000","last_peered":"2024-09-12T22:13:24.781142+0000","last_clean":"2024-09-12T22:13:24.781142+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:13:24.781142+0000","last_undegraded":"2024-09-12T22:13:24.781142+0000","last_fullsized":"2024-09-12T22:13:24.781142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":157,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781362+0000","last_change":"2024-09-12T22:09:47.821940+0000","last_active":"2024-09-12T22:13:24.781362+0000","last_peered":"2024-09-12T22:13:24.781362+0000","last_clean":"2024-09-12T22:13:24.781362+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:24.781362+0000","last_undegraded":"2024-09-12T22:13:24.781362+0000","last_fullsized":"2024-09-12T22:13:24.781362+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782630+0000","last_change":"2024-09-12T22:13:08.808768+0000","last_active":"2024-09-12T22:13:24.782630+0000","last_peered":"2024-09-12T22:13:24.782630+0000","last_clean":"2024-09-12T22:13:24.782630+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:24.782630+0000","last_undegraded":"2024-09-12T22:13:24.782630+0000","last_fullsized":"2024-09-12T22:13:24.782630+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":944,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.984965+0000","last_change":"2024-09-12T22:13:43.985011+0000","last_active":"2024-09-12T22:13:43.984965+0000","last_peered":"2024-09-12T22:13:43.984965+0000","last_clean":"2024-09-12T22:13:43.984965+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:43.984965+0000","last_undegraded":"2024-09-12T22:13:43.984965+0000","last_fullsized":"2024-09-12T22:13:43.984965+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'399","last_scrub_stamp":"2024-09-12T22:13:43.984840+0000","last_deep_scrub":"58'399","last_deep_scrub_stamp":"2024-09-12T22:13:43.984840+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.984840+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:20.525082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"58'282","reported_seq":424,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782072+0000","last_change":"2024-09-12T22:09:49.949455+0000","last_active":"2024-09-12T22:13:24.782072+0000","last_peered":"2024-09-12T22:13:24.782072+0000","last_clean":"2024-09-12T22:13:24.782072+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:24.782072+0000","last_undegraded":"2024-09-12T22:13:24.782072+0000","last_fullsized":"2024-09-12T22:13:24.782072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780889+0000","last_change":"2024-09-12T22:13:08.740914+0000","last_active":"2024-09-12T22:13:24.780889+0000","last_peered":"2024-09-12T22:13:24.780889+0000","last_clean":"2024-09-12T22:13:24.780889+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:24.780889+0000","last_undegraded":"2024-09-12T22:13:24.780889+0000","last_fullsized":"2024-09-12T22:13:24.780889+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":510,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:39.144935+0000","last_change":"2024-09-12T22:13:39.144962+0000","last_active":"2024-09-12T22:13:39.144935+0000","last_peered":"2024-09-12T22:13:39.144935+0000","last_clean":"2024-09-12T22:13:39.144935+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:39.144935+0000","last_undegraded":"2024-09-12T22:13:39.144935+0000","last_fullsized":"2024-09-12T22:13:39.144935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'372","last_scrub_stamp":"2024-09-12T22:13:39.144832+0000","last_deep_scrub":"58'372","last_deep_scrub_stamp":"2024-09-12T22:13:39.144832+0000","last_clean_scrub_stamp":"2024-09-12T22:13:39.144832+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:29.485332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":216,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.010701+0000","last_change":"2024-09-12T22:13:35.010725+0000","last_active":"2024-09-12T22:13:35.010701+0000","last_peered":"2024-09-12T22:13:35.010701+0000","last_clean":"2024-09-12T22:13:35.010701+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:35.010701+0000","last_undegraded":"2024-09-12T22:13:35.010701+0000","last_fullsized":"2024-09-12T22:13:35.010701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-09-12T22:13:35.010613+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-09-12T22:13:35.010613+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.010613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:52.144717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783209+0000","last_change":"2024-09-12T22:13:07.745586+0000","last_active":"2024-09-12T22:13:24.783209+0000","last_peered":"2024-09-12T22:13:24.783209+0000","last_clean":"2024-09-12T22:13:24.783209+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:24.783209+0000","last_undegraded":"2024-09-12T22:13:24.783209+0000","last_fullsized":"2024-09-12T22:13:24.783209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:44.795390+0000","last_clean_scrub_stamp":"2024-09-12T22:09:44.795390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.069891+0000","last_change":"2024-09-12T22:13:46.069920+0000","last_active":"2024-09-12T22:13:46.069891+0000","last_peered":"2024-09-12T22:13:46.069891+0000","last_clean":"2024-09-12T22:13:46.069891+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:46.069891+0000","last_undegraded":"2024-09-12T22:13:46.069891+0000","last_fullsized":"2024-09-12T22:13:46.069891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'406","last_scrub_stamp":"2024-09-12T22:13:46.069789+0000","last_deep_scrub":"58'406","last_deep_scrub_stamp":"2024-09-12T22:13:46.069789+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.069789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.437775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'66","reported_seq":224,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.025558+0000","last_change":"2024-09-12T22:13:36.025587+0000","last_active":"2024-09-12T22:13:36.025558+0000","last_peered":"2024-09-12T22:13:36.025558+0000","last_clean":"2024-09-12T22:13:36.025558+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:36.025558+0000","last_undegraded":"2024-09-12T22:13:36.025558+0000","last_fullsized":"2024-09-12T22:13:36.025558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'66","last_scrub_stamp":"2024-09-12T22:13:36.025461+0000","last_deep_scrub":"82'66","last_deep_scrub_stamp":"2024-09-12T22:13:36.025461+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.025461+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.455807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:33.005625+0000","last_change":"2024-09-12T22:13:33.005647+0000","last_active":"2024-09-12T22:13:33.005625+0000","last_peered":"2024-09-12T22:13:33.005625+0000","last_clean":"2024-09-12T22:13:33.005625+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:33.005625+0000","last_undegraded":"2024-09-12T22:13:33.005625+0000","last_fullsized":"2024-09-12T22:13:33.005625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:33.005510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:33.005510+0000","last_clean_scrub_stamp":"2024-09-12T22:13:33.005510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:48.395884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.979074+0000","last_change":"2024-09-12T22:13:36.979103+0000","last_active":"2024-09-12T22:13:36.979074+0000","last_peered":"2024-09-12T22:13:36.979074+0000","last_clean":"2024-09-12T22:13:36.979074+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:36.979074+0000","last_undegraded":"2024-09-12T22:13:36.979074+0000","last_fullsized":"2024-09-12T22:13:36.979074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'408","last_scrub_stamp":"2024-09-12T22:13:36.978977+0000","last_deep_scrub":"58'408","last_deep_scrub_stamp":"2024-09-12T22:13:36.978977+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.978977+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:06.536023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'108","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:45.070640+0000","last_change":"2024-09-12T22:13:45.070669+0000","last_active":"2024-09-12T22:13:45.070640+0000","last_peered":"2024-09-12T22:13:45.070640+0000","last_clean":"2024-09-12T22:13:45.070640+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:45.070640+0000","last_undegraded":"2024-09-12T22:13:45.070640+0000","last_fullsized":"2024-09-12T22:13:45.070640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'108","last_scrub_stamp":"2024-09-12T22:13:45.070538+0000","last_deep_scrub":"82'108","last_deep_scrub_stamp":"2024-09-12T22:13:45.070538+0000","last_clean_scrub_stamp":"2024-09-12T22:13:45.070538+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:00.212543+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.934622+0000","last_change":"2024-09-12T22:13:47.934647+0000","last_active":"2024-09-12T22:13:47.934622+0000","last_peered":"2024-09-12T22:13:47.934622+0000","last_clean":"2024-09-12T22:13:47.934622+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:47.934622+0000","last_undegraded":"2024-09-12T22:13:47.934622+0000","last_fullsized":"2024-09-12T22:13:47.934622+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:47.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:47.934524+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:15.934835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":683,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.141956+0000","last_change":"2024-09-12T22:13:43.141980+0000","last_active":"2024-09-12T22:13:43.141956+0000","last_peered":"2024-09-12T22:13:43.141956+0000","last_clean":"2024-09-12T22:13:43.141956+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:43.141956+0000","last_undegraded":"2024-09-12T22:13:43.141956+0000","last_fullsized":"2024-09-12T22:13:43.141956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'440","last_scrub_stamp":"2024-09-12T22:13:43.141854+0000","last_deep_scrub":"58'440","last_deep_scrub_stamp":"2024-09-12T22:13:43.141854+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.141854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:35.490113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":915,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.844457+0000","last_change":"2024-09-12T22:13:35.844505+0000","last_active":"2024-09-12T22:13:35.844457+0000","last_peered":"2024-09-12T22:13:35.844457+0000","last_clean":"2024-09-12T22:13:35.844457+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:35.844457+0000","last_undegraded":"2024-09-12T22:13:35.844457+0000","last_fullsized":"2024-09-12T22:13:35.844457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:35.844355+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:35.844355+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.844355+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:53.301642+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"58'283","reported_seq":443,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781515+0000","last_change":"2024-09-12T22:13:10.750510+0000","last_active":"2024-09-12T22:13:24.781515+0000","last_peered":"2024-09-12T22:13:24.781515+0000","last_clean":"2024-09-12T22:13:24.781515+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:13:24.781515+0000","last_undegraded":"2024-09-12T22:13:24.781515+0000","last_fullsized":"2024-09-12T22:13:24.781515+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1025,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780325+0000","last_change":"2024-09-12T22:13:13.767976+0000","last_active":"2024-09-12T22:13:24.780325+0000","last_peered":"2024-09-12T22:13:24.780325+0000","last_clean":"2024-09-12T22:13:24.780325+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:24.780325+0000","last_undegraded":"2024-09-12T22:13:24.780325+0000","last_fullsized":"2024-09-12T22:13:24.780325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"58'82","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783024+0000","last_change":"2024-09-12T22:13:07.749094+0000","last_active":"2024-09-12T22:13:24.783024+0000","last_peered":"2024-09-12T22:13:24.783024+0000","last_clean":"2024-09-12T22:13:24.783024+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:24.783024+0000","last_undegraded":"2024-09-12T22:13:24.783024+0000","last_fullsized":"2024-09-12T22:13:24.783024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'215","reported_seq":328,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782735+0000","last_change":"2024-09-12T22:13:10.749299+0000","last_active":"2024-09-12T22:13:24.782735+0000","last_peered":"2024-09-12T22:13:24.782735+0000","last_clean":"2024-09-12T22:13:24.782735+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:13:24.782735+0000","last_undegraded":"2024-09-12T22:13:24.782735+0000","last_fullsized":"2024-09-12T22:13:24.782735+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":697,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.972230+0000","last_change":"2024-09-12T22:13:42.972255+0000","last_active":"2024-09-12T22:13:42.972230+0000","last_peered":"2024-09-12T22:13:42.972230+0000","last_clean":"2024-09-12T22:13:42.972230+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:42.972230+0000","last_undegraded":"2024-09-12T22:13:42.972230+0000","last_fullsized":"2024-09-12T22:13:42.972230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'487","last_scrub_stamp":"2024-09-12T22:13:42.972138+0000","last_deep_scrub":"58'487","last_deep_scrub_stamp":"2024-09-12T22:13:42.972138+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.972138+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.418432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":193,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781297+0000","last_change":"2024-09-12T22:09:49.953078+0000","last_active":"2024-09-12T22:13:24.781297+0000","last_peered":"2024-09-12T22:13:24.781297+0000","last_clean":"2024-09-12T22:13:24.781297+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:24.781297+0000","last_undegraded":"2024-09-12T22:13:24.781297+0000","last_fullsized":"2024-09-12T22:13:24.781297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1021,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.780269+0000","last_change":"2024-09-12T22:13:22.785742+0000","last_active":"2024-09-12T22:13:24.780269+0000","last_peered":"2024-09-12T22:13:24.780269+0000","last_clean":"2024-09-12T22:13:24.780269+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:13:24.780269+0000","last_undegraded":"2024-09-12T22:13:24.780269+0000","last_fullsized":"2024-09-12T22:13:24.780269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":518,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.783210+0000","last_change":"2024-09-12T22:13:14.780774+0000","last_active":"2024-09-12T22:13:24.783210+0000","last_peered":"2024-09-12T22:13:24.783210+0000","last_clean":"2024-09-12T22:13:24.783210+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:24.783210+0000","last_undegraded":"2024-09-12T22:13:24.783210+0000","last_fullsized":"2024-09-12T22:13:24.783210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"82'768","reported_seq":933,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.027568+0000","last_change":"2024-09-12T22:13:40.027596+0000","last_active":"2024-09-12T22:13:40.027568+0000","last_peered":"2024-09-12T22:13:40.027568+0000","last_clean":"2024-09-12T22:13:40.027568+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:40.027568+0000","last_undegraded":"2024-09-12T22:13:40.027568+0000","last_fullsized":"2024-09-12T22:13:40.027568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'768","last_scrub_stamp":"2024-09-12T22:13:40.027467+0000","last_deep_scrub":"82'768","last_deep_scrub_stamp":"2024-09-12T22:13:40.027467+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.027467+0000","objects_scrubbed":2,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.189190+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":588,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.987394+0000","last_change":"2024-09-12T22:13:40.987436+0000","last_active":"2024-09-12T22:13:40.987394+0000","last_peered":"2024-09-12T22:13:40.987394+0000","last_clean":"2024-09-12T22:13:40.987394+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:40.987394+0000","last_undegraded":"2024-09-12T22:13:40.987394+0000","last_fullsized":"2024-09-12T22:13:40.987394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'414","last_scrub_stamp":"2024-09-12T22:13:40.987282+0000","last_deep_scrub":"58'414","last_deep_scrub_stamp":"2024-09-12T22:13:40.987282+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.987282+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:48.266861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"82'186","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.018245+0000","last_change":"2024-09-12T22:13:48.018272+0000","last_active":"2024-09-12T22:13:48.018245+0000","last_peered":"2024-09-12T22:13:48.018245+0000","last_clean":"2024-09-12T22:13:48.018245+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:48.018245+0000","last_undegraded":"2024-09-12T22:13:48.018245+0000","last_fullsized":"2024-09-12T22:13:48.018245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'186","last_scrub_stamp":"2024-09-12T22:13:48.018162+0000","last_deep_scrub":"82'186","last_deep_scrub_stamp":"2024-09-12T22:13:48.018162+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.018162+0000","objects_scrubbed":1,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:57.556686+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":524,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782894+0000","last_change":"2024-09-12T22:13:20.792676+0000","last_active":"2024-09-12T22:13:24.782894+0000","last_peered":"2024-09-12T22:13:24.782894+0000","last_clean":"2024-09-12T22:13:24.782894+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:13:24.782894+0000","last_undegraded":"2024-09-12T22:13:24.782894+0000","last_fullsized":"2024-09-12T22:13:24.782894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"59'171","reported_seq":284,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782552+0000","last_change":"2024-09-12T22:13:10.749306+0000","last_active":"2024-09-12T22:13:24.782552+0000","last_peered":"2024-09-12T22:13:24.782552+0000","last_clean":"2024-09-12T22:13:24.782552+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:24.782552+0000","last_undegraded":"2024-09-12T22:13:24.782552+0000","last_fullsized":"2024-09-12T22:13:24.782552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":542,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.137632+0000","last_change":"2024-09-12T22:13:41.137659+0000","last_active":"2024-09-12T22:13:41.137632+0000","last_peered":"2024-09-12T22:13:41.137632+0000","last_clean":"2024-09-12T22:13:41.137632+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:41.137632+0000","last_undegraded":"2024-09-12T22:13:41.137632+0000","last_fullsized":"2024-09-12T22:13:41.137632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:41.137508+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:41.137508+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.137508+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:34.388869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'58","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782344+0000","last_change":"2024-09-12T22:13:08.839902+0000","last_active":"2024-09-12T22:13:24.782344+0000","last_peered":"2024-09-12T22:13:24.782344+0000","last_clean":"2024-09-12T22:13:24.782344+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:13:24.782344+0000","last_undegraded":"2024-09-12T22:13:24.782344+0000","last_fullsized":"2024-09-12T22:13:24.782344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":528,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781195+0000","last_change":"2024-09-12T22:09:50.964755+0000","last_active":"2024-09-12T22:13:24.781195+0000","last_peered":"2024-09-12T22:13:24.781195+0000","last_clean":"2024-09-12T22:13:24.781195+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:24.781195+0000","last_undegraded":"2024-09-12T22:13:24.781195+0000","last_fullsized":"2024-09-12T22:13:24.781195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"58'187","reported_seq":329,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781435+0000","last_change":"2024-09-12T22:09:49.950521+0000","last_active":"2024-09-12T22:13:24.781435+0000","last_peered":"2024-09-12T22:13:24.781435+0000","last_clean":"2024-09-12T22:13:24.781435+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:24.781435+0000","last_undegraded":"2024-09-12T22:13:24.781435+0000","last_fullsized":"2024-09-12T22:13:24.781435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":895,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.781092+0000","last_change":"2024-09-12T22:13:22.785577+0000","last_active":"2024-09-12T22:13:24.781092+0000","last_peered":"2024-09-12T22:13:24.781092+0000","last_clean":"2024-09-12T22:13:24.781092+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:13:24.781092+0000","last_undegraded":"2024-09-12T22:13:24.781092+0000","last_fullsized":"2024-09-12T22:13:24.781092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'187","reported_seq":309,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782741+0000","last_change":"2024-09-12T22:13:10.748862+0000","last_active":"2024-09-12T22:13:24.782741+0000","last_peered":"2024-09-12T22:13:24.782741+0000","last_clean":"2024-09-12T22:13:24.782741+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:13:24.782741+0000","last_undegraded":"2024-09-12T22:13:24.782741+0000","last_fullsized":"2024-09-12T22:13:24.782741+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:48.929113+0000","last_clean_scrub_stamp":"2024-09-12T22:09:48.929113+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":576,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.782459+0000","last_change":"2024-09-12T22:13:14.780931+0000","last_active":"2024-09-12T22:13:24.782459+0000","last_peered":"2024-09-12T22:13:24.782459+0000","last_clean":"2024-09-12T22:13:24.782459+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:24.782459+0000","last_undegraded":"2024-09-12T22:13:24.782459+0000","last_fullsized":"2024-09-12T22:13:24.782459+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"82'59","reported_seq":222,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.998257+0000","last_change":"2024-09-12T22:13:37.998257+0000","last_active":"2024-09-12T22:13:37.998257+0000","last_peered":"2024-09-12T22:13:37.998257+0000","last_clean":"2024-09-12T22:13:37.998257+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:37.998257+0000","last_undegraded":"2024-09-12T22:13:37.998257+0000","last_fullsized":"2024-09-12T22:13:37.998257+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'59","last_scrub_stamp":"2024-09-12T22:13:37.998147+0000","last_deep_scrub":"82'59","last_deep_scrub_stamp":"2024-09-12T22:13:37.998147+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.998147+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.371726+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.916962+0000","last_change":"2024-09-12T22:13:48.917018+0000","last_active":"2024-09-12T22:13:48.916962+0000","last_peered":"2024-09-12T22:13:48.916962+0000","last_clean":"2024-09-12T22:13:48.916962+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:48.916962+0000","last_undegraded":"2024-09-12T22:13:48.916962+0000","last_fullsized":"2024-09-12T22:13:48.916962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'460","last_scrub_stamp":"2024-09-12T22:13:48.916859+0000","last_deep_scrub":"58'460","last_deep_scrub_stamp":"2024-09-12T22:13:48.916859+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.916859+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:36.542559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'114","reported_seq":264,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.991465+0000","last_change":"2024-09-12T22:13:48.991494+0000","last_active":"2024-09-12T22:13:48.991465+0000","last_peered":"2024-09-12T22:13:48.991465+0000","last_clean":"2024-09-12T22:13:48.991465+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:48.991465+0000","last_undegraded":"2024-09-12T22:13:48.991465+0000","last_fullsized":"2024-09-12T22:13:48.991465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'114","last_scrub_stamp":"2024-09-12T22:13:48.991378+0000","last_deep_scrub":"82'114","last_deep_scrub_stamp":"2024-09-12T22:13:48.991378+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.991378+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:16.999908+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6296,"ondisk_log_size":6296,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906955,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76820,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295020,"statfs":{"total":96636764160,"available":96558100480,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738423,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114656,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257184,"statfs":{"total":96636764160,"available":96519356416,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118484,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253356,"statfs":{"total":96636764160,"available":96515436544,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:13:54.029 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.030 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.030 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.030 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.030 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.030 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.030 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.030 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.031 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.031 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.031 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.031 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.031 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.031 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.031 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.032 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.033 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.034 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.034 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.034 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.034 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.034 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.034 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.034 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.035 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.035 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T22:09:44.795390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.035 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.035 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.035 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.035 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.035 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.036 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.036 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.036 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.036 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.036 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.036 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.036 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.037 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.037 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T22:09:48.929113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.037 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:13:54.038 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:14:14.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:14:14.353 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:14:14.355 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:14:14.365 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-12T22:14:13.139226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33123,"ondisk_log_size":33123,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309960,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805560,"statfs":{"total":289910292480,"available":289592893440,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003531"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":586,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:09.799390+0000","last_change":"2024-09-12T22:14:09.799429+0000","last_active":"2024-09-12T22:14:09.799390+0000","last_peered":"2024-09-12T22:14:09.799390+0000","last_clean":"2024-09-12T22:14:09.799390+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:14:09.799390+0000","last_undegraded":"2024-09-12T22:14:09.799390+0000","last_fullsized":"2024-09-12T22:14:09.799390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'434","last_scrub_stamp":"2024-09-12T22:14:09.799278+0000","last_deep_scrub":"58'434","last_deep_scrub_stamp":"2024-09-12T22:14:09.799278+0000","last_clean_scrub_stamp":"2024-09-12T22:14:09.799278+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:39.275505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":539,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.176819+0000","last_change":"2024-09-12T22:13:40.176860+0000","last_active":"2024-09-12T22:13:40.176819+0000","last_peered":"2024-09-12T22:13:40.176819+0000","last_clean":"2024-09-12T22:13:40.176819+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:40.176819+0000","last_undegraded":"2024-09-12T22:13:40.176819+0000","last_fullsized":"2024-09-12T22:13:40.176819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'392","last_scrub_stamp":"2024-09-12T22:13:40.176721+0000","last_deep_scrub":"58'392","last_deep_scrub_stamp":"2024-09-12T22:13:40.176721+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.176721+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:24.434920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":876,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:02.873702+0000","last_change":"2024-09-12T22:14:02.873702+0000","last_active":"2024-09-12T22:14:02.873702+0000","last_peered":"2024-09-12T22:14:02.873702+0000","last_clean":"2024-09-12T22:14:02.873702+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:14:02.873702+0000","last_undegraded":"2024-09-12T22:14:02.873702+0000","last_fullsized":"2024-09-12T22:14:02.873702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'362","last_scrub_stamp":"2024-09-12T22:14:02.873534+0000","last_deep_scrub":"58'362","last_deep_scrub_stamp":"2024-09-12T22:14:02.873534+0000","last_clean_scrub_stamp":"2024-09-12T22:14:02.873534+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:58.135025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":609,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.883972+0000","last_change":"2024-09-12T22:13:37.883972+0000","last_active":"2024-09-12T22:13:37.883972+0000","last_peered":"2024-09-12T22:13:37.883972+0000","last_clean":"2024-09-12T22:13:37.883972+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:37.883972+0000","last_undegraded":"2024-09-12T22:13:37.883972+0000","last_fullsized":"2024-09-12T22:13:37.883972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'417","last_scrub_stamp":"2024-09-12T22:13:37.883848+0000","last_deep_scrub":"58'417","last_deep_scrub_stamp":"2024-09-12T22:13:37.883848+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.883848+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:33.029505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":632,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.129647+0000","last_change":"2024-09-12T22:13:37.129694+0000","last_active":"2024-09-12T22:13:37.129647+0000","last_peered":"2024-09-12T22:13:37.129647+0000","last_clean":"2024-09-12T22:13:37.129647+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:37.129647+0000","last_undegraded":"2024-09-12T22:13:37.129647+0000","last_fullsized":"2024-09-12T22:13:37.129647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'466","last_scrub_stamp":"2024-09-12T22:13:37.129556+0000","last_deep_scrub":"58'466","last_deep_scrub_stamp":"2024-09-12T22:13:37.129556+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.129556+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:21:13.730450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":605,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.910215+0000","last_change":"2024-09-12T22:13:40.910269+0000","last_active":"2024-09-12T22:13:40.910215+0000","last_peered":"2024-09-12T22:13:40.910215+0000","last_clean":"2024-09-12T22:13:40.910215+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:40.910215+0000","last_undegraded":"2024-09-12T22:13:40.910215+0000","last_fullsized":"2024-09-12T22:13:40.910215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:40.910100+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:40.910100+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.910100+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:50.448625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":695,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:00.861595+0000","last_change":"2024-09-12T22:14:00.861623+0000","last_active":"2024-09-12T22:14:00.861595+0000","last_peered":"2024-09-12T22:14:00.861595+0000","last_clean":"2024-09-12T22:14:00.861595+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:14:00.861595+0000","last_undegraded":"2024-09-12T22:14:00.861595+0000","last_fullsized":"2024-09-12T22:14:00.861595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'463","last_scrub_stamp":"2024-09-12T22:14:00.861496+0000","last_deep_scrub":"58'463","last_deep_scrub_stamp":"2024-09-12T22:14:00.861496+0000","last_clean_scrub_stamp":"2024-09-12T22:14:00.861496+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:16.168986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:39.888993+0000","last_change":"2024-09-12T22:13:39.889019+0000","last_active":"2024-09-12T22:13:39.888993+0000","last_peered":"2024-09-12T22:13:39.888993+0000","last_clean":"2024-09-12T22:13:39.888993+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:39.888993+0000","last_undegraded":"2024-09-12T22:13:39.888993+0000","last_fullsized":"2024-09-12T22:13:39.888993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'391","last_scrub_stamp":"2024-09-12T22:13:39.888903+0000","last_deep_scrub":"58'391","last_deep_scrub_stamp":"2024-09-12T22:13:39.888903+0000","last_clean_scrub_stamp":"2024-09-12T22:13:39.888903+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:13.545009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":991,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:59.041863+0000","last_change":"2024-09-12T22:13:59.041902+0000","last_active":"2024-09-12T22:13:59.041863+0000","last_peered":"2024-09-12T22:13:59.041863+0000","last_clean":"2024-09-12T22:13:59.041863+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:59.041863+0000","last_undegraded":"2024-09-12T22:13:59.041863+0000","last_fullsized":"2024-09-12T22:13:59.041863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'422","last_scrub_stamp":"2024-09-12T22:13:59.041757+0000","last_deep_scrub":"58'422","last_deep_scrub_stamp":"2024-09-12T22:13:59.041757+0000","last_clean_scrub_stamp":"2024-09-12T22:13:59.041757+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:41.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":535,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:50.102416+0000","last_change":"2024-09-12T22:13:50.102445+0000","last_active":"2024-09-12T22:13:50.102416+0000","last_peered":"2024-09-12T22:13:50.102416+0000","last_clean":"2024-09-12T22:13:50.102416+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:50.102416+0000","last_undegraded":"2024-09-12T22:13:50.102416+0000","last_fullsized":"2024-09-12T22:13:50.102416+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'390","last_scrub_stamp":"2024-09-12T22:13:50.102311+0000","last_deep_scrub":"58'390","last_deep_scrub_stamp":"2024-09-12T22:13:50.102311+0000","last_clean_scrub_stamp":"2024-09-12T22:13:50.102311+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:49.935921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":558,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:52.862064+0000","last_change":"2024-09-12T22:13:52.862091+0000","last_active":"2024-09-12T22:13:52.862064+0000","last_peered":"2024-09-12T22:13:52.862064+0000","last_clean":"2024-09-12T22:13:52.862064+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:52.862064+0000","last_undegraded":"2024-09-12T22:13:52.862064+0000","last_fullsized":"2024-09-12T22:13:52.862064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'376","last_scrub_stamp":"2024-09-12T22:13:52.861966+0000","last_deep_scrub":"58'376","last_deep_scrub_stamp":"2024-09-12T22:13:52.861966+0000","last_clean_scrub_stamp":"2024-09-12T22:13:52.861966+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:50.519796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":494,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.103406+0000","last_change":"2024-09-12T22:13:36.103433+0000","last_active":"2024-09-12T22:13:36.103406+0000","last_peered":"2024-09-12T22:13:36.103406+0000","last_clean":"2024-09-12T22:13:36.103406+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:36.103406+0000","last_undegraded":"2024-09-12T22:13:36.103406+0000","last_fullsized":"2024-09-12T22:13:36.103406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'366","last_scrub_stamp":"2024-09-12T22:13:36.103319+0000","last_deep_scrub":"58'366","last_deep_scrub_stamp":"2024-09-12T22:13:36.103319+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.103319+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:12.617873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:03.921030+0000","last_change":"2024-09-12T22:14:03.921057+0000","last_active":"2024-09-12T22:14:03.921030+0000","last_peered":"2024-09-12T22:14:03.921030+0000","last_clean":"2024-09-12T22:14:03.921030+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:14:03.921030+0000","last_undegraded":"2024-09-12T22:14:03.921030+0000","last_fullsized":"2024-09-12T22:14:03.921030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'435","last_scrub_stamp":"2024-09-12T22:14:03.920937+0000","last_deep_scrub":"58'435","last_deep_scrub_stamp":"2024-09-12T22:14:03.920937+0000","last_clean_scrub_stamp":"2024-09-12T22:14:03.920937+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:20.943831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":949,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:06.896087+0000","last_change":"2024-09-12T22:14:06.896119+0000","last_active":"2024-09-12T22:14:06.896087+0000","last_peered":"2024-09-12T22:14:06.896087+0000","last_clean":"2024-09-12T22:14:06.896087+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:14:06.896087+0000","last_undegraded":"2024-09-12T22:14:06.896087+0000","last_fullsized":"2024-09-12T22:14:06.896087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'402","last_scrub_stamp":"2024-09-12T22:14:06.895977+0000","last_deep_scrub":"58'402","last_deep_scrub_stamp":"2024-09-12T22:14:06.895977+0000","last_clean_scrub_stamp":"2024-09-12T22:14:06.895977+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:01.293871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1048,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.799637+0000","last_change":"2024-09-12T22:13:34.799663+0000","last_active":"2024-09-12T22:13:34.799637+0000","last_peered":"2024-09-12T22:13:34.799637+0000","last_clean":"2024-09-12T22:13:34.799637+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:34.799637+0000","last_undegraded":"2024-09-12T22:13:34.799637+0000","last_fullsized":"2024-09-12T22:13:34.799637+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'437","last_scrub_stamp":"2024-09-12T22:13:34.799532+0000","last_deep_scrub":"58'437","last_deep_scrub_stamp":"2024-09-12T22:13:34.799532+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.799532+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:12.788366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":633,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.950391+0000","last_change":"2024-09-12T22:13:44.950422+0000","last_active":"2024-09-12T22:13:44.950391+0000","last_peered":"2024-09-12T22:13:44.950391+0000","last_clean":"2024-09-12T22:13:44.950391+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:44.950391+0000","last_undegraded":"2024-09-12T22:13:44.950391+0000","last_fullsized":"2024-09-12T22:13:44.950391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'438","last_scrub_stamp":"2024-09-12T22:13:44.950299+0000","last_deep_scrub":"58'438","last_deep_scrub_stamp":"2024-09-12T22:13:44.950299+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.950299+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:03.773639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":948,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:02.025526+0000","last_change":"2024-09-12T22:14:02.025554+0000","last_active":"2024-09-12T22:14:02.025526+0000","last_peered":"2024-09-12T22:14:02.025526+0000","last_clean":"2024-09-12T22:14:02.025526+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:14:02.025526+0000","last_undegraded":"2024-09-12T22:14:02.025526+0000","last_fullsized":"2024-09-12T22:14:02.025526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'403","last_scrub_stamp":"2024-09-12T22:14:02.025421+0000","last_deep_scrub":"58'403","last_deep_scrub_stamp":"2024-09-12T22:14:02.025421+0000","last_clean_scrub_stamp":"2024-09-12T22:14:02.025421+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:50.006157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":542,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:06.861119+0000","last_change":"2024-09-12T22:14:06.861185+0000","last_active":"2024-09-12T22:14:06.861119+0000","last_peered":"2024-09-12T22:14:06.861119+0000","last_clean":"2024-09-12T22:14:06.861119+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:14:06.861119+0000","last_undegraded":"2024-09-12T22:14:06.861119+0000","last_fullsized":"2024-09-12T22:14:06.861119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'402","last_scrub_stamp":"2024-09-12T22:14:06.861002+0000","last_deep_scrub":"58'402","last_deep_scrub_stamp":"2024-09-12T22:14:06.861002+0000","last_clean_scrub_stamp":"2024-09-12T22:14:06.861002+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:58.997007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":985,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:56.988436+0000","last_change":"2024-09-12T22:13:56.988463+0000","last_active":"2024-09-12T22:13:56.988436+0000","last_peered":"2024-09-12T22:13:56.988436+0000","last_clean":"2024-09-12T22:13:56.988436+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:56.988436+0000","last_undegraded":"2024-09-12T22:13:56.988436+0000","last_fullsized":"2024-09-12T22:13:56.988436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'423","last_scrub_stamp":"2024-09-12T22:13:56.988327+0000","last_deep_scrub":"58'423","last_deep_scrub_stamp":"2024-09-12T22:13:56.988327+0000","last_clean_scrub_stamp":"2024-09-12T22:13:56.988327+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:27.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":626,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.961819+0000","last_change":"2024-09-12T22:13:46.961847+0000","last_active":"2024-09-12T22:13:46.961819+0000","last_peered":"2024-09-12T22:13:46.961819+0000","last_clean":"2024-09-12T22:13:46.961819+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:46.961819+0000","last_undegraded":"2024-09-12T22:13:46.961819+0000","last_fullsized":"2024-09-12T22:13:46.961819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'442","last_scrub_stamp":"2024-09-12T22:13:46.961715+0000","last_deep_scrub":"58'442","last_deep_scrub_stamp":"2024-09-12T22:13:46.961715+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.961715+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.371724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":678,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.909178+0000","last_change":"2024-09-12T22:13:38.909206+0000","last_active":"2024-09-12T22:13:38.909178+0000","last_peered":"2024-09-12T22:13:38.909178+0000","last_clean":"2024-09-12T22:13:38.909178+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:38.909178+0000","last_undegraded":"2024-09-12T22:13:38.909178+0000","last_fullsized":"2024-09-12T22:13:38.909178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'440","last_scrub_stamp":"2024-09-12T22:13:38.909089+0000","last_deep_scrub":"58'440","last_deep_scrub_stamp":"2024-09-12T22:13:38.909089+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.909089+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:55.274195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":612,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.101346+0000","last_change":"2024-09-12T22:13:35.101372+0000","last_active":"2024-09-12T22:13:35.101346+0000","last_peered":"2024-09-12T22:13:35.101346+0000","last_clean":"2024-09-12T22:13:35.101346+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:35.101346+0000","last_undegraded":"2024-09-12T22:13:35.101346+0000","last_fullsized":"2024-09-12T22:13:35.101346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'443","last_scrub_stamp":"2024-09-12T22:13:35.101256+0000","last_deep_scrub":"58'443","last_deep_scrub_stamp":"2024-09-12T22:13:35.101256+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.101256+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:14.463127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":667,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.989810+0000","last_change":"2024-09-12T22:13:44.989836+0000","last_active":"2024-09-12T22:13:44.989810+0000","last_peered":"2024-09-12T22:13:44.989810+0000","last_clean":"2024-09-12T22:13:44.989810+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:44.989810+0000","last_undegraded":"2024-09-12T22:13:44.989810+0000","last_fullsized":"2024-09-12T22:13:44.989810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'442","last_scrub_stamp":"2024-09-12T22:13:44.989717+0000","last_deep_scrub":"58'442","last_deep_scrub_stamp":"2024-09-12T22:13:44.989717+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.989717+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:44.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:08.807161+0000","last_change":"2024-09-12T22:14:08.807184+0000","last_active":"2024-09-12T22:14:08.807161+0000","last_peered":"2024-09-12T22:14:08.807161+0000","last_clean":"2024-09-12T22:14:08.807161+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:14:08.807161+0000","last_undegraded":"2024-09-12T22:14:08.807161+0000","last_fullsized":"2024-09-12T22:14:08.807161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'448","last_scrub_stamp":"2024-09-12T22:14:08.807091+0000","last_deep_scrub":"58'448","last_deep_scrub_stamp":"2024-09-12T22:14:08.807091+0000","last_clean_scrub_stamp":"2024-09-12T22:14:08.807091+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:18.057892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.104721+0000","last_change":"2024-09-12T22:13:38.104758+0000","last_active":"2024-09-12T22:13:38.104721+0000","last_peered":"2024-09-12T22:13:38.104721+0000","last_clean":"2024-09-12T22:13:38.104721+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:38.104721+0000","last_undegraded":"2024-09-12T22:13:38.104721+0000","last_fullsized":"2024-09-12T22:13:38.104721+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'399","last_scrub_stamp":"2024-09-12T22:13:38.104628+0000","last_deep_scrub":"58'399","last_deep_scrub_stamp":"2024-09-12T22:13:38.104628+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.104628+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.552622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":668,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.054157+0000","last_change":"2024-09-12T22:13:47.054181+0000","last_active":"2024-09-12T22:13:47.054157+0000","last_peered":"2024-09-12T22:13:47.054157+0000","last_clean":"2024-09-12T22:13:47.054157+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:47.054157+0000","last_undegraded":"2024-09-12T22:13:47.054157+0000","last_fullsized":"2024-09-12T22:13:47.054157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'479","last_scrub_stamp":"2024-09-12T22:13:47.054068+0000","last_deep_scrub":"58'479","last_deep_scrub_stamp":"2024-09-12T22:13:47.054068+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.054068+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:14.956452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":879,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:03.860338+0000","last_change":"2024-09-12T22:14:03.860371+0000","last_active":"2024-09-12T22:14:03.860338+0000","last_peered":"2024-09-12T22:14:03.860338+0000","last_clean":"2024-09-12T22:14:03.860338+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:14:03.860338+0000","last_undegraded":"2024-09-12T22:14:03.860338+0000","last_fullsized":"2024-09-12T22:14:03.860338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'374","last_scrub_stamp":"2024-09-12T22:14:03.860248+0000","last_deep_scrub":"58'374","last_deep_scrub_stamp":"2024-09-12T22:14:03.860248+0000","last_clean_scrub_stamp":"2024-09-12T22:14:03.860248+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:19.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":554,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.156757+0000","last_change":"2024-09-12T22:13:42.156782+0000","last_active":"2024-09-12T22:13:42.156757+0000","last_peered":"2024-09-12T22:13:42.156757+0000","last_clean":"2024-09-12T22:13:42.156757+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:42.156757+0000","last_undegraded":"2024-09-12T22:13:42.156757+0000","last_fullsized":"2024-09-12T22:13:42.156757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:42.156667+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:42.156667+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.156667+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:35.039529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":989,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.003988+0000","last_change":"2024-09-12T22:13:58.003988+0000","last_active":"2024-09-12T22:13:58.003988+0000","last_peered":"2024-09-12T22:13:58.003988+0000","last_clean":"2024-09-12T22:13:58.003988+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:58.003988+0000","last_undegraded":"2024-09-12T22:13:58.003988+0000","last_fullsized":"2024-09-12T22:13:58.003988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'410","last_scrub_stamp":"2024-09-12T22:13:58.003819+0000","last_deep_scrub":"58'410","last_deep_scrub_stamp":"2024-09-12T22:13:58.003819+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.003819+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:39.296523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":644,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:04.894778+0000","last_change":"2024-09-12T22:14:04.894804+0000","last_active":"2024-09-12T22:14:04.894778+0000","last_peered":"2024-09-12T22:14:04.894778+0000","last_clean":"2024-09-12T22:14:04.894778+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:14:04.894778+0000","last_undegraded":"2024-09-12T22:14:04.894778+0000","last_fullsized":"2024-09-12T22:14:04.894778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'481","last_scrub_stamp":"2024-09-12T22:14:04.894692+0000","last_deep_scrub":"58'481","last_deep_scrub_stamp":"2024-09-12T22:14:04.894692+0000","last_clean_scrub_stamp":"2024-09-12T22:14:04.894692+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:20.350858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":944,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.007095+0000","last_change":"2024-09-12T22:13:46.007095+0000","last_active":"2024-09-12T22:13:46.007095+0000","last_peered":"2024-09-12T22:13:46.007095+0000","last_clean":"2024-09-12T22:13:46.007095+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:46.007095+0000","last_undegraded":"2024-09-12T22:13:46.007095+0000","last_fullsized":"2024-09-12T22:13:46.007095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'401","last_scrub_stamp":"2024-09-12T22:13:46.006977+0000","last_deep_scrub":"58'401","last_deep_scrub_stamp":"2024-09-12T22:13:46.006977+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.006977+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:20:56.543008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1012,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:08.890964+0000","last_change":"2024-09-12T22:14:08.890992+0000","last_active":"2024-09-12T22:14:08.890964+0000","last_peered":"2024-09-12T22:14:08.890964+0000","last_clean":"2024-09-12T22:14:08.890964+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:14:08.890964+0000","last_undegraded":"2024-09-12T22:14:08.890964+0000","last_fullsized":"2024-09-12T22:14:08.890964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'436","last_scrub_stamp":"2024-09-12T22:14:08.890871+0000","last_deep_scrub":"58'436","last_deep_scrub_stamp":"2024-09-12T22:14:08.890871+0000","last_clean_scrub_stamp":"2024-09-12T22:14:08.890871+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:29.562262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":569,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.105590+0000","last_change":"2024-09-12T22:13:44.105628+0000","last_active":"2024-09-12T22:13:44.105590+0000","last_peered":"2024-09-12T22:13:44.105590+0000","last_clean":"2024-09-12T22:13:44.105590+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:44.105590+0000","last_undegraded":"2024-09-12T22:13:44.105590+0000","last_fullsized":"2024-09-12T22:13:44.105590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'407","last_scrub_stamp":"2024-09-12T22:13:44.105503+0000","last_deep_scrub":"58'407","last_deep_scrub_stamp":"2024-09-12T22:13:44.105503+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.105503+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:57.987490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"82'315","reported_seq":465,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.879111+0000","last_change":"2024-09-12T22:13:58.879145+0000","last_active":"2024-09-12T22:13:58.879111+0000","last_peered":"2024-09-12T22:13:58.879111+0000","last_clean":"2024-09-12T22:13:58.879111+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:58.879111+0000","last_undegraded":"2024-09-12T22:13:58.879111+0000","last_fullsized":"2024-09-12T22:13:58.879111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'315","last_scrub_stamp":"2024-09-12T22:13:58.879008+0000","last_deep_scrub":"82'315","last_deep_scrub_stamp":"2024-09-12T22:13:58.879008+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.879008+0000","objects_scrubbed":4,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:31.895483+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":570,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.144324+0000","last_change":"2024-09-12T22:13:34.144346+0000","last_active":"2024-09-12T22:13:34.144324+0000","last_peered":"2024-09-12T22:13:34.144324+0000","last_clean":"2024-09-12T22:13:34.144324+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:34.144324+0000","last_undegraded":"2024-09-12T22:13:34.144324+0000","last_fullsized":"2024-09-12T22:13:34.144324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'418","last_scrub_stamp":"2024-09-12T22:13:34.144214+0000","last_deep_scrub":"58'418","last_deep_scrub_stamp":"2024-09-12T22:13:34.144214+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.144214+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:50.343272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":208,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.018938+0000","last_change":"2024-09-12T22:13:53.018963+0000","last_active":"2024-09-12T22:13:53.018938+0000","last_peered":"2024-09-12T22:13:53.018938+0000","last_clean":"2024-09-12T22:13:53.018938+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:53.018938+0000","last_undegraded":"2024-09-12T22:13:53.018938+0000","last_fullsized":"2024-09-12T22:13:53.018938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-09-12T22:13:53.018842+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-09-12T22:13:53.018842+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.018842+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:13.739594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":580,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.962974+0000","last_change":"2024-09-12T22:13:38.962999+0000","last_active":"2024-09-12T22:13:38.962974+0000","last_peered":"2024-09-12T22:13:38.962974+0000","last_clean":"2024-09-12T22:13:38.962974+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:38.962974+0000","last_undegraded":"2024-09-12T22:13:38.962974+0000","last_fullsized":"2024-09-12T22:13:38.962974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'422","last_scrub_stamp":"2024-09-12T22:13:38.962883+0000","last_deep_scrub":"58'422","last_deep_scrub_stamp":"2024-09-12T22:13:38.962883+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.962883+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:32.625470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:57.046558+0000","last_change":"2024-09-12T22:13:57.046585+0000","last_active":"2024-09-12T22:13:57.046558+0000","last_peered":"2024-09-12T22:13:57.046558+0000","last_clean":"2024-09-12T22:13:57.046558+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:57.046558+0000","last_undegraded":"2024-09-12T22:13:57.046558+0000","last_fullsized":"2024-09-12T22:13:57.046558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-09-12T22:13:57.046465+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-09-12T22:13:57.046465+0000","last_clean_scrub_stamp":"2024-09-12T22:13:57.046465+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:27.694902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":580,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.991477+0000","last_change":"2024-09-12T22:13:53.991502+0000","last_active":"2024-09-12T22:13:53.991477+0000","last_peered":"2024-09-12T22:13:53.991477+0000","last_clean":"2024-09-12T22:13:53.991477+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:53.991477+0000","last_undegraded":"2024-09-12T22:13:53.991477+0000","last_fullsized":"2024-09-12T22:13:53.991477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'398","last_scrub_stamp":"2024-09-12T22:13:53.991361+0000","last_deep_scrub":"58'398","last_deep_scrub_stamp":"2024-09-12T22:13:53.991361+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.991361+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:21.991672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"82'74","reported_seq":232,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:45.957216+0000","last_change":"2024-09-12T22:13:45.957271+0000","last_active":"2024-09-12T22:13:45.957216+0000","last_peered":"2024-09-12T22:13:45.957216+0000","last_clean":"2024-09-12T22:13:45.957216+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:45.957216+0000","last_undegraded":"2024-09-12T22:13:45.957216+0000","last_fullsized":"2024-09-12T22:13:45.957216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'74","last_scrub_stamp":"2024-09-12T22:13:45.957125+0000","last_deep_scrub":"82'74","last_deep_scrub_stamp":"2024-09-12T22:13:45.957125+0000","last_clean_scrub_stamp":"2024-09-12T22:13:45.957125+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:01.987729+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'158","reported_seq":322,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:51.847794+0000","last_change":"2024-09-12T22:13:51.847858+0000","last_active":"2024-09-12T22:13:51.847794+0000","last_peered":"2024-09-12T22:13:51.847794+0000","last_clean":"2024-09-12T22:13:51.847794+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:51.847794+0000","last_undegraded":"2024-09-12T22:13:51.847794+0000","last_fullsized":"2024-09-12T22:13:51.847794+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'158","last_scrub_stamp":"2024-09-12T22:13:51.847695+0000","last_deep_scrub":"82'158","last_deep_scrub_stamp":"2024-09-12T22:13:51.847695+0000","last_clean_scrub_stamp":"2024-09-12T22:13:51.847695+0000","objects_scrubbed":2,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:31:17.316722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":539,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:05.899998+0000","last_change":"2024-09-12T22:14:05.900023+0000","last_active":"2024-09-12T22:14:05.899998+0000","last_peered":"2024-09-12T22:14:05.899998+0000","last_clean":"2024-09-12T22:14:05.899998+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:14:05.899998+0000","last_undegraded":"2024-09-12T22:14:05.899998+0000","last_fullsized":"2024-09-12T22:14:05.899998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'403","last_scrub_stamp":"2024-09-12T22:14:05.899906+0000","last_deep_scrub":"58'403","last_deep_scrub_stamp":"2024-09-12T22:14:05.899906+0000","last_clean_scrub_stamp":"2024-09-12T22:14:05.899906+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:38.808716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"82'219","reported_seq":349,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.108065+0000","last_change":"2024-09-12T22:13:47.108094+0000","last_active":"2024-09-12T22:13:47.108065+0000","last_peered":"2024-09-12T22:13:47.108065+0000","last_clean":"2024-09-12T22:13:47.108065+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:47.108065+0000","last_undegraded":"2024-09-12T22:13:47.108065+0000","last_fullsized":"2024-09-12T22:13:47.108065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'219","last_scrub_stamp":"2024-09-12T22:13:47.107987+0000","last_deep_scrub":"82'219","last_deep_scrub_stamp":"2024-09-12T22:13:47.107987+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.107987+0000","objects_scrubbed":2,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:21.893622+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":554,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:24.791140+0000","last_change":"2024-09-12T22:13:24.787848+0000","last_active":"2024-09-12T22:13:24.791140+0000","last_peered":"2024-09-12T22:13:24.791140+0000","last_clean":"2024-09-12T22:13:24.791140+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:13:24.791140+0000","last_undegraded":"2024-09-12T22:13:24.791140+0000","last_fullsized":"2024-09-12T22:13:24.791140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:09:49.932788+0000","last_clean_scrub_stamp":"2024-09-12T22:09:49.932788+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'474","reported_seq":638,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.865474+0000","last_change":"2024-09-12T22:13:36.865505+0000","last_active":"2024-09-12T22:13:36.865474+0000","last_peered":"2024-09-12T22:13:36.865474+0000","last_clean":"2024-09-12T22:13:36.865474+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:36.865474+0000","last_undegraded":"2024-09-12T22:13:36.865474+0000","last_fullsized":"2024-09-12T22:13:36.865474+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'474","last_scrub_stamp":"2024-09-12T22:13:36.865383+0000","last_deep_scrub":"82'474","last_deep_scrub_stamp":"2024-09-12T22:13:36.865383+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.865383+0000","objects_scrubbed":2,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.405625+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":602,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:59.907020+0000","last_change":"2024-09-12T22:13:59.907079+0000","last_active":"2024-09-12T22:13:59.907020+0000","last_peered":"2024-09-12T22:13:59.907020+0000","last_clean":"2024-09-12T22:13:59.907020+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:59.907020+0000","last_undegraded":"2024-09-12T22:13:59.907020+0000","last_fullsized":"2024-09-12T22:13:59.907020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'437","last_scrub_stamp":"2024-09-12T22:13:59.906891+0000","last_deep_scrub":"58'437","last_deep_scrub_stamp":"2024-09-12T22:13:59.906891+0000","last_clean_scrub_stamp":"2024-09-12T22:13:59.906891+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:48.953971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":207,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:56.904341+0000","last_change":"2024-09-12T22:13:56.904365+0000","last_active":"2024-09-12T22:13:56.904341+0000","last_peered":"2024-09-12T22:13:56.904341+0000","last_clean":"2024-09-12T22:13:56.904341+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:56.904341+0000","last_undegraded":"2024-09-12T22:13:56.904341+0000","last_fullsized":"2024-09-12T22:13:56.904341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'57","last_scrub_stamp":"2024-09-12T22:13:56.904252+0000","last_deep_scrub":"58'57","last_deep_scrub_stamp":"2024-09-12T22:13:56.904252+0000","last_clean_scrub_stamp":"2024-09-12T22:13:56.904252+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:39.967749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":617,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.000048+0000","last_change":"2024-09-12T22:13:55.000072+0000","last_active":"2024-09-12T22:13:55.000048+0000","last_peered":"2024-09-12T22:13:55.000048+0000","last_clean":"2024-09-12T22:13:55.000048+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:55.000048+0000","last_undegraded":"2024-09-12T22:13:55.000048+0000","last_fullsized":"2024-09-12T22:13:55.000048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'430","last_scrub_stamp":"2024-09-12T22:13:54.999952+0000","last_deep_scrub":"58'430","last_deep_scrub_stamp":"2024-09-12T22:13:54.999952+0000","last_clean_scrub_stamp":"2024-09-12T22:13:54.999952+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:42.625652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"82'174","reported_seq":324,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:51.985342+0000","last_change":"2024-09-12T22:13:51.985371+0000","last_active":"2024-09-12T22:13:51.985342+0000","last_peered":"2024-09-12T22:13:51.985342+0000","last_clean":"2024-09-12T22:13:51.985342+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:51.985342+0000","last_undegraded":"2024-09-12T22:13:51.985342+0000","last_fullsized":"2024-09-12T22:13:51.985342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'174","last_scrub_stamp":"2024-09-12T22:13:51.985259+0000","last_deep_scrub":"82'174","last_deep_scrub_stamp":"2024-09-12T22:13:51.985259+0000","last_clean_scrub_stamp":"2024-09-12T22:13:51.985259+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:10.808599+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":678,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.891606+0000","last_change":"2024-09-12T22:13:42.891634+0000","last_active":"2024-09-12T22:13:42.891606+0000","last_peered":"2024-09-12T22:13:42.891606+0000","last_clean":"2024-09-12T22:13:42.891606+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:42.891606+0000","last_undegraded":"2024-09-12T22:13:42.891606+0000","last_fullsized":"2024-09-12T22:13:42.891606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'476","last_scrub_stamp":"2024-09-12T22:13:42.891514+0000","last_deep_scrub":"58'476","last_deep_scrub_stamp":"2024-09-12T22:13:42.891514+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.891514+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:15.358329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"82'110","reported_seq":231,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.050966+0000","last_change":"2024-09-12T22:13:53.050992+0000","last_active":"2024-09-12T22:13:53.050966+0000","last_peered":"2024-09-12T22:13:53.050966+0000","last_clean":"2024-09-12T22:13:53.050966+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:53.050966+0000","last_undegraded":"2024-09-12T22:13:53.050966+0000","last_fullsized":"2024-09-12T22:13:53.050966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'110","last_scrub_stamp":"2024-09-12T22:13:53.050829+0000","last_deep_scrub":"82'110","last_deep_scrub_stamp":"2024-09-12T22:13:53.050829+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.050829+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:53.361651+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":905,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:04.893208+0000","last_change":"2024-09-12T22:14:04.893235+0000","last_active":"2024-09-12T22:14:04.893208+0000","last_peered":"2024-09-12T22:14:04.893208+0000","last_clean":"2024-09-12T22:14:04.893208+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:14:04.893208+0000","last_undegraded":"2024-09-12T22:14:04.893208+0000","last_fullsized":"2024-09-12T22:14:04.893208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'394","last_scrub_stamp":"2024-09-12T22:14:04.893084+0000","last_deep_scrub":"58'394","last_deep_scrub_stamp":"2024-09-12T22:14:04.893084+0000","last_clean_scrub_stamp":"2024-09-12T22:14:04.893084+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:59.851858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:56.037554+0000","last_change":"2024-09-12T22:13:56.037595+0000","last_active":"2024-09-12T22:13:56.037554+0000","last_peered":"2024-09-12T22:13:56.037554+0000","last_clean":"2024-09-12T22:13:56.037554+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:56.037554+0000","last_undegraded":"2024-09-12T22:13:56.037554+0000","last_fullsized":"2024-09-12T22:13:56.037554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'56","last_scrub_stamp":"2024-09-12T22:13:56.037424+0000","last_deep_scrub":"58'56","last_deep_scrub_stamp":"2024-09-12T22:13:56.037424+0000","last_clean_scrub_stamp":"2024-09-12T22:13:56.037424+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:12.803875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":850,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:33.805839+0000","last_change":"2024-09-12T22:13:33.805892+0000","last_active":"2024-09-12T22:13:33.805839+0000","last_peered":"2024-09-12T22:13:33.805839+0000","last_clean":"2024-09-12T22:13:33.805839+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:33.805839+0000","last_undegraded":"2024-09-12T22:13:33.805839+0000","last_fullsized":"2024-09-12T22:13:33.805839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'358","last_scrub_stamp":"2024-09-12T22:13:33.805719+0000","last_deep_scrub":"58'358","last_deep_scrub_stamp":"2024-09-12T22:13:33.805719+0000","last_clean_scrub_stamp":"2024-09-12T22:13:33.805719+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:53.477722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"82'493","reported_seq":614,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:51.082228+0000","last_change":"2024-09-12T22:13:51.082257+0000","last_active":"2024-09-12T22:13:51.082228+0000","last_peered":"2024-09-12T22:13:51.082228+0000","last_clean":"2024-09-12T22:13:51.082228+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:51.082228+0000","last_undegraded":"2024-09-12T22:13:51.082228+0000","last_fullsized":"2024-09-12T22:13:51.082228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'493","last_scrub_stamp":"2024-09-12T22:13:51.082144+0000","last_deep_scrub":"82'493","last_deep_scrub_stamp":"2024-09-12T22:13:51.082144+0000","last_clean_scrub_stamp":"2024-09-12T22:13:51.082144+0000","objects_scrubbed":1,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:00.703129+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":985,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:00.070050+0000","last_change":"2024-09-12T22:14:00.070089+0000","last_active":"2024-09-12T22:14:00.070050+0000","last_peered":"2024-09-12T22:14:00.070050+0000","last_clean":"2024-09-12T22:14:00.070050+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:14:00.070050+0000","last_undegraded":"2024-09-12T22:14:00.070050+0000","last_fullsized":"2024-09-12T22:14:00.070050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'414","last_scrub_stamp":"2024-09-12T22:14:00.069947+0000","last_deep_scrub":"58'414","last_deep_scrub_stamp":"2024-09-12T22:14:00.069947+0000","last_clean_scrub_stamp":"2024-09-12T22:14:00.069947+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:16.680006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":370,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.928350+0000","last_change":"2024-09-12T22:13:43.928350+0000","last_active":"2024-09-12T22:13:43.928350+0000","last_peered":"2024-09-12T22:13:43.928350+0000","last_clean":"2024-09-12T22:13:43.928350+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:43.928350+0000","last_undegraded":"2024-09-12T22:13:43.928350+0000","last_fullsized":"2024-09-12T22:13:43.928350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-09-12T22:13:43.928152+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-09-12T22:13:43.928152+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.928152+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:04.652918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"82'2","reported_seq":166,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:54.883974+0000","last_change":"2024-09-12T22:13:54.883974+0000","last_active":"2024-09-12T22:13:54.883974+0000","last_peered":"2024-09-12T22:13:54.883974+0000","last_clean":"2024-09-12T22:13:54.883974+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:54.883974+0000","last_undegraded":"2024-09-12T22:13:54.883974+0000","last_fullsized":"2024-09-12T22:13:54.883974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-09-12T22:13:54.883844+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-09-12T22:13:54.883844+0000","last_clean_scrub_stamp":"2024-09-12T22:13:54.883844+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:21.032428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"82'610","reported_seq":776,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.977122+0000","last_change":"2024-09-12T22:13:41.977122+0000","last_active":"2024-09-12T22:13:41.977122+0000","last_peered":"2024-09-12T22:13:41.977122+0000","last_clean":"2024-09-12T22:13:41.977122+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:41.977122+0000","last_undegraded":"2024-09-12T22:13:41.977122+0000","last_fullsized":"2024-09-12T22:13:41.977122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'610","last_scrub_stamp":"2024-09-12T22:13:41.976949+0000","last_deep_scrub":"82'610","last_deep_scrub_stamp":"2024-09-12T22:13:41.976949+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.976949+0000","objects_scrubbed":2,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:53.900021+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":1002,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:07.853384+0000","last_change":"2024-09-12T22:14:07.853428+0000","last_active":"2024-09-12T22:14:07.853384+0000","last_peered":"2024-09-12T22:14:07.853384+0000","last_clean":"2024-09-12T22:14:07.853384+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:14:07.853384+0000","last_undegraded":"2024-09-12T22:14:07.853384+0000","last_fullsized":"2024-09-12T22:14:07.853384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'431","last_scrub_stamp":"2024-09-12T22:14:07.853262+0000","last_deep_scrub":"58'431","last_deep_scrub_stamp":"2024-09-12T22:14:07.853262+0000","last_clean_scrub_stamp":"2024-09-12T22:14:07.853262+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:27.811350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.867859+0000","last_change":"2024-09-12T22:13:41.867859+0000","last_active":"2024-09-12T22:13:41.867859+0000","last_peered":"2024-09-12T22:13:41.867859+0000","last_clean":"2024-09-12T22:13:41.867859+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:41.867859+0000","last_undegraded":"2024-09-12T22:13:41.867859+0000","last_fullsized":"2024-09-12T22:13:41.867859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:41.867742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:41.867742+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.867742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:09.876272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"82'112","reported_seq":309,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:49.998409+0000","last_change":"2024-09-12T22:13:49.998409+0000","last_active":"2024-09-12T22:13:49.998409+0000","last_peered":"2024-09-12T22:13:49.998409+0000","last_clean":"2024-09-12T22:13:49.998409+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:49.998409+0000","last_undegraded":"2024-09-12T22:13:49.998409+0000","last_fullsized":"2024-09-12T22:13:49.998409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'112","last_scrub_stamp":"2024-09-12T22:13:49.998297+0000","last_deep_scrub":"82'112","last_deep_scrub_stamp":"2024-09-12T22:13:49.998297+0000","last_clean_scrub_stamp":"2024-09-12T22:13:49.998297+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:25.329388+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":622,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.133393+0000","last_change":"2024-09-12T22:13:48.133442+0000","last_active":"2024-09-12T22:13:48.133393+0000","last_peered":"2024-09-12T22:13:48.133393+0000","last_clean":"2024-09-12T22:13:48.133393+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:48.133393+0000","last_undegraded":"2024-09-12T22:13:48.133393+0000","last_fullsized":"2024-09-12T22:13:48.133393+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'449","last_scrub_stamp":"2024-09-12T22:13:48.133281+0000","last_deep_scrub":"58'449","last_deep_scrub_stamp":"2024-09-12T22:13:48.133281+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.133281+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:39.397507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.034493+0000","last_change":"2024-09-12T22:13:34.034493+0000","last_active":"2024-09-12T22:13:34.034493+0000","last_peered":"2024-09-12T22:13:34.034493+0000","last_clean":"2024-09-12T22:13:34.034493+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:34.034493+0000","last_undegraded":"2024-09-12T22:13:34.034493+0000","last_fullsized":"2024-09-12T22:13:34.034493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:34.034386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:34.034386+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.034386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:45.571644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"82'399","reported_seq":520,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:49.107447+0000","last_change":"2024-09-12T22:13:49.107496+0000","last_active":"2024-09-12T22:13:49.107447+0000","last_peered":"2024-09-12T22:13:49.107447+0000","last_clean":"2024-09-12T22:13:49.107447+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:49.107447+0000","last_undegraded":"2024-09-12T22:13:49.107447+0000","last_fullsized":"2024-09-12T22:13:49.107447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'399","last_scrub_stamp":"2024-09-12T22:13:49.107347+0000","last_deep_scrub":"82'399","last_deep_scrub_stamp":"2024-09-12T22:13:49.107347+0000","last_clean_scrub_stamp":"2024-09-12T22:13:49.107347+0000","objects_scrubbed":2,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:19.733424+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":833,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:01.032887+0000","last_change":"2024-09-12T22:14:01.032927+0000","last_active":"2024-09-12T22:14:01.032887+0000","last_peered":"2024-09-12T22:14:01.032887+0000","last_clean":"2024-09-12T22:14:01.032887+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:14:01.032887+0000","last_undegraded":"2024-09-12T22:14:01.032887+0000","last_fullsized":"2024-09-12T22:14:01.032887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'339","last_scrub_stamp":"2024-09-12T22:14:01.032769+0000","last_deep_scrub":"58'339","last_deep_scrub_stamp":"2024-09-12T22:14:01.032769+0000","last_clean_scrub_stamp":"2024-09-12T22:14:01.032769+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:21.004956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"82'3","reported_seq":167,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.909991+0000","last_change":"2024-09-12T22:13:53.909991+0000","last_active":"2024-09-12T22:13:53.909991+0000","last_peered":"2024-09-12T22:13:53.909991+0000","last_clean":"2024-09-12T22:13:53.909991+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:53.909991+0000","last_undegraded":"2024-09-12T22:13:53.909991+0000","last_fullsized":"2024-09-12T22:13:53.909991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-09-12T22:13:53.909858+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-09-12T22:13:53.909858+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.909858+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.519918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:59.929576+0000","last_change":"2024-09-12T22:13:59.929604+0000","last_active":"2024-09-12T22:13:59.929576+0000","last_peered":"2024-09-12T22:13:59.929576+0000","last_clean":"2024-09-12T22:13:59.929576+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:59.929576+0000","last_undegraded":"2024-09-12T22:13:59.929576+0000","last_fullsized":"2024-09-12T22:13:59.929576+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'65","last_scrub_stamp":"2024-09-12T22:13:59.929451+0000","last_deep_scrub":"58'65","last_deep_scrub_stamp":"2024-09-12T22:13:59.929451+0000","last_clean_scrub_stamp":"2024-09-12T22:13:59.929451+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:51.522557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":945,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.985011+0000","last_change":"2024-09-12T22:13:43.985011+0000","last_active":"2024-09-12T22:13:43.985011+0000","last_peered":"2024-09-12T22:13:43.985011+0000","last_clean":"2024-09-12T22:13:43.985011+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:43.985011+0000","last_undegraded":"2024-09-12T22:13:43.985011+0000","last_fullsized":"2024-09-12T22:13:43.985011+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'399","last_scrub_stamp":"2024-09-12T22:13:43.984840+0000","last_deep_scrub":"58'399","last_deep_scrub_stamp":"2024-09-12T22:13:43.984840+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.984840+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:20.525082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"82'283","reported_seq":434,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.905143+0000","last_change":"2024-09-12T22:13:55.905143+0000","last_active":"2024-09-12T22:13:55.905143+0000","last_peered":"2024-09-12T22:13:55.905143+0000","last_clean":"2024-09-12T22:13:55.905143+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:55.905143+0000","last_undegraded":"2024-09-12T22:13:55.905143+0000","last_fullsized":"2024-09-12T22:13:55.905143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'283","last_scrub_stamp":"2024-09-12T22:13:55.904976+0000","last_deep_scrub":"82'283","last_deep_scrub_stamp":"2024-09-12T22:13:55.904976+0000","last_clean_scrub_stamp":"2024-09-12T22:13:55.904976+0000","objects_scrubbed":1,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:43.885712+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:49.931935+0000","last_change":"2024-09-12T22:13:49.931964+0000","last_active":"2024-09-12T22:13:49.931935+0000","last_peered":"2024-09-12T22:13:49.931935+0000","last_clean":"2024-09-12T22:13:49.931935+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:49.931935+0000","last_undegraded":"2024-09-12T22:13:49.931935+0000","last_fullsized":"2024-09-12T22:13:49.931935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:49.931837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:49.931837+0000","last_clean_scrub_stamp":"2024-09-12T22:13:49.931837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:53.003810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":510,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:39.144935+0000","last_change":"2024-09-12T22:13:39.144962+0000","last_active":"2024-09-12T22:13:39.144935+0000","last_peered":"2024-09-12T22:13:39.144935+0000","last_clean":"2024-09-12T22:13:39.144935+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:39.144935+0000","last_undegraded":"2024-09-12T22:13:39.144935+0000","last_fullsized":"2024-09-12T22:13:39.144935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'372","last_scrub_stamp":"2024-09-12T22:13:39.144832+0000","last_deep_scrub":"58'372","last_deep_scrub_stamp":"2024-09-12T22:13:39.144832+0000","last_clean_scrub_stamp":"2024-09-12T22:13:39.144832+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:29.485332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.010725+0000","last_change":"2024-09-12T22:13:35.010725+0000","last_active":"2024-09-12T22:13:35.010725+0000","last_peered":"2024-09-12T22:13:35.010725+0000","last_clean":"2024-09-12T22:13:35.010725+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:35.010725+0000","last_undegraded":"2024-09-12T22:13:35.010725+0000","last_fullsized":"2024-09-12T22:13:35.010725+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-09-12T22:13:35.010613+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-09-12T22:13:35.010613+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.010613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:52.144717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.002097+0000","last_change":"2024-09-12T22:13:58.002120+0000","last_active":"2024-09-12T22:13:58.002097+0000","last_peered":"2024-09-12T22:13:58.002097+0000","last_clean":"2024-09-12T22:13:58.002097+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:58.002097+0000","last_undegraded":"2024-09-12T22:13:58.002097+0000","last_fullsized":"2024-09-12T22:13:58.002097+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:58.002014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:58.002014+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.002014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:42.862328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.069891+0000","last_change":"2024-09-12T22:13:46.069920+0000","last_active":"2024-09-12T22:13:46.069891+0000","last_peered":"2024-09-12T22:13:46.069891+0000","last_clean":"2024-09-12T22:13:46.069891+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:46.069891+0000","last_undegraded":"2024-09-12T22:13:46.069891+0000","last_fullsized":"2024-09-12T22:13:46.069891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'406","last_scrub_stamp":"2024-09-12T22:13:46.069789+0000","last_deep_scrub":"58'406","last_deep_scrub_stamp":"2024-09-12T22:13:46.069789+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.069789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.437775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'66","reported_seq":225,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.025587+0000","last_change":"2024-09-12T22:13:36.025587+0000","last_active":"2024-09-12T22:13:36.025587+0000","last_peered":"2024-09-12T22:13:36.025587+0000","last_clean":"2024-09-12T22:13:36.025587+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:36.025587+0000","last_undegraded":"2024-09-12T22:13:36.025587+0000","last_fullsized":"2024-09-12T22:13:36.025587+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'66","last_scrub_stamp":"2024-09-12T22:13:36.025461+0000","last_deep_scrub":"82'66","last_deep_scrub_stamp":"2024-09-12T22:13:36.025461+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.025461+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.455807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:33.005647+0000","last_change":"2024-09-12T22:13:33.005647+0000","last_active":"2024-09-12T22:13:33.005647+0000","last_peered":"2024-09-12T22:13:33.005647+0000","last_clean":"2024-09-12T22:13:33.005647+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:33.005647+0000","last_undegraded":"2024-09-12T22:13:33.005647+0000","last_fullsized":"2024-09-12T22:13:33.005647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:33.005510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:33.005510+0000","last_clean_scrub_stamp":"2024-09-12T22:13:33.005510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:48.395884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":576,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.979103+0000","last_change":"2024-09-12T22:13:36.979103+0000","last_active":"2024-09-12T22:13:36.979103+0000","last_peered":"2024-09-12T22:13:36.979103+0000","last_clean":"2024-09-12T22:13:36.979103+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:36.979103+0000","last_undegraded":"2024-09-12T22:13:36.979103+0000","last_fullsized":"2024-09-12T22:13:36.979103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'408","last_scrub_stamp":"2024-09-12T22:13:36.978977+0000","last_deep_scrub":"58'408","last_deep_scrub_stamp":"2024-09-12T22:13:36.978977+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.978977+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:06.536023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'108","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:45.070640+0000","last_change":"2024-09-12T22:13:45.070669+0000","last_active":"2024-09-12T22:13:45.070640+0000","last_peered":"2024-09-12T22:13:45.070640+0000","last_clean":"2024-09-12T22:13:45.070640+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:45.070640+0000","last_undegraded":"2024-09-12T22:13:45.070640+0000","last_fullsized":"2024-09-12T22:13:45.070640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'108","last_scrub_stamp":"2024-09-12T22:13:45.070538+0000","last_deep_scrub":"82'108","last_deep_scrub_stamp":"2024-09-12T22:13:45.070538+0000","last_clean_scrub_stamp":"2024-09-12T22:13:45.070538+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:00.212543+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.934647+0000","last_change":"2024-09-12T22:13:47.934647+0000","last_active":"2024-09-12T22:13:47.934647+0000","last_peered":"2024-09-12T22:13:47.934647+0000","last_clean":"2024-09-12T22:13:47.934647+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:47.934647+0000","last_undegraded":"2024-09-12T22:13:47.934647+0000","last_fullsized":"2024-09-12T22:13:47.934647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:47.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:47.934524+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:15.934835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":683,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.141956+0000","last_change":"2024-09-12T22:13:43.141980+0000","last_active":"2024-09-12T22:13:43.141956+0000","last_peered":"2024-09-12T22:13:43.141956+0000","last_clean":"2024-09-12T22:13:43.141956+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:43.141956+0000","last_undegraded":"2024-09-12T22:13:43.141956+0000","last_fullsized":"2024-09-12T22:13:43.141956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'440","last_scrub_stamp":"2024-09-12T22:13:43.141854+0000","last_deep_scrub":"58'440","last_deep_scrub_stamp":"2024-09-12T22:13:43.141854+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.141854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:35.490113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":915,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.844457+0000","last_change":"2024-09-12T22:13:35.844505+0000","last_active":"2024-09-12T22:13:35.844457+0000","last_peered":"2024-09-12T22:13:35.844457+0000","last_clean":"2024-09-12T22:13:35.844457+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:35.844457+0000","last_undegraded":"2024-09-12T22:13:35.844457+0000","last_fullsized":"2024-09-12T22:13:35.844457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:35.844355+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:35.844355+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.844355+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:53.301642+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"82'288","reported_seq":456,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:01.933315+0000","last_change":"2024-09-12T22:14:01.933352+0000","last_active":"2024-09-12T22:14:01.933315+0000","last_peered":"2024-09-12T22:14:01.933315+0000","last_clean":"2024-09-12T22:14:01.933315+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:14:01.933315+0000","last_undegraded":"2024-09-12T22:14:01.933315+0000","last_fullsized":"2024-09-12T22:14:01.933315+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'288","last_scrub_stamp":"2024-09-12T22:14:01.933217+0000","last_deep_scrub":"82'288","last_deep_scrub_stamp":"2024-09-12T22:14:01.933217+0000","last_clean_scrub_stamp":"2024-09-12T22:14:01.933217+0000","objects_scrubbed":5,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:51:06.639550+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1033,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.989357+0000","last_change":"2024-09-12T22:13:55.989386+0000","last_active":"2024-09-12T22:13:55.989357+0000","last_peered":"2024-09-12T22:13:55.989357+0000","last_clean":"2024-09-12T22:13:55.989357+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:55.989357+0000","last_undegraded":"2024-09-12T22:13:55.989357+0000","last_fullsized":"2024-09-12T22:13:55.989357+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'447","last_scrub_stamp":"2024-09-12T22:13:55.989230+0000","last_deep_scrub":"58'447","last_deep_scrub_stamp":"2024-09-12T22:13:55.989230+0000","last_clean_scrub_stamp":"2024-09-12T22:13:55.989230+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:02.845340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"82'84","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.957710+0000","last_change":"2024-09-12T22:13:58.957747+0000","last_active":"2024-09-12T22:13:58.957710+0000","last_peered":"2024-09-12T22:13:58.957710+0000","last_clean":"2024-09-12T22:13:58.957710+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:58.957710+0000","last_undegraded":"2024-09-12T22:13:58.957710+0000","last_fullsized":"2024-09-12T22:13:58.957710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'84","last_scrub_stamp":"2024-09-12T22:13:58.957616+0000","last_deep_scrub":"82'84","last_deep_scrub_stamp":"2024-09-12T22:13:58.957616+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.957616+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:41.133914+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"82'216","reported_seq":337,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:02.908503+0000","last_change":"2024-09-12T22:14:02.908533+0000","last_active":"2024-09-12T22:14:02.908503+0000","last_peered":"2024-09-12T22:14:02.908503+0000","last_clean":"2024-09-12T22:14:02.908503+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:14:02.908503+0000","last_undegraded":"2024-09-12T22:14:02.908503+0000","last_fullsized":"2024-09-12T22:14:02.908503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'216","last_scrub_stamp":"2024-09-12T22:14:02.908416+0000","last_deep_scrub":"82'216","last_deep_scrub_stamp":"2024-09-12T22:14:02.908416+0000","last_clean_scrub_stamp":"2024-09-12T22:14:02.908416+0000","objects_scrubbed":1,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:10.310346+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":697,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.972230+0000","last_change":"2024-09-12T22:13:42.972255+0000","last_active":"2024-09-12T22:13:42.972230+0000","last_peered":"2024-09-12T22:13:42.972230+0000","last_clean":"2024-09-12T22:13:42.972230+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:42.972230+0000","last_undegraded":"2024-09-12T22:13:42.972230+0000","last_fullsized":"2024-09-12T22:13:42.972230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'487","last_scrub_stamp":"2024-09-12T22:13:42.972138+0000","last_deep_scrub":"58'487","last_deep_scrub_stamp":"2024-09-12T22:13:42.972138+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.972138+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.418432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:50.984939+0000","last_change":"2024-09-12T22:13:50.984969+0000","last_active":"2024-09-12T22:13:50.984939+0000","last_peered":"2024-09-12T22:13:50.984939+0000","last_clean":"2024-09-12T22:13:50.984939+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:50.984939+0000","last_undegraded":"2024-09-12T22:13:50.984939+0000","last_fullsized":"2024-09-12T22:13:50.984939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'51","last_scrub_stamp":"2024-09-12T22:13:50.984833+0000","last_deep_scrub":"58'51","last_deep_scrub_stamp":"2024-09-12T22:13:50.984833+0000","last_clean_scrub_stamp":"2024-09-12T22:13:50.984833+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:34.570531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1029,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:03.039007+0000","last_change":"2024-09-12T22:14:03.039047+0000","last_active":"2024-09-12T22:14:03.039007+0000","last_peered":"2024-09-12T22:14:03.039007+0000","last_clean":"2024-09-12T22:14:03.039007+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:14:03.039007+0000","last_undegraded":"2024-09-12T22:14:03.039007+0000","last_fullsized":"2024-09-12T22:14:03.039007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'431","last_scrub_stamp":"2024-09-12T22:14:03.038897+0000","last_deep_scrub":"58'431","last_deep_scrub_stamp":"2024-09-12T22:14:03.038897+0000","last_clean_scrub_stamp":"2024-09-12T22:14:03.038897+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:46.102394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:52.058769+0000","last_change":"2024-09-12T22:13:52.058797+0000","last_active":"2024-09-12T22:13:52.058769+0000","last_peered":"2024-09-12T22:13:52.058769+0000","last_clean":"2024-09-12T22:13:52.058769+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:52.058769+0000","last_undegraded":"2024-09-12T22:13:52.058769+0000","last_fullsized":"2024-09-12T22:13:52.058769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'365","last_scrub_stamp":"2024-09-12T22:13:52.058669+0000","last_deep_scrub":"58'365","last_deep_scrub_stamp":"2024-09-12T22:13:52.058669+0000","last_clean_scrub_stamp":"2024-09-12T22:13:52.058669+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:25.253113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"82'768","reported_seq":933,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.027568+0000","last_change":"2024-09-12T22:13:40.027596+0000","last_active":"2024-09-12T22:13:40.027568+0000","last_peered":"2024-09-12T22:13:40.027568+0000","last_clean":"2024-09-12T22:13:40.027568+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:40.027568+0000","last_undegraded":"2024-09-12T22:13:40.027568+0000","last_fullsized":"2024-09-12T22:13:40.027568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'768","last_scrub_stamp":"2024-09-12T22:13:40.027467+0000","last_deep_scrub":"82'768","last_deep_scrub_stamp":"2024-09-12T22:13:40.027467+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.027467+0000","objects_scrubbed":2,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.189190+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":589,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.987436+0000","last_change":"2024-09-12T22:13:40.987436+0000","last_active":"2024-09-12T22:13:40.987436+0000","last_peered":"2024-09-12T22:13:40.987436+0000","last_clean":"2024-09-12T22:13:40.987436+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:40.987436+0000","last_undegraded":"2024-09-12T22:13:40.987436+0000","last_fullsized":"2024-09-12T22:13:40.987436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'414","last_scrub_stamp":"2024-09-12T22:13:40.987282+0000","last_deep_scrub":"58'414","last_deep_scrub_stamp":"2024-09-12T22:13:40.987282+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.987282+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:48.266861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"82'186","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.018245+0000","last_change":"2024-09-12T22:13:48.018272+0000","last_active":"2024-09-12T22:13:48.018245+0000","last_peered":"2024-09-12T22:13:48.018245+0000","last_clean":"2024-09-12T22:13:48.018245+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:48.018245+0000","last_undegraded":"2024-09-12T22:13:48.018245+0000","last_fullsized":"2024-09-12T22:13:48.018245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'186","last_scrub_stamp":"2024-09-12T22:13:48.018162+0000","last_deep_scrub":"82'186","last_deep_scrub_stamp":"2024-09-12T22:13:48.018162+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.018162+0000","objects_scrubbed":1,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:57.556686+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":532,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:07.848986+0000","last_change":"2024-09-12T22:14:07.849037+0000","last_active":"2024-09-12T22:14:07.848986+0000","last_peered":"2024-09-12T22:14:07.848986+0000","last_clean":"2024-09-12T22:14:07.848986+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:14:07.848986+0000","last_undegraded":"2024-09-12T22:14:07.848986+0000","last_fullsized":"2024-09-12T22:14:07.848986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'392","last_scrub_stamp":"2024-09-12T22:14:07.848852+0000","last_deep_scrub":"58'392","last_deep_scrub_stamp":"2024-09-12T22:14:07.848852+0000","last_clean_scrub_stamp":"2024-09-12T22:14:07.848852+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:08.761904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"82'174","reported_seq":295,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.072439+0000","last_change":"2024-09-12T22:13:55.072469+0000","last_active":"2024-09-12T22:13:55.072439+0000","last_peered":"2024-09-12T22:13:55.072439+0000","last_clean":"2024-09-12T22:13:55.072439+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:55.072439+0000","last_undegraded":"2024-09-12T22:13:55.072439+0000","last_fullsized":"2024-09-12T22:13:55.072439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'174","last_scrub_stamp":"2024-09-12T22:13:55.072318+0000","last_deep_scrub":"82'174","last_deep_scrub_stamp":"2024-09-12T22:13:55.072318+0000","last_clean_scrub_stamp":"2024-09-12T22:13:55.072318+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:03.849386+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":542,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.137632+0000","last_change":"2024-09-12T22:13:41.137659+0000","last_active":"2024-09-12T22:13:41.137632+0000","last_peered":"2024-09-12T22:13:41.137632+0000","last_clean":"2024-09-12T22:13:41.137632+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:41.137632+0000","last_undegraded":"2024-09-12T22:13:41.137632+0000","last_fullsized":"2024-09-12T22:13:41.137632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:41.137508+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:41.137508+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.137508+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:34.388869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"82'59","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:00.939573+0000","last_change":"2024-09-12T22:14:00.939616+0000","last_active":"2024-09-12T22:14:00.939573+0000","last_peered":"2024-09-12T22:14:00.939573+0000","last_clean":"2024-09-12T22:14:00.939573+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:14:00.939573+0000","last_undegraded":"2024-09-12T22:14:00.939573+0000","last_fullsized":"2024-09-12T22:14:00.939573+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'59","last_scrub_stamp":"2024-09-12T22:14:00.939473+0000","last_deep_scrub":"82'59","last_deep_scrub_stamp":"2024-09-12T22:14:00.939473+0000","last_clean_scrub_stamp":"2024-09-12T22:14:00.939473+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:12.129160+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":536,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:50.885892+0000","last_change":"2024-09-12T22:13:50.885924+0000","last_active":"2024-09-12T22:13:50.885892+0000","last_peered":"2024-09-12T22:13:50.885892+0000","last_clean":"2024-09-12T22:13:50.885892+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:50.885892+0000","last_undegraded":"2024-09-12T22:13:50.885892+0000","last_fullsized":"2024-09-12T22:13:50.885892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'373","last_scrub_stamp":"2024-09-12T22:13:50.885761+0000","last_deep_scrub":"58'373","last_deep_scrub_stamp":"2024-09-12T22:13:50.885761+0000","last_clean_scrub_stamp":"2024-09-12T22:13:50.885761+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:34.282113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'189","reported_seq":339,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:57.885858+0000","last_change":"2024-09-12T22:13:57.885910+0000","last_active":"2024-09-12T22:13:57.885858+0000","last_peered":"2024-09-12T22:13:57.885858+0000","last_clean":"2024-09-12T22:13:57.885858+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:57.885858+0000","last_undegraded":"2024-09-12T22:13:57.885858+0000","last_fullsized":"2024-09-12T22:13:57.885858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'189","last_scrub_stamp":"2024-09-12T22:13:57.885742+0000","last_deep_scrub":"82'189","last_deep_scrub_stamp":"2024-09-12T22:13:57.885742+0000","last_clean_scrub_stamp":"2024-09-12T22:13:57.885742+0000","objects_scrubbed":2,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:35.926791+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":903,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:05.935666+0000","last_change":"2024-09-12T22:14:05.935694+0000","last_active":"2024-09-12T22:14:05.935666+0000","last_peered":"2024-09-12T22:14:05.935666+0000","last_clean":"2024-09-12T22:14:05.935666+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:14:05.935666+0000","last_undegraded":"2024-09-12T22:14:05.935666+0000","last_fullsized":"2024-09-12T22:14:05.935666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'381","last_scrub_stamp":"2024-09-12T22:14:05.935560+0000","last_deep_scrub":"58'381","last_deep_scrub_stamp":"2024-09-12T22:14:05.935560+0000","last_clean_scrub_stamp":"2024-09-12T22:14:05.935560+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:56.989426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"82'191","reported_seq":321,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:01.970095+0000","last_change":"2024-09-12T22:14:01.970141+0000","last_active":"2024-09-12T22:14:01.970095+0000","last_peered":"2024-09-12T22:14:01.970095+0000","last_clean":"2024-09-12T22:14:01.970095+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:14:01.970095+0000","last_undegraded":"2024-09-12T22:14:01.970095+0000","last_fullsized":"2024-09-12T22:14:01.970095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'191","last_scrub_stamp":"2024-09-12T22:14:01.970019+0000","last_deep_scrub":"82'191","last_deep_scrub_stamp":"2024-09-12T22:14:01.970019+0000","last_clean_scrub_stamp":"2024-09-12T22:14:01.970019+0000","objects_scrubbed":4,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:43.785802+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:54.064211+0000","last_change":"2024-09-12T22:13:54.064237+0000","last_active":"2024-09-12T22:13:54.064211+0000","last_peered":"2024-09-12T22:13:54.064211+0000","last_clean":"2024-09-12T22:13:54.064211+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:54.064211+0000","last_undegraded":"2024-09-12T22:13:54.064211+0000","last_fullsized":"2024-09-12T22:13:54.064211+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'443","last_scrub_stamp":"2024-09-12T22:13:54.064086+0000","last_deep_scrub":"58'443","last_deep_scrub_stamp":"2024-09-12T22:13:54.064086+0000","last_clean_scrub_stamp":"2024-09-12T22:13:54.064086+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:09.958311+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"82'59","reported_seq":222,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.998257+0000","last_change":"2024-09-12T22:13:37.998257+0000","last_active":"2024-09-12T22:13:37.998257+0000","last_peered":"2024-09-12T22:13:37.998257+0000","last_clean":"2024-09-12T22:13:37.998257+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:37.998257+0000","last_undegraded":"2024-09-12T22:13:37.998257+0000","last_fullsized":"2024-09-12T22:13:37.998257+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'59","last_scrub_stamp":"2024-09-12T22:13:37.998147+0000","last_deep_scrub":"82'59","last_deep_scrub_stamp":"2024-09-12T22:13:37.998147+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.998147+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.371726+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.916962+0000","last_change":"2024-09-12T22:13:48.917018+0000","last_active":"2024-09-12T22:13:48.916962+0000","last_peered":"2024-09-12T22:13:48.916962+0000","last_clean":"2024-09-12T22:13:48.916962+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:48.916962+0000","last_undegraded":"2024-09-12T22:13:48.916962+0000","last_fullsized":"2024-09-12T22:13:48.916962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'460","last_scrub_stamp":"2024-09-12T22:13:48.916859+0000","last_deep_scrub":"58'460","last_deep_scrub_stamp":"2024-09-12T22:13:48.916859+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.916859+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:36.542559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'114","reported_seq":265,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.991494+0000","last_change":"2024-09-12T22:13:48.991494+0000","last_active":"2024-09-12T22:13:48.991494+0000","last_peered":"2024-09-12T22:13:48.991494+0000","last_clean":"2024-09-12T22:13:48.991494+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:48.991494+0000","last_undegraded":"2024-09-12T22:13:48.991494+0000","last_fullsized":"2024-09-12T22:13:48.991494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'114","last_scrub_stamp":"2024-09-12T22:13:48.991378+0000","last_deep_scrub":"82'114","last_deep_scrub_stamp":"2024-09-12T22:13:48.991378+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.991378+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:16.999908+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6327,"ondisk_log_size":6327,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906959,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76820,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295020,"statfs":{"total":96636764160,"available":96558100480,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114656,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257184,"statfs":{"total":96636764160,"available":96519356416,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118484,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253356,"statfs":{"total":96636764160,"available":96515436544,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:14:14.371 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:09:49.932788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=13, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:14:14.372 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:14:34.373 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:14:34.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:14:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:14:34.693 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-12T22:14:33.144653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127842362,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2902,"num_read_kb":1404515,"num_write":29193,"num_write_kb":4469534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7762,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33123,"ondisk_log_size":33123,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":309960,"kb_used_data":73048,"kb_used_omap":9,"kb_used_meta":236854,"kb_avail":282805560,"statfs":{"total":289910292480,"available":289592893440,"internally_reserved":0,"allocated":74801152,"data_stored":256774981,"data_compressed":40049127,"data_compressed_allocated":49991680,"data_compressed_original":233611264,"omap_allocated":9228,"internal_metadata":242539508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003261"},"pg_stats":[{"pgid":"4.3f","version":"58'434","reported_seq":586,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:09.799390+0000","last_change":"2024-09-12T22:14:09.799429+0000","last_active":"2024-09-12T22:14:09.799390+0000","last_peered":"2024-09-12T22:14:09.799390+0000","last_clean":"2024-09-12T22:14:09.799390+0000","last_became_active":"2024-09-12T22:13:23.779370+0000","last_became_peered":"2024-09-12T22:13:23.779370+0000","last_unstale":"2024-09-12T22:14:09.799390+0000","last_undegraded":"2024-09-12T22:14:09.799390+0000","last_fullsized":"2024-09-12T22:14:09.799390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'434","last_scrub_stamp":"2024-09-12T22:14:09.799278+0000","last_deep_scrub":"58'434","last_deep_scrub_stamp":"2024-09-12T22:14:09.799278+0000","last_clean_scrub_stamp":"2024-09-12T22:14:09.799278+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:39.275505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23146,"num_write":397,"num_write_kb":92153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"58'392","reported_seq":539,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.176819+0000","last_change":"2024-09-12T22:13:40.176860+0000","last_active":"2024-09-12T22:13:40.176819+0000","last_peered":"2024-09-12T22:13:40.176819+0000","last_clean":"2024-09-12T22:13:40.176819+0000","last_became_active":"2024-09-12T22:13:11.754199+0000","last_became_peered":"2024-09-12T22:13:11.754199+0000","last_unstale":"2024-09-12T22:13:40.176819+0000","last_undegraded":"2024-09-12T22:13:40.176819+0000","last_fullsized":"2024-09-12T22:13:40.176819+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'392","last_scrub_stamp":"2024-09-12T22:13:40.176721+0000","last_deep_scrub":"58'392","last_deep_scrub_stamp":"2024-09-12T22:13:40.176721+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.176721+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:24.434920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":8961,"num_write":359,"num_write_kb":25767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'362","reported_seq":876,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:02.873702+0000","last_change":"2024-09-12T22:14:02.873702+0000","last_active":"2024-09-12T22:14:02.873702+0000","last_peered":"2024-09-12T22:14:02.873702+0000","last_clean":"2024-09-12T22:14:02.873702+0000","last_became_active":"2024-09-12T22:13:19.783234+0000","last_became_peered":"2024-09-12T22:13:19.783234+0000","last_unstale":"2024-09-12T22:14:02.873702+0000","last_undegraded":"2024-09-12T22:14:02.873702+0000","last_fullsized":"2024-09-12T22:14:02.873702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'362","last_scrub_stamp":"2024-09-12T22:14:02.873534+0000","last_deep_scrub":"58'362","last_deep_scrub_stamp":"2024-09-12T22:14:02.873534+0000","last_clean_scrub_stamp":"2024-09-12T22:14:02.873534+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:57:58.135025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15143,"num_write":335,"num_write_kb":30243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"58'417","reported_seq":609,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.883972+0000","last_change":"2024-09-12T22:13:37.883972+0000","last_active":"2024-09-12T22:13:37.883972+0000","last_peered":"2024-09-12T22:13:37.883972+0000","last_clean":"2024-09-12T22:13:37.883972+0000","last_became_active":"2024-09-12T22:09:50.969224+0000","last_became_peered":"2024-09-12T22:09:50.969224+0000","last_unstale":"2024-09-12T22:13:37.883972+0000","last_undegraded":"2024-09-12T22:13:37.883972+0000","last_fullsized":"2024-09-12T22:13:37.883972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'417","last_scrub_stamp":"2024-09-12T22:13:37.883848+0000","last_deep_scrub":"58'417","last_deep_scrub_stamp":"2024-09-12T22:13:37.883848+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.883848+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:33.029505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14690,"num_write":378,"num_write_kb":88667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"58'466","reported_seq":632,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.129647+0000","last_change":"2024-09-12T22:13:37.129694+0000","last_active":"2024-09-12T22:13:37.129647+0000","last_peered":"2024-09-12T22:13:37.129647+0000","last_clean":"2024-09-12T22:13:37.129647+0000","last_became_active":"2024-09-12T22:13:15.787394+0000","last_became_peered":"2024-09-12T22:13:15.787394+0000","last_unstale":"2024-09-12T22:13:37.129647+0000","last_undegraded":"2024-09-12T22:13:37.129647+0000","last_fullsized":"2024-09-12T22:13:37.129647+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'466","last_scrub_stamp":"2024-09-12T22:13:37.129556+0000","last_deep_scrub":"58'466","last_deep_scrub_stamp":"2024-09-12T22:13:37.129556+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.129556+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:21:13.730450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31780,"num_write":440,"num_write_kb":129970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"58'393","reported_seq":605,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.910215+0000","last_change":"2024-09-12T22:13:40.910269+0000","last_active":"2024-09-12T22:13:40.910215+0000","last_peered":"2024-09-12T22:13:40.910215+0000","last_clean":"2024-09-12T22:13:40.910215+0000","last_became_active":"2024-09-12T22:09:50.966302+0000","last_became_peered":"2024-09-12T22:09:50.966302+0000","last_unstale":"2024-09-12T22:13:40.910215+0000","last_undegraded":"2024-09-12T22:13:40.910215+0000","last_fullsized":"2024-09-12T22:13:40.910215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:40.910100+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:40.910100+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.910100+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:50.448625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":32533,"num_write":367,"num_write_kb":47160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"58'463","reported_seq":695,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:00.861595+0000","last_change":"2024-09-12T22:14:00.861623+0000","last_active":"2024-09-12T22:14:00.861595+0000","last_peered":"2024-09-12T22:14:00.861595+0000","last_clean":"2024-09-12T22:14:00.861595+0000","last_became_active":"2024-09-12T22:09:50.960128+0000","last_became_peered":"2024-09-12T22:09:50.960128+0000","last_unstale":"2024-09-12T22:14:00.861595+0000","last_undegraded":"2024-09-12T22:14:00.861595+0000","last_fullsized":"2024-09-12T22:14:00.861595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'463","last_scrub_stamp":"2024-09-12T22:14:00.861496+0000","last_deep_scrub":"58'463","last_deep_scrub_stamp":"2024-09-12T22:14:00.861496+0000","last_clean_scrub_stamp":"2024-09-12T22:14:00.861496+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:16.168986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":46611,"num_write":435,"num_write_kb":97294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"58'391","reported_seq":593,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:39.888993+0000","last_change":"2024-09-12T22:13:39.889019+0000","last_active":"2024-09-12T22:13:39.888993+0000","last_peered":"2024-09-12T22:13:39.888993+0000","last_clean":"2024-09-12T22:13:39.888993+0000","last_became_active":"2024-09-12T22:09:50.969307+0000","last_became_peered":"2024-09-12T22:09:50.969307+0000","last_unstale":"2024-09-12T22:13:39.888993+0000","last_undegraded":"2024-09-12T22:13:39.888993+0000","last_fullsized":"2024-09-12T22:13:39.888993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'391","last_scrub_stamp":"2024-09-12T22:13:39.888903+0000","last_deep_scrub":"58'391","last_deep_scrub_stamp":"2024-09-12T22:13:39.888903+0000","last_clean_scrub_stamp":"2024-09-12T22:13:39.888903+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:13.545009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28104,"num_write":357,"num_write_kb":80240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"58'422","reported_seq":991,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:59.041863+0000","last_change":"2024-09-12T22:13:59.041902+0000","last_active":"2024-09-12T22:13:59.041863+0000","last_peered":"2024-09-12T22:13:59.041863+0000","last_clean":"2024-09-12T22:13:59.041863+0000","last_became_active":"2024-09-12T22:13:19.788534+0000","last_became_peered":"2024-09-12T22:13:19.788534+0000","last_unstale":"2024-09-12T22:13:59.041863+0000","last_undegraded":"2024-09-12T22:13:59.041863+0000","last_fullsized":"2024-09-12T22:13:59.041863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'422","last_scrub_stamp":"2024-09-12T22:13:59.041757+0000","last_deep_scrub":"58'422","last_deep_scrub_stamp":"2024-09-12T22:13:59.041757+0000","last_clean_scrub_stamp":"2024-09-12T22:13:59.041757+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:41.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28734,"num_write":390,"num_write_kb":63185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'390","reported_seq":535,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:50.102416+0000","last_change":"2024-09-12T22:13:50.102445+0000","last_active":"2024-09-12T22:13:50.102416+0000","last_peered":"2024-09-12T22:13:50.102416+0000","last_clean":"2024-09-12T22:13:50.102416+0000","last_became_active":"2024-09-12T22:13:12.767582+0000","last_became_peered":"2024-09-12T22:13:12.767582+0000","last_unstale":"2024-09-12T22:13:50.102416+0000","last_undegraded":"2024-09-12T22:13:50.102416+0000","last_fullsized":"2024-09-12T22:13:50.102416+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'390","last_scrub_stamp":"2024-09-12T22:13:50.102311+0000","last_deep_scrub":"58'390","last_deep_scrub_stamp":"2024-09-12T22:13:50.102311+0000","last_clean_scrub_stamp":"2024-09-12T22:13:50.102311+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:49.935921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16822,"num_write":346,"num_write_kb":46287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"58'376","reported_seq":558,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:52.862064+0000","last_change":"2024-09-12T22:13:52.862091+0000","last_active":"2024-09-12T22:13:52.862064+0000","last_peered":"2024-09-12T22:13:52.862064+0000","last_clean":"2024-09-12T22:13:52.862064+0000","last_became_active":"2024-09-12T22:09:50.963001+0000","last_became_peered":"2024-09-12T22:09:50.963001+0000","last_unstale":"2024-09-12T22:13:52.862064+0000","last_undegraded":"2024-09-12T22:13:52.862064+0000","last_fullsized":"2024-09-12T22:13:52.862064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'376","last_scrub_stamp":"2024-09-12T22:13:52.861966+0000","last_deep_scrub":"58'376","last_deep_scrub_stamp":"2024-09-12T22:13:52.861966+0000","last_clean_scrub_stamp":"2024-09-12T22:13:52.861966+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:50.519796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":20815,"num_write":356,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"58'366","reported_seq":494,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.103406+0000","last_change":"2024-09-12T22:13:36.103433+0000","last_active":"2024-09-12T22:13:36.103406+0000","last_peered":"2024-09-12T22:13:36.103406+0000","last_clean":"2024-09-12T22:13:36.103406+0000","last_became_active":"2024-09-12T22:13:16.787935+0000","last_became_peered":"2024-09-12T22:13:16.787935+0000","last_unstale":"2024-09-12T22:13:36.103406+0000","last_undegraded":"2024-09-12T22:13:36.103406+0000","last_fullsized":"2024-09-12T22:13:36.103406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'366","last_scrub_stamp":"2024-09-12T22:13:36.103319+0000","last_deep_scrub":"58'366","last_deep_scrub_stamp":"2024-09-12T22:13:36.103319+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.103319+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:12.617873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12952,"num_write":341,"num_write_kb":66884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"58'435","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:03.921030+0000","last_change":"2024-09-12T22:14:03.921057+0000","last_active":"2024-09-12T22:14:03.921030+0000","last_peered":"2024-09-12T22:14:03.921030+0000","last_clean":"2024-09-12T22:14:03.921030+0000","last_became_active":"2024-09-12T22:13:14.779182+0000","last_became_peered":"2024-09-12T22:13:14.779182+0000","last_unstale":"2024-09-12T22:14:03.921030+0000","last_undegraded":"2024-09-12T22:14:03.921030+0000","last_fullsized":"2024-09-12T22:14:03.921030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'435","last_scrub_stamp":"2024-09-12T22:14:03.920937+0000","last_deep_scrub":"58'435","last_deep_scrub_stamp":"2024-09-12T22:14:03.920937+0000","last_clean_scrub_stamp":"2024-09-12T22:14:03.920937+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:20.943831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15962,"num_write":394,"num_write_kb":108272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"58'402","reported_seq":949,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:06.896087+0000","last_change":"2024-09-12T22:14:06.896119+0000","last_active":"2024-09-12T22:14:06.896087+0000","last_peered":"2024-09-12T22:14:06.896087+0000","last_clean":"2024-09-12T22:14:06.896087+0000","last_became_active":"2024-09-12T22:13:22.785664+0000","last_became_peered":"2024-09-12T22:13:22.785664+0000","last_unstale":"2024-09-12T22:14:06.896087+0000","last_undegraded":"2024-09-12T22:14:06.896087+0000","last_fullsized":"2024-09-12T22:14:06.896087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'402","last_scrub_stamp":"2024-09-12T22:14:06.895977+0000","last_deep_scrub":"58'402","last_deep_scrub_stamp":"2024-09-12T22:14:06.895977+0000","last_clean_scrub_stamp":"2024-09-12T22:14:06.895977+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:01.293871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20503,"num_write":369,"num_write_kb":42405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'437","reported_seq":1048,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.799637+0000","last_change":"2024-09-12T22:13:34.799663+0000","last_active":"2024-09-12T22:13:34.799637+0000","last_peered":"2024-09-12T22:13:34.799637+0000","last_clean":"2024-09-12T22:13:34.799637+0000","last_became_active":"2024-09-12T22:13:11.753962+0000","last_became_peered":"2024-09-12T22:13:11.753962+0000","last_unstale":"2024-09-12T22:13:34.799637+0000","last_undegraded":"2024-09-12T22:13:34.799637+0000","last_fullsized":"2024-09-12T22:13:34.799637+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'437","last_scrub_stamp":"2024-09-12T22:13:34.799532+0000","last_deep_scrub":"58'437","last_deep_scrub_stamp":"2024-09-12T22:13:34.799532+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.799532+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:12.788366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44125,"num_write":400,"num_write_kb":88147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"58'438","reported_seq":633,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.950391+0000","last_change":"2024-09-12T22:13:44.950422+0000","last_active":"2024-09-12T22:13:44.950391+0000","last_peered":"2024-09-12T22:13:44.950391+0000","last_clean":"2024-09-12T22:13:44.950391+0000","last_became_active":"2024-09-12T22:09:50.964845+0000","last_became_peered":"2024-09-12T22:09:50.964845+0000","last_unstale":"2024-09-12T22:13:44.950391+0000","last_undegraded":"2024-09-12T22:13:44.950391+0000","last_fullsized":"2024-09-12T22:13:44.950391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'438","last_scrub_stamp":"2024-09-12T22:13:44.950299+0000","last_deep_scrub":"58'438","last_deep_scrub_stamp":"2024-09-12T22:13:44.950299+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.950299+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:03.773639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28647,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"58'403","reported_seq":948,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:02.025526+0000","last_change":"2024-09-12T22:14:02.025554+0000","last_active":"2024-09-12T22:14:02.025526+0000","last_peered":"2024-09-12T22:14:02.025526+0000","last_clean":"2024-09-12T22:14:02.025526+0000","last_became_active":"2024-09-12T22:13:21.783370+0000","last_became_peered":"2024-09-12T22:13:21.783370+0000","last_unstale":"2024-09-12T22:14:02.025526+0000","last_undegraded":"2024-09-12T22:14:02.025526+0000","last_fullsized":"2024-09-12T22:14:02.025526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'403","last_scrub_stamp":"2024-09-12T22:14:02.025421+0000","last_deep_scrub":"58'403","last_deep_scrub_stamp":"2024-09-12T22:14:02.025421+0000","last_clean_scrub_stamp":"2024-09-12T22:14:02.025421+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:50.006157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11160,"num_write":366,"num_write_kb":29798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'402","reported_seq":542,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:06.861119+0000","last_change":"2024-09-12T22:14:06.861185+0000","last_active":"2024-09-12T22:14:06.861119+0000","last_peered":"2024-09-12T22:14:06.861119+0000","last_clean":"2024-09-12T22:14:06.861119+0000","last_became_active":"2024-09-12T22:13:18.782749+0000","last_became_peered":"2024-09-12T22:13:18.782749+0000","last_unstale":"2024-09-12T22:14:06.861119+0000","last_undegraded":"2024-09-12T22:14:06.861119+0000","last_fullsized":"2024-09-12T22:14:06.861119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'402","last_scrub_stamp":"2024-09-12T22:14:06.861002+0000","last_deep_scrub":"58'402","last_deep_scrub_stamp":"2024-09-12T22:14:06.861002+0000","last_clean_scrub_stamp":"2024-09-12T22:14:06.861002+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:58.997007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":12162,"num_write":364,"num_write_kb":58860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"58'423","reported_seq":986,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:56.988463+0000","last_change":"2024-09-12T22:13:56.988463+0000","last_active":"2024-09-12T22:13:56.988463+0000","last_peered":"2024-09-12T22:13:56.988463+0000","last_clean":"2024-09-12T22:13:56.988463+0000","last_became_active":"2024-09-12T22:13:16.787947+0000","last_became_peered":"2024-09-12T22:13:16.787947+0000","last_unstale":"2024-09-12T22:13:56.988463+0000","last_undegraded":"2024-09-12T22:13:56.988463+0000","last_fullsized":"2024-09-12T22:13:56.988463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'423","last_scrub_stamp":"2024-09-12T22:13:56.988327+0000","last_deep_scrub":"58'423","last_deep_scrub_stamp":"2024-09-12T22:13:56.988327+0000","last_clean_scrub_stamp":"2024-09-12T22:13:56.988327+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:27.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31049,"num_write":373,"num_write_kb":59032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'442","reported_seq":627,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.961847+0000","last_change":"2024-09-12T22:13:46.961847+0000","last_active":"2024-09-12T22:13:46.961847+0000","last_peered":"2024-09-12T22:13:46.961847+0000","last_clean":"2024-09-12T22:13:46.961847+0000","last_became_active":"2024-09-12T22:09:50.964755+0000","last_became_peered":"2024-09-12T22:09:50.964755+0000","last_unstale":"2024-09-12T22:13:46.961847+0000","last_undegraded":"2024-09-12T22:13:46.961847+0000","last_fullsized":"2024-09-12T22:13:46.961847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'442","last_scrub_stamp":"2024-09-12T22:13:46.961715+0000","last_deep_scrub":"58'442","last_deep_scrub_stamp":"2024-09-12T22:13:46.961715+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.961715+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.371724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23621,"num_write":404,"num_write_kb":54704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"58'440","reported_seq":679,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.909206+0000","last_change":"2024-09-12T22:13:38.909206+0000","last_active":"2024-09-12T22:13:38.909206+0000","last_peered":"2024-09-12T22:13:38.909206+0000","last_clean":"2024-09-12T22:13:38.909206+0000","last_became_active":"2024-09-12T22:09:50.967400+0000","last_became_peered":"2024-09-12T22:09:50.967400+0000","last_unstale":"2024-09-12T22:13:38.909206+0000","last_undegraded":"2024-09-12T22:13:38.909206+0000","last_fullsized":"2024-09-12T22:13:38.909206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'440","last_scrub_stamp":"2024-09-12T22:13:38.909089+0000","last_deep_scrub":"58'440","last_deep_scrub_stamp":"2024-09-12T22:13:38.909089+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.909089+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:55.274195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45810,"num_write":410,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"58'443","reported_seq":612,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.101346+0000","last_change":"2024-09-12T22:13:35.101372+0000","last_active":"2024-09-12T22:13:35.101346+0000","last_peered":"2024-09-12T22:13:35.101346+0000","last_clean":"2024-09-12T22:13:35.101346+0000","last_became_active":"2024-09-12T22:13:16.787989+0000","last_became_peered":"2024-09-12T22:13:16.787989+0000","last_unstale":"2024-09-12T22:13:35.101346+0000","last_undegraded":"2024-09-12T22:13:35.101346+0000","last_fullsized":"2024-09-12T22:13:35.101346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'443","last_scrub_stamp":"2024-09-12T22:13:35.101256+0000","last_deep_scrub":"58'443","last_deep_scrub_stamp":"2024-09-12T22:13:35.101256+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.101256+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:14.463127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28334,"num_write":408,"num_write_kb":108403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"58'442","reported_seq":668,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.989836+0000","last_change":"2024-09-12T22:13:44.989836+0000","last_active":"2024-09-12T22:13:44.989836+0000","last_peered":"2024-09-12T22:13:44.989836+0000","last_clean":"2024-09-12T22:13:44.989836+0000","last_became_active":"2024-09-12T22:09:50.964137+0000","last_became_peered":"2024-09-12T22:09:50.964137+0000","last_unstale":"2024-09-12T22:13:44.989836+0000","last_undegraded":"2024-09-12T22:13:44.989836+0000","last_fullsized":"2024-09-12T22:13:44.989836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'442","last_scrub_stamp":"2024-09-12T22:13:44.989717+0000","last_deep_scrub":"58'442","last_deep_scrub_stamp":"2024-09-12T22:13:44.989717+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.989717+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:44.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40327,"num_write":413,"num_write_kb":92979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'448","reported_seq":575,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:08.807161+0000","last_change":"2024-09-12T22:14:08.807184+0000","last_active":"2024-09-12T22:14:08.807161+0000","last_peered":"2024-09-12T22:14:08.807161+0000","last_clean":"2024-09-12T22:14:08.807161+0000","last_became_active":"2024-09-12T22:13:21.783399+0000","last_became_peered":"2024-09-12T22:13:21.783399+0000","last_unstale":"2024-09-12T22:14:08.807161+0000","last_undegraded":"2024-09-12T22:14:08.807161+0000","last_fullsized":"2024-09-12T22:14:08.807161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'448","last_scrub_stamp":"2024-09-12T22:14:08.807091+0000","last_deep_scrub":"58'448","last_deep_scrub_stamp":"2024-09-12T22:14:08.807091+0000","last_clean_scrub_stamp":"2024-09-12T22:14:08.807091+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:18.057892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13118,"num_write":417,"num_write_kb":63099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"58'399","reported_seq":527,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.104721+0000","last_change":"2024-09-12T22:13:38.104758+0000","last_active":"2024-09-12T22:13:38.104721+0000","last_peered":"2024-09-12T22:13:38.104721+0000","last_clean":"2024-09-12T22:13:38.104721+0000","last_became_active":"2024-09-12T22:13:17.795717+0000","last_became_peered":"2024-09-12T22:13:17.795717+0000","last_unstale":"2024-09-12T22:13:38.104721+0000","last_undegraded":"2024-09-12T22:13:38.104721+0000","last_fullsized":"2024-09-12T22:13:38.104721+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'399","last_scrub_stamp":"2024-09-12T22:13:38.104628+0000","last_deep_scrub":"58'399","last_deep_scrub_stamp":"2024-09-12T22:13:38.104628+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.104628+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:32.552622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14227,"num_write":375,"num_write_kb":17494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"58'479","reported_seq":669,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.054181+0000","last_change":"2024-09-12T22:13:47.054181+0000","last_active":"2024-09-12T22:13:47.054181+0000","last_peered":"2024-09-12T22:13:47.054181+0000","last_clean":"2024-09-12T22:13:47.054181+0000","last_became_active":"2024-09-12T22:09:50.960679+0000","last_became_peered":"2024-09-12T22:09:50.960679+0000","last_unstale":"2024-09-12T22:13:47.054181+0000","last_undegraded":"2024-09-12T22:13:47.054181+0000","last_fullsized":"2024-09-12T22:13:47.054181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'479","last_scrub_stamp":"2024-09-12T22:13:47.054068+0000","last_deep_scrub":"58'479","last_deep_scrub_stamp":"2024-09-12T22:13:47.054068+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.054068+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:14.956452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":16261,"num_write":433,"num_write_kb":80355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'374","reported_seq":880,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:03.860371+0000","last_change":"2024-09-12T22:14:03.860371+0000","last_active":"2024-09-12T22:14:03.860371+0000","last_peered":"2024-09-12T22:14:03.860371+0000","last_clean":"2024-09-12T22:14:03.860371+0000","last_became_active":"2024-09-12T22:13:20.790914+0000","last_became_peered":"2024-09-12T22:13:20.790914+0000","last_unstale":"2024-09-12T22:14:03.860371+0000","last_undegraded":"2024-09-12T22:14:03.860371+0000","last_fullsized":"2024-09-12T22:14:03.860371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'374","last_scrub_stamp":"2024-09-12T22:14:03.860248+0000","last_deep_scrub":"58'374","last_deep_scrub_stamp":"2024-09-12T22:14:03.860248+0000","last_clean_scrub_stamp":"2024-09-12T22:14:03.860248+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:19.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3060,"num_write":343,"num_write_kb":21959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"58'393","reported_seq":554,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.156757+0000","last_change":"2024-09-12T22:13:42.156782+0000","last_active":"2024-09-12T22:13:42.156757+0000","last_peered":"2024-09-12T22:13:42.156757+0000","last_clean":"2024-09-12T22:13:42.156757+0000","last_became_active":"2024-09-12T22:13:11.753745+0000","last_became_peered":"2024-09-12T22:13:11.753745+0000","last_unstale":"2024-09-12T22:13:42.156757+0000","last_undegraded":"2024-09-12T22:13:42.156757+0000","last_fullsized":"2024-09-12T22:13:42.156757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:42.156667+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:42.156667+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.156667+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:55:35.039529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":23102,"num_write":366,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"58'410","reported_seq":989,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.003988+0000","last_change":"2024-09-12T22:13:58.003988+0000","last_active":"2024-09-12T22:13:58.003988+0000","last_peered":"2024-09-12T22:13:58.003988+0000","last_clean":"2024-09-12T22:13:58.003988+0000","last_became_active":"2024-09-12T22:13:17.795993+0000","last_became_peered":"2024-09-12T22:13:17.795993+0000","last_unstale":"2024-09-12T22:13:58.003988+0000","last_undegraded":"2024-09-12T22:13:58.003988+0000","last_fullsized":"2024-09-12T22:13:58.003988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'410","last_scrub_stamp":"2024-09-12T22:13:58.003819+0000","last_deep_scrub":"58'410","last_deep_scrub_stamp":"2024-09-12T22:13:58.003819+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.003819+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:39.296523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39434,"num_write":374,"num_write_kb":63412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'481","reported_seq":644,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:04.894778+0000","last_change":"2024-09-12T22:14:04.894804+0000","last_active":"2024-09-12T22:14:04.894778+0000","last_peered":"2024-09-12T22:14:04.894778+0000","last_clean":"2024-09-12T22:14:04.894778+0000","last_became_active":"2024-09-12T22:13:17.795716+0000","last_became_peered":"2024-09-12T22:13:17.795716+0000","last_unstale":"2024-09-12T22:14:04.894778+0000","last_undegraded":"2024-09-12T22:14:04.894778+0000","last_fullsized":"2024-09-12T22:14:04.894778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'481","last_scrub_stamp":"2024-09-12T22:14:04.894692+0000","last_deep_scrub":"58'481","last_deep_scrub_stamp":"2024-09-12T22:14:04.894692+0000","last_clean_scrub_stamp":"2024-09-12T22:14:04.894692+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:20.350858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":22903,"num_write":443,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"58'401","reported_seq":944,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.007095+0000","last_change":"2024-09-12T22:13:46.007095+0000","last_active":"2024-09-12T22:13:46.007095+0000","last_peered":"2024-09-12T22:13:46.007095+0000","last_clean":"2024-09-12T22:13:46.007095+0000","last_became_active":"2024-09-12T22:13:12.762838+0000","last_became_peered":"2024-09-12T22:13:12.762838+0000","last_unstale":"2024-09-12T22:13:46.007095+0000","last_undegraded":"2024-09-12T22:13:46.007095+0000","last_fullsized":"2024-09-12T22:13:46.007095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'401","last_scrub_stamp":"2024-09-12T22:13:46.006977+0000","last_deep_scrub":"58'401","last_deep_scrub_stamp":"2024-09-12T22:13:46.006977+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.006977+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:20:56.543008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7609,"num_write":367,"num_write_kb":21640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'436","reported_seq":1012,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:08.890964+0000","last_change":"2024-09-12T22:14:08.890992+0000","last_active":"2024-09-12T22:14:08.890964+0000","last_peered":"2024-09-12T22:14:08.890964+0000","last_clean":"2024-09-12T22:14:08.890964+0000","last_became_active":"2024-09-12T22:13:24.783622+0000","last_became_peered":"2024-09-12T22:13:24.783622+0000","last_unstale":"2024-09-12T22:14:08.890964+0000","last_undegraded":"2024-09-12T22:14:08.890964+0000","last_fullsized":"2024-09-12T22:14:08.890964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'436","last_scrub_stamp":"2024-09-12T22:14:08.890871+0000","last_deep_scrub":"58'436","last_deep_scrub_stamp":"2024-09-12T22:14:08.890871+0000","last_clean_scrub_stamp":"2024-09-12T22:14:08.890871+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:29.562262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24259,"num_write":407,"num_write_kb":64654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"58'407","reported_seq":569,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:44.105590+0000","last_change":"2024-09-12T22:13:44.105628+0000","last_active":"2024-09-12T22:13:44.105590+0000","last_peered":"2024-09-12T22:13:44.105590+0000","last_clean":"2024-09-12T22:13:44.105590+0000","last_became_active":"2024-09-12T22:13:11.753575+0000","last_became_peered":"2024-09-12T22:13:11.753575+0000","last_unstale":"2024-09-12T22:13:44.105590+0000","last_undegraded":"2024-09-12T22:13:44.105590+0000","last_fullsized":"2024-09-12T22:13:44.105590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'407","last_scrub_stamp":"2024-09-12T22:13:44.105503+0000","last_deep_scrub":"58'407","last_deep_scrub_stamp":"2024-09-12T22:13:44.105503+0000","last_clean_scrub_stamp":"2024-09-12T22:13:44.105503+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:57.987490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":15859,"num_write":376,"num_write_kb":88650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"82'315","reported_seq":466,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.879145+0000","last_change":"2024-09-12T22:13:58.879145+0000","last_active":"2024-09-12T22:13:58.879145+0000","last_peered":"2024-09-12T22:13:58.879145+0000","last_clean":"2024-09-12T22:13:58.879145+0000","last_became_active":"2024-09-12T22:09:49.950016+0000","last_became_peered":"2024-09-12T22:09:49.950016+0000","last_unstale":"2024-09-12T22:13:58.879145+0000","last_undegraded":"2024-09-12T22:13:58.879145+0000","last_fullsized":"2024-09-12T22:13:58.879145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'315","last_scrub_stamp":"2024-09-12T22:13:58.879008+0000","last_deep_scrub":"82'315","last_deep_scrub_stamp":"2024-09-12T22:13:58.879008+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.879008+0000","objects_scrubbed":4,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:31.895483+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"58'418","reported_seq":570,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.144324+0000","last_change":"2024-09-12T22:13:34.144346+0000","last_active":"2024-09-12T22:13:34.144324+0000","last_peered":"2024-09-12T22:13:34.144324+0000","last_clean":"2024-09-12T22:13:34.144324+0000","last_became_active":"2024-09-12T22:13:17.795726+0000","last_became_peered":"2024-09-12T22:13:17.795726+0000","last_unstale":"2024-09-12T22:13:34.144324+0000","last_undegraded":"2024-09-12T22:13:34.144324+0000","last_fullsized":"2024-09-12T22:13:34.144324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'418","last_scrub_stamp":"2024-09-12T22:13:34.144214+0000","last_deep_scrub":"58'418","last_deep_scrub_stamp":"2024-09-12T22:13:34.144214+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.144214+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:50.343272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":26270,"num_write":386,"num_write_kb":91657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'58","reported_seq":209,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.018963+0000","last_change":"2024-09-12T22:13:53.018963+0000","last_active":"2024-09-12T22:13:53.018963+0000","last_peered":"2024-09-12T22:13:53.018963+0000","last_clean":"2024-09-12T22:13:53.018963+0000","last_became_active":"2024-09-12T22:09:49.952907+0000","last_became_peered":"2024-09-12T22:09:49.952907+0000","last_unstale":"2024-09-12T22:13:53.018963+0000","last_undegraded":"2024-09-12T22:13:53.018963+0000","last_fullsized":"2024-09-12T22:13:53.018963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-09-12T22:13:53.018842+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-09-12T22:13:53.018842+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.018842+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:13.739594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'422","reported_seq":580,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:38.962974+0000","last_change":"2024-09-12T22:13:38.962999+0000","last_active":"2024-09-12T22:13:38.962974+0000","last_peered":"2024-09-12T22:13:38.962974+0000","last_clean":"2024-09-12T22:13:38.962974+0000","last_became_active":"2024-09-12T22:09:50.964216+0000","last_became_peered":"2024-09-12T22:09:50.964216+0000","last_unstale":"2024-09-12T22:13:38.962974+0000","last_undegraded":"2024-09-12T22:13:38.962974+0000","last_fullsized":"2024-09-12T22:13:38.962974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'422","last_scrub_stamp":"2024-09-12T22:13:38.962883+0000","last_deep_scrub":"58'422","last_deep_scrub_stamp":"2024-09-12T22:13:38.962883+0000","last_clean_scrub_stamp":"2024-09-12T22:13:38.962883+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:32.625470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4591,"num_write":388,"num_write_kb":38529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"58'58","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:57.046558+0000","last_change":"2024-09-12T22:13:57.046585+0000","last_active":"2024-09-12T22:13:57.046558+0000","last_peered":"2024-09-12T22:13:57.046558+0000","last_clean":"2024-09-12T22:13:57.046558+0000","last_became_active":"2024-09-12T22:13:07.745071+0000","last_became_peered":"2024-09-12T22:13:07.745071+0000","last_unstale":"2024-09-12T22:13:57.046558+0000","last_undegraded":"2024-09-12T22:13:57.046558+0000","last_fullsized":"2024-09-12T22:13:57.046558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-09-12T22:13:57.046465+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-09-12T22:13:57.046465+0000","last_clean_scrub_stamp":"2024-09-12T22:13:57.046465+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:27.694902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"58'398","reported_seq":580,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.991477+0000","last_change":"2024-09-12T22:13:53.991502+0000","last_active":"2024-09-12T22:13:53.991477+0000","last_peered":"2024-09-12T22:13:53.991477+0000","last_clean":"2024-09-12T22:13:53.991477+0000","last_became_active":"2024-09-12T22:09:50.960423+0000","last_became_peered":"2024-09-12T22:09:50.960423+0000","last_unstale":"2024-09-12T22:13:53.991477+0000","last_undegraded":"2024-09-12T22:13:53.991477+0000","last_fullsized":"2024-09-12T22:13:53.991477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'398","last_scrub_stamp":"2024-09-12T22:13:53.991361+0000","last_deep_scrub":"58'398","last_deep_scrub_stamp":"2024-09-12T22:13:53.991361+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.991361+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:21.991672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15069,"num_write":359,"num_write_kb":54958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"82'74","reported_seq":233,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:45.957271+0000","last_change":"2024-09-12T22:13:45.957271+0000","last_active":"2024-09-12T22:13:45.957271+0000","last_peered":"2024-09-12T22:13:45.957271+0000","last_clean":"2024-09-12T22:13:45.957271+0000","last_became_active":"2024-09-12T22:13:07.745458+0000","last_became_peered":"2024-09-12T22:13:07.745458+0000","last_unstale":"2024-09-12T22:13:45.957271+0000","last_undegraded":"2024-09-12T22:13:45.957271+0000","last_fullsized":"2024-09-12T22:13:45.957271+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'74","last_scrub_stamp":"2024-09-12T22:13:45.957125+0000","last_deep_scrub":"82'74","last_deep_scrub_stamp":"2024-09-12T22:13:45.957125+0000","last_clean_scrub_stamp":"2024-09-12T22:13:45.957125+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:01.987729+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'158","reported_seq":323,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:51.847858+0000","last_change":"2024-09-12T22:13:51.847858+0000","last_active":"2024-09-12T22:13:51.847858+0000","last_peered":"2024-09-12T22:13:51.847858+0000","last_clean":"2024-09-12T22:13:51.847858+0000","last_became_active":"2024-09-12T22:13:10.749899+0000","last_became_peered":"2024-09-12T22:13:10.749899+0000","last_unstale":"2024-09-12T22:13:51.847858+0000","last_undegraded":"2024-09-12T22:13:51.847858+0000","last_fullsized":"2024-09-12T22:13:51.847858+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'158","last_scrub_stamp":"2024-09-12T22:13:51.847695+0000","last_deep_scrub":"82'158","last_deep_scrub_stamp":"2024-09-12T22:13:51.847695+0000","last_clean_scrub_stamp":"2024-09-12T22:13:51.847695+0000","objects_scrubbed":2,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:31:17.316722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'403","reported_seq":539,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:05.899998+0000","last_change":"2024-09-12T22:14:05.900023+0000","last_active":"2024-09-12T22:14:05.899998+0000","last_peered":"2024-09-12T22:14:05.899998+0000","last_clean":"2024-09-12T22:14:05.899998+0000","last_became_active":"2024-09-12T22:13:18.781915+0000","last_became_peered":"2024-09-12T22:13:18.781915+0000","last_unstale":"2024-09-12T22:14:05.899998+0000","last_undegraded":"2024-09-12T22:14:05.899998+0000","last_fullsized":"2024-09-12T22:14:05.899998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'403","last_scrub_stamp":"2024-09-12T22:14:05.899906+0000","last_deep_scrub":"58'403","last_deep_scrub_stamp":"2024-09-12T22:14:05.899906+0000","last_clean_scrub_stamp":"2024-09-12T22:14:05.899906+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:38.808716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":16692,"num_write":366,"num_write_kb":30192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"82'219","reported_seq":349,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.108065+0000","last_change":"2024-09-12T22:13:47.108094+0000","last_active":"2024-09-12T22:13:47.108065+0000","last_peered":"2024-09-12T22:13:47.108065+0000","last_clean":"2024-09-12T22:13:47.108065+0000","last_became_active":"2024-09-12T22:13:10.749865+0000","last_became_peered":"2024-09-12T22:13:10.749865+0000","last_unstale":"2024-09-12T22:13:47.108065+0000","last_undegraded":"2024-09-12T22:13:47.108065+0000","last_fullsized":"2024-09-12T22:13:47.108065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'219","last_scrub_stamp":"2024-09-12T22:13:47.107987+0000","last_deep_scrub":"82'219","last_deep_scrub_stamp":"2024-09-12T22:13:47.107987+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.107987+0000","objects_scrubbed":2,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:21.893622+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'452","reported_seq":562,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:10.780510+0000","last_change":"2024-09-12T22:14:10.780535+0000","last_active":"2024-09-12T22:14:10.780510+0000","last_peered":"2024-09-12T22:14:10.780510+0000","last_clean":"2024-09-12T22:14:10.780510+0000","last_became_active":"2024-09-12T22:13:24.785653+0000","last_became_peered":"2024-09-12T22:13:24.785653+0000","last_unstale":"2024-09-12T22:14:10.780510+0000","last_undegraded":"2024-09-12T22:14:10.780510+0000","last_fullsized":"2024-09-12T22:14:10.780510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'452","last_scrub_stamp":"2024-09-12T22:14:10.780421+0000","last_deep_scrub":"58'452","last_deep_scrub_stamp":"2024-09-12T22:14:10.780421+0000","last_clean_scrub_stamp":"2024-09-12T22:14:10.780421+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:16.028886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":13679,"num_write":428,"num_write_kb":63939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'474","reported_seq":639,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.865505+0000","last_change":"2024-09-12T22:13:36.865505+0000","last_active":"2024-09-12T22:13:36.865505+0000","last_peered":"2024-09-12T22:13:36.865505+0000","last_clean":"2024-09-12T22:13:36.865505+0000","last_became_active":"2024-09-12T22:13:10.750144+0000","last_became_peered":"2024-09-12T22:13:10.750144+0000","last_unstale":"2024-09-12T22:13:36.865505+0000","last_undegraded":"2024-09-12T22:13:36.865505+0000","last_fullsized":"2024-09-12T22:13:36.865505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'474","last_scrub_stamp":"2024-09-12T22:13:36.865383+0000","last_deep_scrub":"82'474","last_deep_scrub_stamp":"2024-09-12T22:13:36.865383+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.865383+0000","objects_scrubbed":2,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.405625+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":4267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"58'437","reported_seq":603,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:59.907079+0000","last_change":"2024-09-12T22:13:59.907079+0000","last_active":"2024-09-12T22:13:59.907079+0000","last_peered":"2024-09-12T22:13:59.907079+0000","last_clean":"2024-09-12T22:13:59.907079+0000","last_became_active":"2024-09-12T22:09:50.959039+0000","last_became_peered":"2024-09-12T22:09:50.959039+0000","last_unstale":"2024-09-12T22:13:59.907079+0000","last_undegraded":"2024-09-12T22:13:59.907079+0000","last_fullsized":"2024-09-12T22:13:59.907079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'437","last_scrub_stamp":"2024-09-12T22:13:59.906891+0000","last_deep_scrub":"58'437","last_deep_scrub_stamp":"2024-09-12T22:13:59.906891+0000","last_clean_scrub_stamp":"2024-09-12T22:13:59.906891+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:48.953971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7149,"num_write":399,"num_write_kb":55340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"58'57","reported_seq":208,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:56.904365+0000","last_change":"2024-09-12T22:13:56.904365+0000","last_active":"2024-09-12T22:13:56.904365+0000","last_peered":"2024-09-12T22:13:56.904365+0000","last_clean":"2024-09-12T22:13:56.904365+0000","last_became_active":"2024-09-12T22:09:49.948528+0000","last_became_peered":"2024-09-12T22:09:49.948528+0000","last_unstale":"2024-09-12T22:13:56.904365+0000","last_undegraded":"2024-09-12T22:13:56.904365+0000","last_fullsized":"2024-09-12T22:13:56.904365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'57","last_scrub_stamp":"2024-09-12T22:13:56.904252+0000","last_deep_scrub":"58'57","last_deep_scrub_stamp":"2024-09-12T22:13:56.904252+0000","last_clean_scrub_stamp":"2024-09-12T22:13:56.904252+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:39.967749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'430","reported_seq":618,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.000072+0000","last_change":"2024-09-12T22:13:55.000072+0000","last_active":"2024-09-12T22:13:55.000072+0000","last_peered":"2024-09-12T22:13:55.000072+0000","last_clean":"2024-09-12T22:13:55.000072+0000","last_became_active":"2024-09-12T22:09:50.960481+0000","last_became_peered":"2024-09-12T22:09:50.960481+0000","last_unstale":"2024-09-12T22:13:55.000072+0000","last_undegraded":"2024-09-12T22:13:55.000072+0000","last_fullsized":"2024-09-12T22:13:55.000072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'430","last_scrub_stamp":"2024-09-12T22:13:54.999952+0000","last_deep_scrub":"58'430","last_deep_scrub_stamp":"2024-09-12T22:13:54.999952+0000","last_clean_scrub_stamp":"2024-09-12T22:13:54.999952+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:42.625652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18508,"num_write":395,"num_write_kb":62966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"82'174","reported_seq":325,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:51.985371+0000","last_change":"2024-09-12T22:13:51.985371+0000","last_active":"2024-09-12T22:13:51.985371+0000","last_peered":"2024-09-12T22:13:51.985371+0000","last_clean":"2024-09-12T22:13:51.985371+0000","last_became_active":"2024-09-12T22:09:49.952568+0000","last_became_peered":"2024-09-12T22:09:49.952568+0000","last_unstale":"2024-09-12T22:13:51.985371+0000","last_undegraded":"2024-09-12T22:13:51.985371+0000","last_fullsized":"2024-09-12T22:13:51.985371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'174","last_scrub_stamp":"2024-09-12T22:13:51.985259+0000","last_deep_scrub":"82'174","last_deep_scrub_stamp":"2024-09-12T22:13:51.985259+0000","last_clean_scrub_stamp":"2024-09-12T22:13:51.985259+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:10.808599+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":8246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'476","reported_seq":679,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.891634+0000","last_change":"2024-09-12T22:13:42.891634+0000","last_active":"2024-09-12T22:13:42.891634+0000","last_peered":"2024-09-12T22:13:42.891634+0000","last_clean":"2024-09-12T22:13:42.891634+0000","last_became_active":"2024-09-12T22:09:50.965451+0000","last_became_peered":"2024-09-12T22:09:50.965451+0000","last_unstale":"2024-09-12T22:13:42.891634+0000","last_undegraded":"2024-09-12T22:13:42.891634+0000","last_fullsized":"2024-09-12T22:13:42.891634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'476","last_scrub_stamp":"2024-09-12T22:13:42.891514+0000","last_deep_scrub":"58'476","last_deep_scrub_stamp":"2024-09-12T22:13:42.891514+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.891514+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:15.358329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29021,"num_write":446,"num_write_kb":100895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"82'110","reported_seq":231,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.050966+0000","last_change":"2024-09-12T22:13:53.050992+0000","last_active":"2024-09-12T22:13:53.050966+0000","last_peered":"2024-09-12T22:13:53.050966+0000","last_clean":"2024-09-12T22:13:53.050966+0000","last_became_active":"2024-09-12T22:13:10.748220+0000","last_became_peered":"2024-09-12T22:13:10.748220+0000","last_unstale":"2024-09-12T22:13:53.050966+0000","last_undegraded":"2024-09-12T22:13:53.050966+0000","last_fullsized":"2024-09-12T22:13:53.050966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'110","last_scrub_stamp":"2024-09-12T22:13:53.050829+0000","last_deep_scrub":"82'110","last_deep_scrub_stamp":"2024-09-12T22:13:53.050829+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.050829+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:53.361651+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"58'394","reported_seq":906,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:04.893235+0000","last_change":"2024-09-12T22:14:04.893235+0000","last_active":"2024-09-12T22:14:04.893235+0000","last_peered":"2024-09-12T22:14:04.893235+0000","last_clean":"2024-09-12T22:14:04.893235+0000","last_became_active":"2024-09-12T22:13:21.783570+0000","last_became_peered":"2024-09-12T22:13:21.783570+0000","last_unstale":"2024-09-12T22:14:04.893235+0000","last_undegraded":"2024-09-12T22:14:04.893235+0000","last_fullsized":"2024-09-12T22:14:04.893235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'394","last_scrub_stamp":"2024-09-12T22:14:04.893084+0000","last_deep_scrub":"58'394","last_deep_scrub_stamp":"2024-09-12T22:14:04.893084+0000","last_clean_scrub_stamp":"2024-09-12T22:14:04.893084+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:59.851858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":558,"num_write":361,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"58'56","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:56.037554+0000","last_change":"2024-09-12T22:13:56.037595+0000","last_active":"2024-09-12T22:13:56.037554+0000","last_peered":"2024-09-12T22:13:56.037554+0000","last_clean":"2024-09-12T22:13:56.037554+0000","last_became_active":"2024-09-12T22:13:07.744166+0000","last_became_peered":"2024-09-12T22:13:07.744166+0000","last_unstale":"2024-09-12T22:13:56.037554+0000","last_undegraded":"2024-09-12T22:13:56.037554+0000","last_fullsized":"2024-09-12T22:13:56.037554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'56","last_scrub_stamp":"2024-09-12T22:13:56.037424+0000","last_deep_scrub":"58'56","last_deep_scrub_stamp":"2024-09-12T22:13:56.037424+0000","last_clean_scrub_stamp":"2024-09-12T22:13:56.037424+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:12.803875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"58'358","reported_seq":851,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:33.805892+0000","last_change":"2024-09-12T22:13:33.805892+0000","last_active":"2024-09-12T22:13:33.805892+0000","last_peered":"2024-09-12T22:13:33.805892+0000","last_clean":"2024-09-12T22:13:33.805892+0000","last_became_active":"2024-09-12T22:13:12.767661+0000","last_became_peered":"2024-09-12T22:13:12.767661+0000","last_unstale":"2024-09-12T22:13:33.805892+0000","last_undegraded":"2024-09-12T22:13:33.805892+0000","last_fullsized":"2024-09-12T22:13:33.805892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'358","last_scrub_stamp":"2024-09-12T22:13:33.805719+0000","last_deep_scrub":"58'358","last_deep_scrub_stamp":"2024-09-12T22:13:33.805719+0000","last_clean_scrub_stamp":"2024-09-12T22:13:33.805719+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:53.477722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8793,"num_write":320,"num_write_kb":25698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"82'493","reported_seq":614,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:51.082228+0000","last_change":"2024-09-12T22:13:51.082257+0000","last_active":"2024-09-12T22:13:51.082228+0000","last_peered":"2024-09-12T22:13:51.082228+0000","last_clean":"2024-09-12T22:13:51.082228+0000","last_became_active":"2024-09-12T22:13:10.748364+0000","last_became_peered":"2024-09-12T22:13:10.748364+0000","last_unstale":"2024-09-12T22:13:51.082228+0000","last_undegraded":"2024-09-12T22:13:51.082228+0000","last_fullsized":"2024-09-12T22:13:51.082228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'493","last_scrub_stamp":"2024-09-12T22:13:51.082144+0000","last_deep_scrub":"82'493","last_deep_scrub_stamp":"2024-09-12T22:13:51.082144+0000","last_clean_scrub_stamp":"2024-09-12T22:13:51.082144+0000","objects_scrubbed":1,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:00.703129+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"58'414","reported_seq":986,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:00.070089+0000","last_change":"2024-09-12T22:14:00.070089+0000","last_active":"2024-09-12T22:14:00.070089+0000","last_peered":"2024-09-12T22:14:00.070089+0000","last_clean":"2024-09-12T22:14:00.070089+0000","last_became_active":"2024-09-12T22:13:19.788503+0000","last_became_peered":"2024-09-12T22:13:19.788503+0000","last_unstale":"2024-09-12T22:14:00.070089+0000","last_undegraded":"2024-09-12T22:14:00.070089+0000","last_fullsized":"2024-09-12T22:14:00.070089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'414","last_scrub_stamp":"2024-09-12T22:14:00.069947+0000","last_deep_scrub":"58'414","last_deep_scrub_stamp":"2024-09-12T22:14:00.069947+0000","last_clean_scrub_stamp":"2024-09-12T22:14:00.069947+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:16.680006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":45939,"num_write":377,"num_write_kb":108286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":370,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.928350+0000","last_change":"2024-09-12T22:13:43.928350+0000","last_active":"2024-09-12T22:13:43.928350+0000","last_peered":"2024-09-12T22:13:43.928350+0000","last_clean":"2024-09-12T22:13:43.928350+0000","last_became_active":"2024-09-12T22:13:07.743959+0000","last_became_peered":"2024-09-12T22:13:07.743959+0000","last_unstale":"2024-09-12T22:13:43.928350+0000","last_undegraded":"2024-09-12T22:13:43.928350+0000","last_fullsized":"2024-09-12T22:13:43.928350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-09-12T22:13:43.928152+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-09-12T22:13:43.928152+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.928152+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:04.652918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"82'2","reported_seq":166,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:54.883974+0000","last_change":"2024-09-12T22:13:54.883974+0000","last_active":"2024-09-12T22:13:54.883974+0000","last_peered":"2024-09-12T22:13:54.883974+0000","last_clean":"2024-09-12T22:13:54.883974+0000","last_became_active":"2024-09-12T22:09:45.815774+0000","last_became_peered":"2024-09-12T22:09:45.815774+0000","last_unstale":"2024-09-12T22:13:54.883974+0000","last_undegraded":"2024-09-12T22:13:54.883974+0000","last_fullsized":"2024-09-12T22:13:54.883974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-09-12T22:13:54.883844+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-09-12T22:13:54.883844+0000","last_clean_scrub_stamp":"2024-09-12T22:13:54.883844+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:21.032428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00071227300000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"82'610","reported_seq":776,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.977122+0000","last_change":"2024-09-12T22:13:41.977122+0000","last_active":"2024-09-12T22:13:41.977122+0000","last_peered":"2024-09-12T22:13:41.977122+0000","last_clean":"2024-09-12T22:13:41.977122+0000","last_became_active":"2024-09-12T22:13:10.748861+0000","last_became_peered":"2024-09-12T22:13:10.748861+0000","last_unstale":"2024-09-12T22:13:41.977122+0000","last_undegraded":"2024-09-12T22:13:41.977122+0000","last_fullsized":"2024-09-12T22:13:41.977122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'610","last_scrub_stamp":"2024-09-12T22:13:41.976949+0000","last_deep_scrub":"82'610","last_deep_scrub_stamp":"2024-09-12T22:13:41.976949+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.976949+0000","objects_scrubbed":2,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:53.900021+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'431","reported_seq":1002,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:07.853384+0000","last_change":"2024-09-12T22:14:07.853428+0000","last_active":"2024-09-12T22:14:07.853384+0000","last_peered":"2024-09-12T22:14:07.853384+0000","last_clean":"2024-09-12T22:14:07.853384+0000","last_became_active":"2024-09-12T22:13:23.836708+0000","last_became_peered":"2024-09-12T22:13:23.836708+0000","last_unstale":"2024-09-12T22:14:07.853384+0000","last_undegraded":"2024-09-12T22:14:07.853384+0000","last_fullsized":"2024-09-12T22:14:07.853384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'431","last_scrub_stamp":"2024-09-12T22:14:07.853262+0000","last_deep_scrub":"58'431","last_deep_scrub_stamp":"2024-09-12T22:14:07.853262+0000","last_clean_scrub_stamp":"2024-09-12T22:14:07.853262+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:27.811350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13715,"num_write":391,"num_write_kb":39305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.867859+0000","last_change":"2024-09-12T22:13:41.867859+0000","last_active":"2024-09-12T22:13:41.867859+0000","last_peered":"2024-09-12T22:13:41.867859+0000","last_clean":"2024-09-12T22:13:41.867859+0000","last_became_active":"2024-09-12T22:13:07.743824+0000","last_became_peered":"2024-09-12T22:13:07.743824+0000","last_unstale":"2024-09-12T22:13:41.867859+0000","last_undegraded":"2024-09-12T22:13:41.867859+0000","last_fullsized":"2024-09-12T22:13:41.867859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:41.867742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:41.867742+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.867742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:09.876272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377155,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"82'112","reported_seq":309,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:49.998409+0000","last_change":"2024-09-12T22:13:49.998409+0000","last_active":"2024-09-12T22:13:49.998409+0000","last_peered":"2024-09-12T22:13:49.998409+0000","last_clean":"2024-09-12T22:13:49.998409+0000","last_became_active":"2024-09-12T22:09:49.952264+0000","last_became_peered":"2024-09-12T22:09:49.952264+0000","last_unstale":"2024-09-12T22:13:49.998409+0000","last_undegraded":"2024-09-12T22:13:49.998409+0000","last_fullsized":"2024-09-12T22:13:49.998409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'112","last_scrub_stamp":"2024-09-12T22:13:49.998297+0000","last_deep_scrub":"82'112","last_deep_scrub_stamp":"2024-09-12T22:13:49.998297+0000","last_clean_scrub_stamp":"2024-09-12T22:13:49.998297+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:25.329388+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464601,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":46,"num_write_kb":1459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'449","reported_seq":622,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.133393+0000","last_change":"2024-09-12T22:13:48.133442+0000","last_active":"2024-09-12T22:13:48.133393+0000","last_peered":"2024-09-12T22:13:48.133393+0000","last_clean":"2024-09-12T22:13:48.133393+0000","last_became_active":"2024-09-12T22:13:12.765195+0000","last_became_peered":"2024-09-12T22:13:12.765195+0000","last_unstale":"2024-09-12T22:13:48.133393+0000","last_undegraded":"2024-09-12T22:13:48.133393+0000","last_fullsized":"2024-09-12T22:13:48.133393+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'449","last_scrub_stamp":"2024-09-12T22:13:48.133281+0000","last_deep_scrub":"58'449","last_deep_scrub_stamp":"2024-09-12T22:13:48.133281+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.133281+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:39.397507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33538,"num_write":422,"num_write_kb":96640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:34.034493+0000","last_change":"2024-09-12T22:13:34.034493+0000","last_active":"2024-09-12T22:13:34.034493+0000","last_peered":"2024-09-12T22:13:34.034493+0000","last_clean":"2024-09-12T22:13:34.034493+0000","last_became_active":"2024-09-12T22:13:07.745589+0000","last_became_peered":"2024-09-12T22:13:07.745589+0000","last_unstale":"2024-09-12T22:13:34.034493+0000","last_undegraded":"2024-09-12T22:13:34.034493+0000","last_fullsized":"2024-09-12T22:13:34.034493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:34.034386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:34.034386+0000","last_clean_scrub_stamp":"2024-09-12T22:13:34.034386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:45.571644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036897500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"82'399","reported_seq":520,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:49.107447+0000","last_change":"2024-09-12T22:13:49.107496+0000","last_active":"2024-09-12T22:13:49.107447+0000","last_peered":"2024-09-12T22:13:49.107447+0000","last_clean":"2024-09-12T22:13:49.107447+0000","last_became_active":"2024-09-12T22:13:10.748819+0000","last_became_peered":"2024-09-12T22:13:10.748819+0000","last_unstale":"2024-09-12T22:13:49.107447+0000","last_undegraded":"2024-09-12T22:13:49.107447+0000","last_fullsized":"2024-09-12T22:13:49.107447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'399","last_scrub_stamp":"2024-09-12T22:13:49.107347+0000","last_deep_scrub":"82'399","last_deep_scrub_stamp":"2024-09-12T22:13:49.107347+0000","last_clean_scrub_stamp":"2024-09-12T22:13:49.107347+0000","objects_scrubbed":2,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:19.733424+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'339","reported_seq":834,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:01.032927+0000","last_change":"2024-09-12T22:14:01.032927+0000","last_active":"2024-09-12T22:14:01.032927+0000","last_peered":"2024-09-12T22:14:01.032927+0000","last_clean":"2024-09-12T22:14:01.032927+0000","last_became_active":"2024-09-12T22:13:20.790927+0000","last_became_peered":"2024-09-12T22:13:20.790927+0000","last_unstale":"2024-09-12T22:14:01.032927+0000","last_undegraded":"2024-09-12T22:14:01.032927+0000","last_fullsized":"2024-09-12T22:14:01.032927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'339","last_scrub_stamp":"2024-09-12T22:14:01.032769+0000","last_deep_scrub":"58'339","last_deep_scrub_stamp":"2024-09-12T22:14:01.032769+0000","last_clean_scrub_stamp":"2024-09-12T22:14:01.032769+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:21.004956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16720,"num_write":314,"num_write_kb":34200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"82'3","reported_seq":167,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:53.909991+0000","last_change":"2024-09-12T22:13:53.909991+0000","last_active":"2024-09-12T22:13:53.909991+0000","last_peered":"2024-09-12T22:13:53.909991+0000","last_clean":"2024-09-12T22:13:53.909991+0000","last_became_active":"2024-09-12T22:09:45.815859+0000","last_became_peered":"2024-09-12T22:09:45.815859+0000","last_unstale":"2024-09-12T22:13:53.909991+0000","last_undegraded":"2024-09-12T22:13:53.909991+0000","last_fullsized":"2024-09-12T22:13:53.909991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-09-12T22:13:53.909858+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-09-12T22:13:53.909858+0000","last_clean_scrub_stamp":"2024-09-12T22:13:53.909858+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.519918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00060060799999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"58'65","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:59.929576+0000","last_change":"2024-09-12T22:13:59.929604+0000","last_active":"2024-09-12T22:13:59.929576+0000","last_peered":"2024-09-12T22:13:59.929576+0000","last_clean":"2024-09-12T22:13:59.929576+0000","last_became_active":"2024-09-12T22:13:08.807517+0000","last_became_peered":"2024-09-12T22:13:08.807517+0000","last_unstale":"2024-09-12T22:13:59.929576+0000","last_undegraded":"2024-09-12T22:13:59.929576+0000","last_fullsized":"2024-09-12T22:13:59.929576+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'65","last_scrub_stamp":"2024-09-12T22:13:59.929451+0000","last_deep_scrub":"58'65","last_deep_scrub_stamp":"2024-09-12T22:13:59.929451+0000","last_clean_scrub_stamp":"2024-09-12T22:13:59.929451+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:51.522557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"58'399","reported_seq":945,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.985011+0000","last_change":"2024-09-12T22:13:43.985011+0000","last_active":"2024-09-12T22:13:43.985011+0000","last_peered":"2024-09-12T22:13:43.985011+0000","last_clean":"2024-09-12T22:13:43.985011+0000","last_became_active":"2024-09-12T22:13:11.753527+0000","last_became_peered":"2024-09-12T22:13:11.753527+0000","last_unstale":"2024-09-12T22:13:43.985011+0000","last_undegraded":"2024-09-12T22:13:43.985011+0000","last_fullsized":"2024-09-12T22:13:43.985011+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'399","last_scrub_stamp":"2024-09-12T22:13:43.984840+0000","last_deep_scrub":"58'399","last_deep_scrub_stamp":"2024-09-12T22:13:43.984840+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.984840+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:20.525082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":37206,"num_write":352,"num_write_kb":71597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"82'283","reported_seq":434,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.905143+0000","last_change":"2024-09-12T22:13:55.905143+0000","last_active":"2024-09-12T22:13:55.905143+0000","last_peered":"2024-09-12T22:13:55.905143+0000","last_clean":"2024-09-12T22:13:55.905143+0000","last_became_active":"2024-09-12T22:09:49.948488+0000","last_became_peered":"2024-09-12T22:09:49.948488+0000","last_unstale":"2024-09-12T22:13:55.905143+0000","last_undegraded":"2024-09-12T22:13:55.905143+0000","last_fullsized":"2024-09-12T22:13:55.905143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'283","last_scrub_stamp":"2024-09-12T22:13:55.904976+0000","last_deep_scrub":"82'283","last_deep_scrub_stamp":"2024-09-12T22:13:55.904976+0000","last_clean_scrub_stamp":"2024-09-12T22:13:55.904976+0000","objects_scrubbed":1,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:43.885712+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:49.931935+0000","last_change":"2024-09-12T22:13:49.931964+0000","last_active":"2024-09-12T22:13:49.931935+0000","last_peered":"2024-09-12T22:13:49.931935+0000","last_clean":"2024-09-12T22:13:49.931935+0000","last_became_active":"2024-09-12T22:13:08.740514+0000","last_became_peered":"2024-09-12T22:13:08.740514+0000","last_unstale":"2024-09-12T22:13:49.931935+0000","last_undegraded":"2024-09-12T22:13:49.931935+0000","last_fullsized":"2024-09-12T22:13:49.931935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:49.931837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:49.931837+0000","last_clean_scrub_stamp":"2024-09-12T22:13:49.931837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:53.003810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00038912400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'372","reported_seq":510,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:39.144935+0000","last_change":"2024-09-12T22:13:39.144962+0000","last_active":"2024-09-12T22:13:39.144935+0000","last_peered":"2024-09-12T22:13:39.144935+0000","last_clean":"2024-09-12T22:13:39.144935+0000","last_became_active":"2024-09-12T22:13:15.787420+0000","last_became_peered":"2024-09-12T22:13:15.787420+0000","last_unstale":"2024-09-12T22:13:39.144935+0000","last_undegraded":"2024-09-12T22:13:39.144935+0000","last_fullsized":"2024-09-12T22:13:39.144935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'372","last_scrub_stamp":"2024-09-12T22:13:39.144832+0000","last_deep_scrub":"58'372","last_deep_scrub_stamp":"2024-09-12T22:13:39.144832+0000","last_clean_scrub_stamp":"2024-09-12T22:13:39.144832+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:29.485332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12100,"num_write":347,"num_write_kb":46443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.010725+0000","last_change":"2024-09-12T22:13:35.010725+0000","last_active":"2024-09-12T22:13:35.010725+0000","last_peered":"2024-09-12T22:13:35.010725+0000","last_clean":"2024-09-12T22:13:35.010725+0000","last_became_active":"2024-09-12T22:13:07.742468+0000","last_became_peered":"2024-09-12T22:13:07.742468+0000","last_unstale":"2024-09-12T22:13:35.010725+0000","last_undegraded":"2024-09-12T22:13:35.010725+0000","last_fullsized":"2024-09-12T22:13:35.010725+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-09-12T22:13:35.010613+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-09-12T22:13:35.010613+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.010613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:52.144717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.002097+0000","last_change":"2024-09-12T22:13:58.002120+0000","last_active":"2024-09-12T22:13:58.002097+0000","last_peered":"2024-09-12T22:13:58.002097+0000","last_clean":"2024-09-12T22:13:58.002097+0000","last_became_active":"2024-09-12T22:13:07.745019+0000","last_became_peered":"2024-09-12T22:13:07.745019+0000","last_unstale":"2024-09-12T22:13:58.002097+0000","last_undegraded":"2024-09-12T22:13:58.002097+0000","last_fullsized":"2024-09-12T22:13:58.002097+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:58.002014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:58.002014+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.002014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:42.862328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"58'406","reported_seq":549,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:46.069891+0000","last_change":"2024-09-12T22:13:46.069920+0000","last_active":"2024-09-12T22:13:46.069891+0000","last_peered":"2024-09-12T22:13:46.069891+0000","last_clean":"2024-09-12T22:13:46.069891+0000","last_became_active":"2024-09-12T22:13:12.765188+0000","last_became_peered":"2024-09-12T22:13:12.765188+0000","last_unstale":"2024-09-12T22:13:46.069891+0000","last_undegraded":"2024-09-12T22:13:46.069891+0000","last_fullsized":"2024-09-12T22:13:46.069891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'406","last_scrub_stamp":"2024-09-12T22:13:46.069789+0000","last_deep_scrub":"58'406","last_deep_scrub_stamp":"2024-09-12T22:13:46.069789+0000","last_clean_scrub_stamp":"2024-09-12T22:13:46.069789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:22.437775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11495,"num_write":370,"num_write_kb":79294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'66","reported_seq":225,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.025587+0000","last_change":"2024-09-12T22:13:36.025587+0000","last_active":"2024-09-12T22:13:36.025587+0000","last_peered":"2024-09-12T22:13:36.025587+0000","last_clean":"2024-09-12T22:13:36.025587+0000","last_became_active":"2024-09-12T22:13:07.746556+0000","last_became_peered":"2024-09-12T22:13:07.746556+0000","last_unstale":"2024-09-12T22:13:36.025587+0000","last_undegraded":"2024-09-12T22:13:36.025587+0000","last_fullsized":"2024-09-12T22:13:36.025587+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'66","last_scrub_stamp":"2024-09-12T22:13:36.025461+0000","last_deep_scrub":"82'66","last_deep_scrub_stamp":"2024-09-12T22:13:36.025461+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.025461+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.455807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:33.005647+0000","last_change":"2024-09-12T22:13:33.005647+0000","last_active":"2024-09-12T22:13:33.005647+0000","last_peered":"2024-09-12T22:13:33.005647+0000","last_clean":"2024-09-12T22:13:33.005647+0000","last_became_active":"2024-09-12T22:13:07.743239+0000","last_became_peered":"2024-09-12T22:13:07.743239+0000","last_unstale":"2024-09-12T22:13:33.005647+0000","last_undegraded":"2024-09-12T22:13:33.005647+0000","last_fullsized":"2024-09-12T22:13:33.005647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:33.005510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:33.005510+0000","last_clean_scrub_stamp":"2024-09-12T22:13:33.005510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:48.395884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055647400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'408","reported_seq":576,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:36.979103+0000","last_change":"2024-09-12T22:13:36.979103+0000","last_active":"2024-09-12T22:13:36.979103+0000","last_peered":"2024-09-12T22:13:36.979103+0000","last_clean":"2024-09-12T22:13:36.979103+0000","last_became_active":"2024-09-12T22:09:50.966342+0000","last_became_peered":"2024-09-12T22:09:50.966342+0000","last_unstale":"2024-09-12T22:13:36.979103+0000","last_undegraded":"2024-09-12T22:13:36.979103+0000","last_fullsized":"2024-09-12T22:13:36.979103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'408","last_scrub_stamp":"2024-09-12T22:13:36.978977+0000","last_deep_scrub":"58'408","last_deep_scrub_stamp":"2024-09-12T22:13:36.978977+0000","last_clean_scrub_stamp":"2024-09-12T22:13:36.978977+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:06.536023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3058,"num_write":372,"num_write_kb":34017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'108","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:45.070640+0000","last_change":"2024-09-12T22:13:45.070669+0000","last_active":"2024-09-12T22:13:45.070640+0000","last_peered":"2024-09-12T22:13:45.070640+0000","last_clean":"2024-09-12T22:13:45.070640+0000","last_became_active":"2024-09-12T22:13:10.750231+0000","last_became_peered":"2024-09-12T22:13:10.750231+0000","last_unstale":"2024-09-12T22:13:45.070640+0000","last_undegraded":"2024-09-12T22:13:45.070640+0000","last_fullsized":"2024-09-12T22:13:45.070640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'108","last_scrub_stamp":"2024-09-12T22:13:45.070538+0000","last_deep_scrub":"82'108","last_deep_scrub_stamp":"2024-09-12T22:13:45.070538+0000","last_clean_scrub_stamp":"2024-09-12T22:13:45.070538+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:00.212543+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:47.934647+0000","last_change":"2024-09-12T22:13:47.934647+0000","last_active":"2024-09-12T22:13:47.934647+0000","last_peered":"2024-09-12T22:13:47.934647+0000","last_clean":"2024-09-12T22:13:47.934647+0000","last_became_active":"2024-09-12T22:13:07.745730+0000","last_became_peered":"2024-09-12T22:13:07.745730+0000","last_unstale":"2024-09-12T22:13:47.934647+0000","last_undegraded":"2024-09-12T22:13:47.934647+0000","last_fullsized":"2024-09-12T22:13:47.934647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:13:47.934524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:13:47.934524+0000","last_clean_scrub_stamp":"2024-09-12T22:13:47.934524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:15.934835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040237500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'440","reported_seq":683,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:43.141956+0000","last_change":"2024-09-12T22:13:43.141980+0000","last_active":"2024-09-12T22:13:43.141956+0000","last_peered":"2024-09-12T22:13:43.141956+0000","last_clean":"2024-09-12T22:13:43.141956+0000","last_became_active":"2024-09-12T22:13:10.748774+0000","last_became_peered":"2024-09-12T22:13:10.748774+0000","last_unstale":"2024-09-12T22:13:43.141956+0000","last_undegraded":"2024-09-12T22:13:43.141956+0000","last_fullsized":"2024-09-12T22:13:43.141956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'440","last_scrub_stamp":"2024-09-12T22:13:43.141854+0000","last_deep_scrub":"58'440","last_deep_scrub_stamp":"2024-09-12T22:13:43.141854+0000","last_clean_scrub_stamp":"2024-09-12T22:13:43.141854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:35.490113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":64265,"num_write":407,"num_write_kb":158815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"58'393","reported_seq":915,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:35.844457+0000","last_change":"2024-09-12T22:13:35.844505+0000","last_active":"2024-09-12T22:13:35.844457+0000","last_peered":"2024-09-12T22:13:35.844457+0000","last_clean":"2024-09-12T22:13:35.844457+0000","last_became_active":"2024-09-12T22:13:13.767553+0000","last_became_peered":"2024-09-12T22:13:13.767553+0000","last_unstale":"2024-09-12T22:13:35.844457+0000","last_undegraded":"2024-09-12T22:13:35.844457+0000","last_fullsized":"2024-09-12T22:13:35.844457+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:35.844355+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:35.844355+0000","last_clean_scrub_stamp":"2024-09-12T22:13:35.844355+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:53.301642+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17255,"num_write":357,"num_write_kb":67951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"82'288","reported_seq":457,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:01.933352+0000","last_change":"2024-09-12T22:14:01.933352+0000","last_active":"2024-09-12T22:14:01.933352+0000","last_peered":"2024-09-12T22:14:01.933352+0000","last_clean":"2024-09-12T22:14:01.933352+0000","last_became_active":"2024-09-12T22:13:10.750224+0000","last_became_peered":"2024-09-12T22:13:10.750224+0000","last_unstale":"2024-09-12T22:14:01.933352+0000","last_undegraded":"2024-09-12T22:14:01.933352+0000","last_fullsized":"2024-09-12T22:14:01.933352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'288","last_scrub_stamp":"2024-09-12T22:14:01.933217+0000","last_deep_scrub":"82'288","last_deep_scrub_stamp":"2024-09-12T22:14:01.933217+0000","last_clean_scrub_stamp":"2024-09-12T22:14:01.933217+0000","objects_scrubbed":5,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:51:06.639550+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'447","reported_seq":1033,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.989357+0000","last_change":"2024-09-12T22:13:55.989386+0000","last_active":"2024-09-12T22:13:55.989357+0000","last_peered":"2024-09-12T22:13:55.989357+0000","last_clean":"2024-09-12T22:13:55.989357+0000","last_became_active":"2024-09-12T22:13:13.766869+0000","last_became_peered":"2024-09-12T22:13:13.766869+0000","last_unstale":"2024-09-12T22:13:55.989357+0000","last_undegraded":"2024-09-12T22:13:55.989357+0000","last_fullsized":"2024-09-12T22:13:55.989357+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'447","last_scrub_stamp":"2024-09-12T22:13:55.989230+0000","last_deep_scrub":"58'447","last_deep_scrub_stamp":"2024-09-12T22:13:55.989230+0000","last_clean_scrub_stamp":"2024-09-12T22:13:55.989230+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:02.845340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35990,"num_write":422,"num_write_kb":117228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"82'84","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:58.957710+0000","last_change":"2024-09-12T22:13:58.957747+0000","last_active":"2024-09-12T22:13:58.957710+0000","last_peered":"2024-09-12T22:13:58.957710+0000","last_clean":"2024-09-12T22:13:58.957710+0000","last_became_active":"2024-09-12T22:13:07.745523+0000","last_became_peered":"2024-09-12T22:13:07.745523+0000","last_unstale":"2024-09-12T22:13:58.957710+0000","last_undegraded":"2024-09-12T22:13:58.957710+0000","last_fullsized":"2024-09-12T22:13:58.957710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'84","last_scrub_stamp":"2024-09-12T22:13:58.957616+0000","last_deep_scrub":"82'84","last_deep_scrub_stamp":"2024-09-12T22:13:58.957616+0000","last_clean_scrub_stamp":"2024-09-12T22:13:58.957616+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:41.133914+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"82'216","reported_seq":337,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:02.908503+0000","last_change":"2024-09-12T22:14:02.908533+0000","last_active":"2024-09-12T22:14:02.908503+0000","last_peered":"2024-09-12T22:14:02.908503+0000","last_clean":"2024-09-12T22:14:02.908503+0000","last_became_active":"2024-09-12T22:13:10.748685+0000","last_became_peered":"2024-09-12T22:13:10.748685+0000","last_unstale":"2024-09-12T22:14:02.908503+0000","last_undegraded":"2024-09-12T22:14:02.908503+0000","last_fullsized":"2024-09-12T22:14:02.908503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'216","last_scrub_stamp":"2024-09-12T22:14:02.908416+0000","last_deep_scrub":"82'216","last_deep_scrub_stamp":"2024-09-12T22:14:02.908416+0000","last_clean_scrub_stamp":"2024-09-12T22:14:02.908416+0000","objects_scrubbed":1,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:10.310346+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"58'487","reported_seq":697,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:42.972230+0000","last_change":"2024-09-12T22:13:42.972255+0000","last_active":"2024-09-12T22:13:42.972230+0000","last_peered":"2024-09-12T22:13:42.972230+0000","last_clean":"2024-09-12T22:13:42.972230+0000","last_became_active":"2024-09-12T22:09:50.964270+0000","last_became_peered":"2024-09-12T22:09:50.964270+0000","last_unstale":"2024-09-12T22:13:42.972230+0000","last_undegraded":"2024-09-12T22:13:42.972230+0000","last_fullsized":"2024-09-12T22:13:42.972230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'487","last_scrub_stamp":"2024-09-12T22:13:42.972138+0000","last_deep_scrub":"58'487","last_deep_scrub_stamp":"2024-09-12T22:13:42.972138+0000","last_clean_scrub_stamp":"2024-09-12T22:13:42.972138+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:58.418432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25415,"num_write":449,"num_write_kb":96995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'51","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:50.984939+0000","last_change":"2024-09-12T22:13:50.984969+0000","last_active":"2024-09-12T22:13:50.984939+0000","last_peered":"2024-09-12T22:13:50.984939+0000","last_clean":"2024-09-12T22:13:50.984939+0000","last_became_active":"2024-09-12T22:09:49.952442+0000","last_became_peered":"2024-09-12T22:09:49.952442+0000","last_unstale":"2024-09-12T22:13:50.984939+0000","last_undegraded":"2024-09-12T22:13:50.984939+0000","last_fullsized":"2024-09-12T22:13:50.984939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'51","last_scrub_stamp":"2024-09-12T22:13:50.984833+0000","last_deep_scrub":"58'51","last_deep_scrub_stamp":"2024-09-12T22:13:50.984833+0000","last_clean_scrub_stamp":"2024-09-12T22:13:50.984833+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:34.570531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'431","reported_seq":1029,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:03.039007+0000","last_change":"2024-09-12T22:14:03.039047+0000","last_active":"2024-09-12T22:14:03.039007+0000","last_peered":"2024-09-12T22:14:03.039007+0000","last_clean":"2024-09-12T22:14:03.039007+0000","last_became_active":"2024-09-12T22:13:22.784460+0000","last_became_peered":"2024-09-12T22:13:22.784460+0000","last_unstale":"2024-09-12T22:14:03.039007+0000","last_undegraded":"2024-09-12T22:14:03.039007+0000","last_fullsized":"2024-09-12T22:14:03.039007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'431","last_scrub_stamp":"2024-09-12T22:14:03.038897+0000","last_deep_scrub":"58'431","last_deep_scrub_stamp":"2024-09-12T22:14:03.038897+0000","last_clean_scrub_stamp":"2024-09-12T22:14:03.038897+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:46.102394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27181,"num_write":407,"num_write_kb":71476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'365","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:52.058769+0000","last_change":"2024-09-12T22:13:52.058797+0000","last_active":"2024-09-12T22:13:52.058769+0000","last_peered":"2024-09-12T22:13:52.058769+0000","last_clean":"2024-09-12T22:13:52.058769+0000","last_became_active":"2024-09-12T22:13:14.779152+0000","last_became_peered":"2024-09-12T22:13:14.779152+0000","last_unstale":"2024-09-12T22:13:52.058769+0000","last_undegraded":"2024-09-12T22:13:52.058769+0000","last_fullsized":"2024-09-12T22:13:52.058769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'365","last_scrub_stamp":"2024-09-12T22:13:52.058669+0000","last_deep_scrub":"58'365","last_deep_scrub_stamp":"2024-09-12T22:13:52.058669+0000","last_clean_scrub_stamp":"2024-09-12T22:13:52.058669+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:25.253113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39961,"num_write":334,"num_write_kb":42445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"82'768","reported_seq":933,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.027568+0000","last_change":"2024-09-12T22:13:40.027596+0000","last_active":"2024-09-12T22:13:40.027568+0000","last_peered":"2024-09-12T22:13:40.027568+0000","last_clean":"2024-09-12T22:13:40.027568+0000","last_became_active":"2024-09-12T22:13:10.748056+0000","last_became_peered":"2024-09-12T22:13:10.748056+0000","last_unstale":"2024-09-12T22:13:40.027568+0000","last_undegraded":"2024-09-12T22:13:40.027568+0000","last_fullsized":"2024-09-12T22:13:40.027568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'768","last_scrub_stamp":"2024-09-12T22:13:40.027467+0000","last_deep_scrub":"82'768","last_deep_scrub_stamp":"2024-09-12T22:13:40.027467+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.027467+0000","objects_scrubbed":2,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.189190+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":8531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'414","reported_seq":589,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:40.987436+0000","last_change":"2024-09-12T22:13:40.987436+0000","last_active":"2024-09-12T22:13:40.987436+0000","last_peered":"2024-09-12T22:13:40.987436+0000","last_clean":"2024-09-12T22:13:40.987436+0000","last_became_active":"2024-09-12T22:09:50.964138+0000","last_became_peered":"2024-09-12T22:09:50.964138+0000","last_unstale":"2024-09-12T22:13:40.987436+0000","last_undegraded":"2024-09-12T22:13:40.987436+0000","last_fullsized":"2024-09-12T22:13:40.987436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'414","last_scrub_stamp":"2024-09-12T22:13:40.987282+0000","last_deep_scrub":"58'414","last_deep_scrub_stamp":"2024-09-12T22:13:40.987282+0000","last_clean_scrub_stamp":"2024-09-12T22:13:40.987282+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:48.266861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12069,"num_write":385,"num_write_kb":60739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"82'186","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.018245+0000","last_change":"2024-09-12T22:13:48.018272+0000","last_active":"2024-09-12T22:13:48.018245+0000","last_peered":"2024-09-12T22:13:48.018245+0000","last_clean":"2024-09-12T22:13:48.018245+0000","last_became_active":"2024-09-12T22:09:49.951424+0000","last_became_peered":"2024-09-12T22:09:49.951424+0000","last_unstale":"2024-09-12T22:13:48.018245+0000","last_undegraded":"2024-09-12T22:13:48.018245+0000","last_fullsized":"2024-09-12T22:13:48.018245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'186","last_scrub_stamp":"2024-09-12T22:13:48.018162+0000","last_deep_scrub":"82'186","last_deep_scrub_stamp":"2024-09-12T22:13:48.018162+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.018162+0000","objects_scrubbed":1,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:57.556686+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'392","reported_seq":532,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:07.848986+0000","last_change":"2024-09-12T22:14:07.849037+0000","last_active":"2024-09-12T22:14:07.848986+0000","last_peered":"2024-09-12T22:14:07.848986+0000","last_clean":"2024-09-12T22:14:07.848986+0000","last_became_active":"2024-09-12T22:13:20.790771+0000","last_became_peered":"2024-09-12T22:13:20.790771+0000","last_unstale":"2024-09-12T22:14:07.848986+0000","last_undegraded":"2024-09-12T22:14:07.848986+0000","last_fullsized":"2024-09-12T22:14:07.848986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'392","last_scrub_stamp":"2024-09-12T22:14:07.848852+0000","last_deep_scrub":"58'392","last_deep_scrub_stamp":"2024-09-12T22:14:07.848852+0000","last_clean_scrub_stamp":"2024-09-12T22:14:07.848852+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:08.761904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20289,"num_write":351,"num_write_kb":62758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"82'174","reported_seq":295,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:55.072439+0000","last_change":"2024-09-12T22:13:55.072469+0000","last_active":"2024-09-12T22:13:55.072439+0000","last_peered":"2024-09-12T22:13:55.072439+0000","last_clean":"2024-09-12T22:13:55.072439+0000","last_became_active":"2024-09-12T22:13:10.748594+0000","last_became_peered":"2024-09-12T22:13:10.748594+0000","last_unstale":"2024-09-12T22:13:55.072439+0000","last_undegraded":"2024-09-12T22:13:55.072439+0000","last_fullsized":"2024-09-12T22:13:55.072439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'174","last_scrub_stamp":"2024-09-12T22:13:55.072318+0000","last_deep_scrub":"82'174","last_deep_scrub_stamp":"2024-09-12T22:13:55.072318+0000","last_clean_scrub_stamp":"2024-09-12T22:13:55.072318+0000","objects_scrubbed":3,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:03.849386+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12539696,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12539696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"58'393","reported_seq":542,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:41.137632+0000","last_change":"2024-09-12T22:13:41.137659+0000","last_active":"2024-09-12T22:13:41.137632+0000","last_peered":"2024-09-12T22:13:41.137632+0000","last_clean":"2024-09-12T22:13:41.137632+0000","last_became_active":"2024-09-12T22:13:10.749748+0000","last_became_peered":"2024-09-12T22:13:10.749748+0000","last_unstale":"2024-09-12T22:13:41.137632+0000","last_undegraded":"2024-09-12T22:13:41.137632+0000","last_fullsized":"2024-09-12T22:13:41.137632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'393","last_scrub_stamp":"2024-09-12T22:13:41.137508+0000","last_deep_scrub":"58'393","last_deep_scrub_stamp":"2024-09-12T22:13:41.137508+0000","last_clean_scrub_stamp":"2024-09-12T22:13:41.137508+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:34.388869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14886,"num_write":366,"num_write_kb":84306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"82'59","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:00.939573+0000","last_change":"2024-09-12T22:14:00.939616+0000","last_active":"2024-09-12T22:14:00.939573+0000","last_peered":"2024-09-12T22:14:00.939573+0000","last_clean":"2024-09-12T22:14:00.939573+0000","last_became_active":"2024-09-12T22:13:08.806481+0000","last_became_peered":"2024-09-12T22:13:08.806481+0000","last_unstale":"2024-09-12T22:14:00.939573+0000","last_undegraded":"2024-09-12T22:14:00.939573+0000","last_fullsized":"2024-09-12T22:14:00.939573+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'59","last_scrub_stamp":"2024-09-12T22:14:00.939473+0000","last_deep_scrub":"82'59","last_deep_scrub_stamp":"2024-09-12T22:14:00.939473+0000","last_clean_scrub_stamp":"2024-09-12T22:14:00.939473+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:12.129160+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"58'373","reported_seq":536,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:50.885892+0000","last_change":"2024-09-12T22:13:50.885924+0000","last_active":"2024-09-12T22:13:50.885892+0000","last_peered":"2024-09-12T22:13:50.885892+0000","last_clean":"2024-09-12T22:13:50.885892+0000","last_became_active":"2024-09-12T22:09:50.964265+0000","last_became_peered":"2024-09-12T22:09:50.964265+0000","last_unstale":"2024-09-12T22:13:50.885892+0000","last_undegraded":"2024-09-12T22:13:50.885892+0000","last_fullsized":"2024-09-12T22:13:50.885892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'373","last_scrub_stamp":"2024-09-12T22:13:50.885761+0000","last_deep_scrub":"58'373","last_deep_scrub_stamp":"2024-09-12T22:13:50.885761+0000","last_clean_scrub_stamp":"2024-09-12T22:13:50.885761+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:34.282113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6779,"num_write":346,"num_write_kb":50613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'189","reported_seq":339,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:57.885858+0000","last_change":"2024-09-12T22:13:57.885910+0000","last_active":"2024-09-12T22:13:57.885858+0000","last_peered":"2024-09-12T22:13:57.885858+0000","last_clean":"2024-09-12T22:13:57.885858+0000","last_became_active":"2024-09-12T22:09:49.949777+0000","last_became_peered":"2024-09-12T22:09:49.949777+0000","last_unstale":"2024-09-12T22:13:57.885858+0000","last_undegraded":"2024-09-12T22:13:57.885858+0000","last_fullsized":"2024-09-12T22:13:57.885858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'189","last_scrub_stamp":"2024-09-12T22:13:57.885742+0000","last_deep_scrub":"82'189","last_deep_scrub_stamp":"2024-09-12T22:13:57.885742+0000","last_clean_scrub_stamp":"2024-09-12T22:13:57.885742+0000","objects_scrubbed":2,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:35.926791+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"58'381","reported_seq":903,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:05.935666+0000","last_change":"2024-09-12T22:14:05.935694+0000","last_active":"2024-09-12T22:14:05.935666+0000","last_peered":"2024-09-12T22:14:05.935666+0000","last_clean":"2024-09-12T22:14:05.935666+0000","last_became_active":"2024-09-12T22:13:22.784380+0000","last_became_peered":"2024-09-12T22:13:22.784380+0000","last_unstale":"2024-09-12T22:14:05.935666+0000","last_undegraded":"2024-09-12T22:14:05.935666+0000","last_fullsized":"2024-09-12T22:14:05.935666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'381","last_scrub_stamp":"2024-09-12T22:14:05.935560+0000","last_deep_scrub":"58'381","last_deep_scrub_stamp":"2024-09-12T22:14:05.935560+0000","last_clean_scrub_stamp":"2024-09-12T22:14:05.935560+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:56.989426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10327,"num_write":350,"num_write_kb":33991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"82'191","reported_seq":321,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:14:01.970095+0000","last_change":"2024-09-12T22:14:01.970141+0000","last_active":"2024-09-12T22:14:01.970095+0000","last_peered":"2024-09-12T22:14:01.970095+0000","last_clean":"2024-09-12T22:14:01.970095+0000","last_became_active":"2024-09-12T22:13:10.748515+0000","last_became_peered":"2024-09-12T22:13:10.748515+0000","last_unstale":"2024-09-12T22:14:01.970095+0000","last_undegraded":"2024-09-12T22:14:01.970095+0000","last_fullsized":"2024-09-12T22:14:01.970095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'191","last_scrub_stamp":"2024-09-12T22:14:01.970019+0000","last_deep_scrub":"82'191","last_deep_scrub_stamp":"2024-09-12T22:14:01.970019+0000","last_clean_scrub_stamp":"2024-09-12T22:14:01.970019+0000","objects_scrubbed":4,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:43.785802+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":12348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"58'443","reported_seq":584,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:54.064211+0000","last_change":"2024-09-12T22:13:54.064237+0000","last_active":"2024-09-12T22:13:54.064211+0000","last_peered":"2024-09-12T22:13:54.064211+0000","last_clean":"2024-09-12T22:13:54.064211+0000","last_became_active":"2024-09-12T22:13:14.779155+0000","last_became_peered":"2024-09-12T22:13:14.779155+0000","last_unstale":"2024-09-12T22:13:54.064211+0000","last_undegraded":"2024-09-12T22:13:54.064211+0000","last_fullsized":"2024-09-12T22:13:54.064211+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'443","last_scrub_stamp":"2024-09-12T22:13:54.064086+0000","last_deep_scrub":"58'443","last_deep_scrub_stamp":"2024-09-12T22:13:54.064086+0000","last_clean_scrub_stamp":"2024-09-12T22:13:54.064086+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:09.958311+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":18822,"num_write":404,"num_write_kb":104465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"82'59","reported_seq":222,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:37.998257+0000","last_change":"2024-09-12T22:13:37.998257+0000","last_active":"2024-09-12T22:13:37.998257+0000","last_peered":"2024-09-12T22:13:37.998257+0000","last_clean":"2024-09-12T22:13:37.998257+0000","last_became_active":"2024-09-12T22:13:07.744107+0000","last_became_peered":"2024-09-12T22:13:07.744107+0000","last_unstale":"2024-09-12T22:13:37.998257+0000","last_undegraded":"2024-09-12T22:13:37.998257+0000","last_fullsized":"2024-09-12T22:13:37.998257+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'59","last_scrub_stamp":"2024-09-12T22:13:37.998147+0000","last_deep_scrub":"82'59","last_deep_scrub_stamp":"2024-09-12T22:13:37.998147+0000","last_clean_scrub_stamp":"2024-09-12T22:13:37.998147+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:12.371726+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'460","reported_seq":659,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.916962+0000","last_change":"2024-09-12T22:13:48.917018+0000","last_active":"2024-09-12T22:13:48.916962+0000","last_peered":"2024-09-12T22:13:48.916962+0000","last_clean":"2024-09-12T22:13:48.916962+0000","last_became_active":"2024-09-12T22:09:50.964702+0000","last_became_peered":"2024-09-12T22:09:50.964702+0000","last_unstale":"2024-09-12T22:13:48.916962+0000","last_undegraded":"2024-09-12T22:13:48.916962+0000","last_fullsized":"2024-09-12T22:13:48.916962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'460","last_scrub_stamp":"2024-09-12T22:13:48.916859+0000","last_deep_scrub":"58'460","last_deep_scrub_stamp":"2024-09-12T22:13:48.916859+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.916859+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:36.542559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33775,"num_write":427,"num_write_kb":96026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'114","reported_seq":265,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T22:13:48.991494+0000","last_change":"2024-09-12T22:13:48.991494+0000","last_active":"2024-09-12T22:13:48.991494+0000","last_peered":"2024-09-12T22:13:48.991494+0000","last_clean":"2024-09-12T22:13:48.991494+0000","last_became_active":"2024-09-12T22:09:49.951943+0000","last_became_peered":"2024-09-12T22:09:49.951943+0000","last_unstale":"2024-09-12T22:13:48.991494+0000","last_undegraded":"2024-09-12T22:13:48.991494+0000","last_fullsized":"2024-09-12T22:13:48.991494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'114","last_scrub_stamp":"2024-09-12T22:13:48.991378+0000","last_deep_scrub":"82'114","last_deep_scrub_stamp":"2024-09-12T22:13:48.991378+0000","last_clean_scrub_stamp":"2024-09-12T22:13:48.991378+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:16.999908+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2720,"num_read_kb":1402938,"num_write":24505,"num_write_kb":4338484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7737,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26632,"ondisk_log_size":26632,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127251975,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":1459,"num_write":4483,"num_write_kb":127588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":92225769,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72007680,"data_stored":254503950,"data_compressed":39981697,"data_compressed_allocated":49901568,"data_compressed_original":232464384,"omap_allocated":4443,"internal_metadata":0},"log_size":6327,"ondisk_log_size":6327,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67430,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":64,"seq":274877906963,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76820,"kb_used_data":18756,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94295020,"statfs":{"total":96636764160,"available":96558100480,"internally_reserved":0,"allocated":19206144,"data_stored":93186113,"data_compressed":15717653,"data_compressed_allocated":18251776,"data_compressed_original":92782592,"omap_allocated":6038,"internal_metadata":59435114},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114656,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94257184,"statfs":{"total":96636764160,"available":96519356416,"internally_reserved":0,"allocated":25837568,"data_stored":77917349,"data_compressed":11670781,"data_compressed_allocated":15167488,"data_compressed_original":67805184,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118484,"kb_used_data":29060,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253356,"statfs":{"total":96636764160,"available":96515436544,"internally_reserved":0,"allocated":29757440,"data_stored":85671519,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33715,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":85308081,"data_compressed":12660693,"data_compressed_allocated":16572416,"data_compressed_original":73023488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24883200,"data_stored":76963543,"data_compressed":11637066,"data_compressed_allocated":15122432,"data_compressed_original":67231744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18255872,"data_stored":92232326,"data_compressed":15683938,"data_compressed_allocated":18206720,"data_compressed_original":92209152,"omap_allocated":4443,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:14:34.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T22:14:35.038 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T22:14:35.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:14:35.365 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:14:35.365 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:09:50.290318+0000","modified":"2024-09-12T22:09:52.306690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/363514776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":363514776},{"type":"v1","addr":"172.21.15.19:6803","nonce":363514776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-12T22:14:35.366 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:14:35.378 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:14:35.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:14:35.703 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:09:52:960483+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:09:50.290318+0000","modified":"2024-09-12T22:09:52.306690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/363514776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":363514776},{"type":"v1","addr":"172.21.15.19:6803","nonce":363514776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4204,"qdb_cluster":[4204]},"id":1}]} 2024-09-12T22:14:35.703 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:14:35.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:14:36.004 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:14:36.004 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"2fe6789e-9afe-4094-9a02-5d2cb3971ecc","created":"2024-09-12T22:09:28.783000+0000","modified":"2024-09-12T22:13:24.774641+0000","last_up_change":"2024-09-12T22:13:06.714165+0000","last_in_change":"2024-09-12T22:09:30.541441+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:09:39.111590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:09:44.758823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:09:48.811189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:09:49.271244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e58e9b-56bf-491e-aaa7-2c19805f71f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6801","nonce":3734941882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6803","nonce":3734941882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6807","nonce":3734941882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3734941882},{"type":"v1","addr":"172.21.15.107:6805","nonce":3734941882}]},"public_addr":"172.21.15.107:6801/3734941882","cluster_addr":"172.21.15.107:6803/3734941882","heartbeat_back_addr":"172.21.15.107:6807/3734941882","heartbeat_front_addr":"172.21.15.107:6805/3734941882","state":["exists","up"]},{"osd":1,"uuid":"12c1612a-797e-4568-b2ad-a072c212de6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6801","nonce":2199871564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6803","nonce":2199871564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6807","nonce":2199871564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2199871564},{"type":"v1","addr":"172.21.15.148:6805","nonce":2199871564}]},"public_addr":"172.21.15.148:6801/2199871564","cluster_addr":"172.21.15.148:6803/2199871564","heartbeat_back_addr":"172.21.15.148:6807/2199871564","heartbeat_front_addr":"172.21.15.148:6805/2199871564","state":["exists","up"]},{"osd":2,"uuid":"975ed872-557f-49b3-a957-216e3ae8dbb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":30,"up_from":64,"up_thru":81,"down_at":31,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6801","nonce":29356918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6803","nonce":29356918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6807","nonce":29356918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":29356918},{"type":"v1","addr":"172.21.15.164:6805","nonce":29356918}]},"public_addr":"172.21.15.164:6801/29356918","cluster_addr":"172.21.15.164:6803/29356918","heartbeat_back_addr":"172.21.15.164:6807/29356918","heartbeat_front_addr":"172.21.15.164:6805/29356918","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.777946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.948106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:09:36.460528+0000","dead_epoch":30}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":0,"to":1}]},{"pgid":"3.3","mappings":[{"from":1,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.a","mappings":[{"from":1,"to":2}]},{"pgid":"3.16","mappings":[{"from":1,"to":2}]},{"pgid":"3.1b","mappings":[{"from":1,"to":0}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.1a","mappings":[{"from":0,"to":2}]},{"pgid":"4.20","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:14:36.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T22:14:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T22:14:36.367 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T22:14:36.392 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T22:14:37.377 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T22:14:38.362 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T22:14:38.380 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T22:14:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T22:14:39.388 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T22:14:39.388 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T22:14:39.388 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.398 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T22:14:39.399 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T22:14:39.399 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T22:14:39.399 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.433 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T22:14:39.433 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T22:14:39.434 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.470 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T22:14:39.471 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T22:14:39.471 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.510 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T22:14:39.510 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T22:14:39.510 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T22:14:39.510 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.540 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T22:14:39.541 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T22:14:39.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.608 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T22:14:39.608 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T22:14:39.609 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T22:14:39.609 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.661 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T22:14:39.661 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T22:14:39.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.714 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T22:14:39.714 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T22:14:39.714 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:14:39.766 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T22:14:39.766 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T22:14:39.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T22:14:39.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T22:14:39.842 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T22:14:39.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:14:39.966 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T22:14:40.089 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:14:40.089 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T22:14:40.148 INFO:tasks.ceph:Archiving mon data... 2024-09-12T22:14:40.149 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/data/mon.a.tgz 2024-09-12T22:14:40.149 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:14:40.167 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.Lebm4qr8r5 2024-09-12T22:14:40.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Lebm4qr8r5 2024-09-12T22:14:40.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.Lebm4qr8r5 2024-09-12T22:14:40.397 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.Lebm4qr8r5 is 380KB 2024-09-12T22:14:40.496 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.Lebm4qr8r5 2024-09-12T22:14:40.512 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/data/mon.b.tgz 2024-09-12T22:14:40.512 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:14:40.566 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.nffXe8tt14 2024-09-12T22:14:40.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nffXe8tt14 2024-09-12T22:14:40.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.nffXe8tt14 2024-09-12T22:14:40.826 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.nffXe8tt14 is 531KB 2024-09-12T22:14:40.925 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.nffXe8tt14 2024-09-12T22:14:40.943 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/data/mon.c.tgz 2024-09-12T22:14:40.943 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:14:40.998 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.m0V8VqJLi7 2024-09-12T22:14:40.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.m0V8VqJLi7 2024-09-12T22:14:41.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.m0V8VqJLi7 2024-09-12T22:14:41.256 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.m0V8VqJLi7 is 531KB 2024-09-12T22:14:41.355 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.m0V8VqJLi7 2024-09-12T22:14:41.370 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T22:14:41.371 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:14:41.412 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:14:41.415 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:14:41.418 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:14:41.491 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:14:41.508 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:14:41.527 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:14:41.545 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:14:41.545 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T22:14:41.546 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi019/crash 2024-09-12T22:14:41.547 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:14:41.572 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi107/crash 2024-09-12T22:14:41.573 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:14:41.907 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi148/crash 2024-09-12T22:14:41.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:14:41.944 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi164/crash 2024-09-12T22:14:41.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:14:41.982 INFO:tasks.ceph:Compressing logs... 2024-09-12T22:14:41.982 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:14:41.985 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:14:41.988 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:14:41.990 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:14:42.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30917.log 2024-09-12T22:14:42.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38923.log 2024-09-12T22:14:42.016 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T22:14:42.021 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T22:14:42.062 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.790.log 2024-09-12T22:14:42.062 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30640.log 2024-09-12T22:14:42.062 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T22:14:42.062 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.790.log.gz 2024-09-12T22:14:42.063 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.30640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30600.log 2024-09-12T22:14:42.063 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30640.log.gz 2024-09-12T22:14:42.063 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30560.log 2024-09-12T22:14:42.063 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.30600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30600.log.gz 2024-09-12T22:14:42.063 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.30560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30560.log.gz 2024-09-12T22:14:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35154.log 2024-09-12T22:14:42.085 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30917.log.gz 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38923.log.gz 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33507.log 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35154.log.gz 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30431.log 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31419.log 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33507.log.gz 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30431.log.gz 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35890.log 2024-09-12T22:14:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31419.log.gz 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35113.log 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34629.log 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35890.log.gz 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39049.log 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35113.log.gz 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31337.log 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34629.log.gz 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39049.log.gz 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36025.log 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31337.log.gz 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39175.log 2024-09-12T22:14:42.087 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36025.log.gz 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37392.log 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38439.log 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39175.log.gz 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34143.log 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37392.log.gz 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32260.log 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38439.log.gz 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33310.log 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34143.log.gz 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32260.log.gz 2024-09-12T22:14:42.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33656.log 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33310.log.gz 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37604.log 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30875.log 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33656.log.gz 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37873.log 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37604.log.gz 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32528.log 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30875.log.gz 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39345.log 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37873.log.gz 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30694.log 2024-09-12T22:14:42.089 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32528.log.gz 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30274.log 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39345.log.gz 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34501.log 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30694.log.gz 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31211.log 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30274.log.gz 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34501.log.gz 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30501.log 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31211.log.gz 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38797.log 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35627.log 2024-09-12T22:14:42.090 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30501.log.gz 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32010.log 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38797.log.gz 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35627.log.gz 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39385.log 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32010.log.gz 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35420.log 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39385.log.gz 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33657.log 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35420.log.gz 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38755.log 2024-09-12T22:14:42.091 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38463.log 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33657.log.gz 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36560.log 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38755.log.gz 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39698.log 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38463.log.gz 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36560.log.gz 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34101.log 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39698.log.gz 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35200.log 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34101.log.gz 2024-09-12T22:14:42.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30787.log 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33727.log 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35200.log.gz 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35068.log 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30787.log.gz 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31169.log 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33727.log.gz 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31544.log 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35068.log.gz 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38671.log 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31169.log.gz 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34190.log 2024-09-12T22:14:42.093 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31544.log.gz 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31545.log 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38671.log.gz 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31505.log 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34190.log.gz 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30406.log 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31545.log.gz 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37831.log 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31505.log.gz 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34322.log 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30406.log.gz 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32424.log 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37831.log.gz 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33169.log 2024-09-12T22:14:42.094 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34322.log.gz 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32424.log.gz 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36312.log 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33169.log.gz 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35287.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38080.log 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36312.log.gz 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.38080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33549.log 2024-09-12T22:14:42.095 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38080.log.gz 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38839.log 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.33549.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33549.log.gz 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38839.log.gz 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39656.log 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-09-12T22:14:42.096 INFO:teuthology.orchestra.run.smithi019.stderr: 95.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36662.log 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39656.log.gz 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34934.log 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34231.log 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36662.log.gz 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34934.log.gz 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31043.log 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34231.log.gz 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31253.log 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz 2024-09-12T22:14:42.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37561.log 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31043.log.gz 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31417.log 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31253.log.gz 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33863.log 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37561.log.gz 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35805.log 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31417.log.gz 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36111.log 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33863.log.gz 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38629.log 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35805.log.gz 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38545.log 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36111.log.gz 2024-09-12T22:14:42.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38206.log 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38629.log.gz 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38545.log.gz 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34807.log 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29030.log 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38206.log.gz 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30745.log 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34807.log.gz 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.29030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38167.log 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29030.log.gz 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31127.log 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30745.log.gz 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36940.log 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38167.log.gz 2024-09-12T22:14:42.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31127.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31127.log.gz 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.36940.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34409.log 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36940.log.gz 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31884.log 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34409.log.gz 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36986.log/var/log/ceph/ceph-mds.a.log: 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30155.log 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31884.log.gz 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36986.log.gz 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37260.log 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37199.log 2024-09-12T22:14:42.100 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30155.log.gz 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37260.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39427.log 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35850.log 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37199.log.gz 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39427.log.gzgzip 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35937.log 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37140.log 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35850.log.gz 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35937.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.35937.log.gz 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30606.log 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38079.log 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37140.log.gz 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30606.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.30606.log.gz 2024-09-12T22:14:42.101 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.34894.log 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31842.log 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38079.log.gz 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35461.log 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34894.log.gz 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31418.log 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31842.log.gz 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35461.log.gz 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34054.log 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37705.log 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31418.log.gz 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34054.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.36184.log -- replaced with /var/log/ceph/ceph-client.admin.34054.log.gz 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T22:14:42.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31926.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37705.log.gz 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33816.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31926.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31926.log.gz 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37347.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33816.log.gz 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32322.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34277.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37347.log.gz 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32322.log.gz 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37049.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31085.log 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34277.log.gz 2024-09-12T22:14:42.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37049.log.gz 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34004.log 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31085.log.gz 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31652.log 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34720.log 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34004.log.gz 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31651.log 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31652.log.gz 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35240.log 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34720.log.gz 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31651.log.gz 2024-09-12T22:14:42.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35717.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35374.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35240.log.gz 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30650.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35717.log.gz 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35374.log.gz 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34364.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31758.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30650.log.gz 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34364.log.gz 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33374.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38965.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31758.log.gz 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34849.log 2024-09-12T22:14:42.105 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33374.log.gz 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37915.log 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38965.log.gz 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32134.log 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34849.log.gz 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37915.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37915.log.gz 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31001.log 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32134.log.gz 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33460.log 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31295.log 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31001.log.gz 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2024-09-12T22:14:42.106 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33460.log.gz 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31295.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.31295.log.gz /var/log/ceph/ceph-client.admin.30350.log 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30350.log.gz 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36381.log 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32935.log 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36381.log.gz 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33964.log 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36469.log 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32935.log.gz 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34543.log 2024-09-12T22:14:42.107 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33964.log.gz 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34981.log 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36469.log.gz 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34543.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34543.log.gz 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34981.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.34981.log.gz -- 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.30132.log 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39007.log 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.30132.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30132.log.gz 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38293.log 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39007.log: 94.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39007.log.gz 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39303.log 2024-09-12T22:14:42.108 INFO:teuthology.orchestra.run.smithi019.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39553.log 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38293.log.gz 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36692.log 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39303.log.gz 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37789.log 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39553.log.gz 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36692.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.36692.log.gz 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.30563.log 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37789.log.gz 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37999.log 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30563.log.gz 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-09-12T22:14:42.109 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37999.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37999.log.gz 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39511.log 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39511.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.39511.log.gz 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.32176.log 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29899.log 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32176.log.gz 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36204.log 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29899.log.gz 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32425.log 2024-09-12T22:14:42.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36204.log.gz 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35763.log 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33309.log 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32425.log.gz 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35763.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35763.log.gz 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32619.log 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37305.log 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33309.log.gz 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34675.log 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32619.log.gz 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32423.log 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37305.log.gz 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31968.log 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34675.log.gz 2024-09-12T22:14:42.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32423.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.32423.log.gz 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37747.log 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30959.log 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31968.log.gz 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37747.log.gz 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30959.log.gz 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33596.log 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39469.log 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33416.log 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33596.log.gz 2024-09-12T22:14:42.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31672.log 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39469.log.gz 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33416.log.gz 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33048.log 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31672.log.gz 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31800.log 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.33048.log: gzip -5 --verbose -- 33.5% /var/log/ceph/ceph-client.admin.32052.log 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.33048.log.gz 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31800.log.gz 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36070.log 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39217.log 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32052.log: 47.7% -- replaced with /var/log/ceph/ceph-client.admin.32052.log.gz 2024-09-12T22:14:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36070.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36070.log.gz 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.39133.log 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39217.log.gz 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36614.log 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37957.log 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39133.log.gz 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36614.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36614.log.gz 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.34762.log 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37957.log.gz 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32218.log 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30829.log 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34762.log.gz 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35026.log 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32218.log.gz 2024-09-12T22:14:42.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36899.log 2024-09-12T22:14:42.115 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30829.log.gz 2024-09-12T22:14:42.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39613.log 2024-09-12T22:14:42.115 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35026.log.gz 2024-09-12T22:14:42.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36899.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.36899.log.gz /var/log/ceph/ceph-client.admin.36812.log 2024-09-12T22:14:42.115 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T22:14:42.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39613.log.gz 2024-09-12T22:14:42.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36812.log.gz 2024-09-12T22:14:42.123 INFO:teuthology.orchestra.run.smithi019.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T22:14:42.160 INFO:teuthology.orchestra.run.smithi019.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T22:14:42.188 INFO:teuthology.orchestra.run.smithi019.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T22:14:42.283 INFO:teuthology.orchestra.run.smithi019.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T22:14:42.285 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T22:14:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m0.286s 2024-09-12T22:14:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m0.636s 2024-09-12T22:14:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.120s 2024-09-12T22:14:42.910 INFO:teuthology.orchestra.run.smithi164.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T22:14:42.912 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-12T22:14:42.912 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m0.872s 2024-09-12T22:14:42.912 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m0.808s 2024-09-12T22:14:42.912 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.040s 2024-09-12T22:14:46.985 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.0.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T22:14:46.986 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T22:14:46.986 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m4.984s 2024-09-12T22:14:46.987 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m4.791s 2024-09-12T22:14:46.987 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.195s 2024-09-12T22:14:47.069 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T22:14:47.070 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-12T22:14:47.070 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m5.065s 2024-09-12T22:14:47.070 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m4.875s 2024-09-12T22:14:47.071 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.191s 2024-09-12T22:14:47.071 INFO:tasks.ceph:Archiving logs... 2024-09-12T22:14:47.071 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi019/log 2024-09-12T22:14:47.072 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:14:47.370 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi107/log 2024-09-12T22:14:47.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:14:48.150 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi148/log 2024-09-12T22:14:48.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:14:48.916 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi164/log 2024-09-12T22:14:48.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:14:49.072 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T22:14:49.081 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T22:14:49.082 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:14:49.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:14:49.087 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:14:49.089 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:14:49.220 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T22:14:49.230 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T22:14:49.231 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:14:49.234 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:14:49.236 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:14:49.239 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:14:49.249 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:14:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:14:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:14:49.254 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:14:49.254 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T22:14:49.254 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 -492us[ -491us] +/- 61ms 2024-09-12T22:14:49.254 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 +110us[ +110us] +/- 63ms 2024-09-12T22:14:49.254 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +487us[ +488us] +/- 77ms 2024-09-12T22:14:49.254 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:14:49.255 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:14:49.255 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-12T22:14:49.255 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 -485us[ -473us] +/- 61ms 2024-09-12T22:14:49.255 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 +121us[ +132us] +/- 63ms 2024-09-12T22:14:49.255 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +496us[ +507us] +/- 77ms 2024-09-12T22:14:49.255 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:14:49.257 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:14:49.258 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:14:49.258 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-12T22:14:49.258 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 -479us[ -475us] +/- 61ms 2024-09-12T22:14:49.258 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 +140us[ +140us] +/- 63ms 2024-09-12T22:14:49.259 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +517us[ +521us] +/- 77ms 2024-09-12T22:14:49.259 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:14:49.261 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:14:49.261 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-12T22:14:49.262 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 37 50 -477us[ -384us] +/- 61ms 2024-09-12T22:14:49.262 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 37 49 +152us[ +152us] +/- 63ms 2024-09-12T22:14:49.262 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 37 50 +484us[ +577us] +/- 77ms 2024-09-12T22:14:49.262 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:14:49.262 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T22:14:49.271 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T22:14:49.271 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T22:14:49.295 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:14:49.373 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:14:49.444 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:14:49.516 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:14:49.639 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:14:49.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:49.673 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:14:49.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:49.705 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:14:49.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:49.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:14:49.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:49.766 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T22:14:49.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T22:14:49.812 INFO:teuthology.task.internal:Duration was 674.765023 seconds 2024-09-12T22:14:49.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T22:14:49.845 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T22:14:49.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:14:49.848 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:14:49.851 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:14:49.853 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:14:49.892 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:14:49.893 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:14:49.894 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:14:49.922 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:14:50.185 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T22:14:50.188 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T22:14:50.188 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:14:50.212 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T22:14:50.213 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:14:50.249 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:14:50.249 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:14:50.277 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-09-12T22:14:50.277 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:14:50.301 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T22:14:50.301 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:14:50.304 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:14:50.306 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:14:50.320 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:14:50.369 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T22:14:50.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:14:50.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:14:50.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:14:50.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:14:50.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T22:14:50.502 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T22:14:50.502 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:14:50.528 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:14:50.553 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:14:50.580 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:14:50.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T22:14:50.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.642 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-12T22:14:50.643 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-09-12T22:14:50.645 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-12T22:14:50.684 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-09-12T22:14:50.705 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:50.721 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:50.735 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:50.750 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:14:50.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:14:50.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T22:14:50.775 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T22:14:50.776 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi019 2024-09-12T22:14:50.777 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:14:50.815 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi107 2024-09-12T22:14:50.815 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:14:50.848 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi148 2024-09-12T22:14:50.848 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:14:50.886 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902919/remote/smithi164 2024-09-12T22:14:50.887 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:14:50.918 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T22:14:50.918 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:14:50.921 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:14:50.923 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:14:50.925 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:14:50.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T22:14:50.982 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T22:14:50.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T22:14:51.005 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T22:14:51.005 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:14:51.010 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:14:51.013 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:14:51.015 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:14:51.023 INFO:teuthology.orchestra.run.smithi019.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:14 /home/ubuntu/cephtest 2024-09-12T22:14:51.025 INFO:teuthology.orchestra.run.smithi107.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:14 /home/ubuntu/cephtest 2024-09-12T22:14:51.027 INFO:teuthology.orchestra.run.smithi148.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:14 /home/ubuntu/cephtest 2024-09-12T22:14:51.030 INFO:teuthology.orchestra.run.smithi164.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:14 /home/ubuntu/cephtest 2024-09-12T22:14:51.031 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T22:14:51.041 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T22:14:51.108 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 674.7650234699249 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T22:14:51.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T22:14:51.193 INFO:teuthology.run:pass